diff --git a/spikes/ovn/README.md b/spikes/ovn/README.md index 8ca2c83..921f8a1 100644 --- a/spikes/ovn/README.md +++ b/spikes/ovn/README.md @@ -1,6 +1,14 @@ # OVN mechanism spike -**2026-09-12 — NOT SMOOTH.** Step 6 did not fail cleanly with central down: +**Current verdict: PROCEED.** Removing the conflicting `default/soak01` +macvlan fixture restored lab01's uplink. The first post-removal lab01-gateway +cycle passed every check in **31.018 s**, with successful OVS parent attachment +and no EBUSY retries. The two operating requirements are exclusive +`fast40-uplink` ownership of `fast40` and central availability for OVN +control-plane operations. See the parent-conflict recovery section at the end +and its [evidence](parent-recovery-2026-09-12/). + +**Initial 2026-09-12 verdict — NOT SMOOTH (superseded below).** Step 6 did not fail cleanly with central down: network creation timed out and left an `Errored` network. Step 7 recreated cross-member connectivity, but gateway and internet egress failed without manual repair. The first pass's dataplane worked. This verdict uses steps @@ -11,13 +19,13 @@ manual repair. The first pass's dataplane worked. This verdict uses steps - [Report and probe PR #15](https://github.com/GilmanLab/agentcompute/pull/15) - [Northbound-unset reproduction](https://github.com/lxc/incus/issues/3948#issuecomment-5642832127) -The owner decides whether to use the documented bridge alternative. This -experiment does not change the design draft or choose another architecture. +The owner authorized proceeding with OVN after the parent-conflict recovery. +Historical failed runs remain recorded below; no bridge alternative was implemented. ## Retained state and Phase 5 handoff -The resume instruction supersedes the original rollback requirement. These -resources remain deliberately enabled despite the negative verdict: +The resume instruction superseded the original rollback requirement. These +resources remain enabled for Phase 5 under the current PROCEED requirements: | Resource | Retained configuration | | --- | --- | @@ -350,3 +358,283 @@ resources. Both guests need curl and the HTTP fixture prepared by the helper. The retained configuration is converged. OVN lifecycle repeatability is not qualified by this spike. + +## 2026-09-12 — recreate and gateway diagnosis + +**Verdict: FALLBACK**, under the owner's follow-up rule. A fresh nas01-gateway +cycle passed; a lab01-gateway cycle failed before and after one authorized +reboot. No fallback architecture was implemented. The failed keeper was removed +through fleet; the uplink, chassis configuration, central, and unrelated +instances were otherwise left in place as requested. + +### One-command cycle + +From this repository, with the existing Incus remote and SSH access to +`sandbox01` and gw01: + +```sh +bash spikes/ovn/probe.sh cycle --evidence-dir "$(mktemp -d)" +``` + +This creates, probes, and destroys the owned disposable topology. It records +commands, elapsed times, network/router identity, NB/SB state, gateway neighbor +state, OVS journals, Incus debug monitors, and a bounded ARP capture. Monitor +readiness requires the client's successful `/1.0/events?all-projects=true` +WebSocket connection, not a sleep or a running PID. + +The probe checks both directions of cross-member ping and 100 MB HTTP transfers +with SHA-256, both guests' gateway ping, DNS and HTTPS, and the workstation's +exact forward body. Probe-tool packages are downloaded on the workstation and +installed with signature verification through Incus file transfer: broken guest +egress must not prevent the remaining datapath checks from running. + +There is one create attempt and no automatic recovery. The cycle never stops +central, creates a keeper, changes chassis configuration, or clears neighbors. +`--keep-on-failure` explicitly preserves failed resources for diagnosis; +otherwise teardown runs even after a failed probe. + +### Cycle results + +[Structured cycle table](diagnosis-2026-09-12/cycle-table.json). External +addresses below are in `10.10.40.0/24`; router names are NB logical routers. +Gateway placement comes from SB binding, not the container's member. + +| Run | NB router | Gateway | External IP | Router MAC | Result | Seconds | +| --- | --- | --- | --- | --- | --- | ---: | +| clean-1 | incus-net24-lr | lab01 | .64 | 10:66:6a:49:f5:82 | Fail; bootstrap blocked by egress | 50.489 | +| keeper-1 | incus-net26-lr | nas01 | .65 | 10:66:6a:ed:13:7f | Pass | 29.756 | +| keeper-2 | incus-net27-lr | lab03 | .65 | 10:66:6a:6c:ad:18 | Pass | 32.190 | +| keeper-3 | incus-net28-lr | lab01 | .65 | 10:66:6a:14:21:7e | Fail; north-south only | 61.306 | +| outage-fixture | incus-net29-lr | lab01 | .65 | 10:66:6a:ab:ba:f8 | Fail; north-south only | 55.432 | +| post-outage | incus-net31-lr | nas01 | .65 | 10:66:6a:ea:40:3b | Pass | 31.078 | +| gateway-pre-1 | incus-net32-lr | lab02 | .64 | 10:66:6a:33:3f:c7 | Pass | 33.092 | +| gateway-pre-2 | incus-net33-lr | lab02 | .64 | 10:66:6a:74:95:5e | Pass | 29.904 | +| gateway-pre-3 | incus-net34-lr | lab02 | .64 | 10:66:6a:1f:21:eb | Pass | 31.142 | +| gateway-pre-4 | incus-net35-lr | lab02 | .64 | 10:66:6a:97:88:42 | Pass | 32.274 | +| gateway-pre-5 | incus-net36-lr | nas01 | .64 | 10:66:6a:ef:03:ee | Pass | 32.470 | +| gateway-pre-6 | incus-net37-lr | lab01 | .64 | 10:66:6a:b2:7a:65 | Fail; north-south only | 60.817 | +| gateway-post-1 | incus-net38-lr | lab01 | .64 | 10:66:6a:43:84:fe | Fail; north-south only | 61.572 | + +All full probes after `clean-1` passed east-west ping and both 100 MB hash +checks, including the failed lab01-gateway cycles. Those failures comprised +gateway ping, DNS and HTTPS from both guests, plus the workstation forward. +The first cycle used guest-side package bootstrap; fallback checks established +cross-member ping but no 100 MB or forward fixture was installed. + +Times include capture/setup/probe/cleanup work, except the explicitly retained +`clean-1` and `outage-fixture`. The former was deleted after the neighbor-clear +test; the latter after the outage experiment. All other cycles completed their +own teardown. No disposable topology remains. + +### Hypotheses and bounded recovery + +- **H3, stale gw01 neighbor state:** clearing only `.64` on gw01 did not restore + gateway ping in the unchanged failed clean topology. With the keeper holding + `.64`, clearing only the failed router's `.65` entry also did not restore + connectivity. Both bounded sandbox01 ARP captures remained empty. A stale + gw01 entry is not a sufficient explanation for these failures. +- **H1, last-consumer uplink teardown:** the keeper kept an OVN consumer alive, + but its three cycles were pass/pass/fail. Failure followed lab01 gateway + placement even without last-consumer teardown. H1 was not established as a + teardown regression; the keeper did not qualify and was removed. +- **H2, reboot-recoverable chassis corruption:** the requested recovery criterion + failed. Lab01 still failed as gateway after reboot. Do not interpret the + successful nas01 control as lab01 recovery. + +The original OVS journal, before sustained rate limiting, reports: + +```text +system@ovs-system: failed to add fast40 as port: Device or resource busy +could not add network device fast40 to ofproto (Device or resource busy) +``` + +Incus lists `fast40-uplink` and `soak01` as consumers of lab01's `fast40`. +`soak01` has an active raw macvlan NIC on that parent. Its configuration was +unchanged, and the NIC was up before and after reboot. The same OVS errors +recurred in the fresh-boot cycle. **Inference:** the active macvlan is the likely +competing attachment; IncusOS's supported API does not expose kernel RX-handler +ownership or an `ovs-vsctl show` equivalent. We did not remove that NIC to test +the inference and do not claim a confirmed kernel/OVS corruption cause. + +Evidence: [parent consumer](diagnosis-2026-09-12/lab01-parent-consumer.json), +[original journal](diagnosis-2026-09-12/lab01-original-ovs-journal.json), +[post-reboot errors](diagnosis-2026-09-12/lab01-post-reboot-ovs-conflict.json). +Persistent gateway failure reported as +[lxc/incus#3986](https://github.com/lxc/incus/issues/3986), including the +macvlan precondition and the distinction between unsupported parent sharing and +silently accepting/selecting an unprogrammable gateway. + +### Reboot evidence + +Fleet submitted exactly one lab01 reboot, request +`phase3-recreate-lab01-20260912`. ONLINE status and a different boot ID were both +required before the post-reboot cycle. + +| Observation | Before | After | +| --- | --- | --- | +| Boot ID | f9f71dd5a051466283d7da6fb860c528 | b5e39bb2a73f421c9b89a935f9f116b2 | +| Incus | 7.4 | 7.4 | +| IncusOS | 202608242359 | 202609100026 | +| Kernel | 7.1.10-zabbly+ | 7.2.4-zabbly+ | +| soak01 macvlan eth1 | Up | Up | +| lab01 gateway probe | Fail | Fail | + +Lab01 returned ONLINE after **146.549 s**. The reboot activated an OS/kernel +update, so this was not a same-software reboot comparison. The failure persisted +across that change. See [reboot comparison](diagnosis-2026-09-12/reboot-comparison.json) +and [readiness observation](diagnosis-2026-09-12/reboot-watch/reboot.json). + +### Northbound outage + +The single follow-up central outage reproduced the creation problem: the client +deadline expired after **60.019 s**, leaving an `Errored` network reserving `.66`. +Restarting central did not change that state. Explicit deletion succeeded; +without a service, chassis, uplink, or neighbor repair, the subsequent fresh +cycle passed on nas01 in **31.078 s**. + +This outage fixture already had broken north-south traffic before central was +stopped; it is not new evidence of egress surviving an outage. The original +spike's outage observations remain separate. + +Reported as [lxc/incus#3985](https://github.com/lxc/incus/issues/3985). +See [outage results](diagnosis-2026-09-12/outage/outage.json) and its command and +monitor logs. The hypothesis that connection initialization escapes the +transaction timeout remains source-based, not a stack-trace diagnosis. + +### Address accounting and final state + +A tested sandbox consumes **two external addresses**: one NAT router address +and one forward listen address. Multiple ports on the same forward address do +not require additional addresses. The 16-address allocation has capacity for +eight such sandboxes with no keeper, or seven plus one spare while a keeper +reserves one address. The keeper was removed and now consumes zero. + +After the final failed cycle: + +- All four cluster members ONLINE; central's four units active; four SB chassis. +- No disposable project, keeper, NB logical topology, or Errored network remains. +- Fleet OVN dry-run: all ten operations unchanged, **3.429 s**. +- Fleet keeper dry-run: absent and unchanged, **0.696 s**. +- Uplink/chassis/central retained as the owner requested; `soak01` unchanged + apart from its authorized host reboot and automatic restart. + +The [execution log](diagnosis-2026-09-12/execution.jsonl) records fleet +operations and final checks. Per-cycle directories contain the command, +probe, monitor, ARP, and NB/SB evidence. Published OVS journal responses retain +timestamp, host, boot ID when available, and message; unrelated journal +metadata is projected out and marked in command records. Original raw captures +were preserved privately before this reduction. + +Publication checks: fleet pytest **39 passed**; mypy passed **17 source files**; +Ruff passed for the new fleet deploy and both Python probe helpers; Bash syntax, +Python compilation, and the actual cycle CLI help passed. The companion +address-plan site built successfully with `moon run docs:build`. No additional +live cycle was run after the owner's FALLBACK condition was established. + +## 2026-09-12 — parent conflict resolved + +**PROCEED** under the owner's final decision rule. `soak01` was an authorized +03c fixture, not a durable workload. Its raw macvlan `eth1` and OVS competed for +the same `fast40` RX handler. Fleet stopped and deleted only `default/soak01` +on lab01. Graceful stop reached its 30-second deadline; a fleet force-stop +then succeeded, followed by deletion of the stopped VM. The API returned +`Instance not found`, and `fast40.used_by` then contained only +`/1.0/networks/fast40-uplink`. + +No reboot, central restart, chassis change, or neighbor clear accompanied this +recovery. Lab01 kept boot ID `b5e39bb2a73f421c9b89a935f9f116b2`. + +### Attachment and qualification evidence + +The first new cycle selected **lab01** as gateway: + +| Field | Observed value | +| --- | --- | +| NB router | `incus-net39-lr` | +| Router external address | `10.10.40.64` | +| Router MAC | `10:66:6a:66:eb:74` | +| Network creation | 0.669 s | +| Complete create/probe/diagnose/destroy cycle | **31.018 s** | +| Probe, capture, and cleanup failures | None | + +All checks passed: cross-member ping, both 100 MB SHA-256 transfers, both guests' +gateway ping, DNS and HTTPS egress, and the workstation forward. The cycle +destroyed its disposable project and network normally. + +Lab01's OVS journal records: + +```text +ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1 +``` + +There were **zero `Device or resource busy` messages** in the captured +post-removal interval. After the successful workload checks, normal +last-consumer teardown logged: + +```text +ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1 +``` + +Thus the port was present for the active OVN topology, not left artificially +attached after teardown. The earlier gateway failure was fixture-induced +parent contention, not a demonstrated OVN recreate regression. + +See [cycle output](parent-recovery-2026-09-12/cycle-1/cycle.json), +[probe transcript](parent-recovery-2026-09-12/cycle-1/probe.stdout.txt), +[attachment journal](parent-recovery-2026-09-12/lab01-attachment-journal.json), +and [fleet command transcript](parent-recovery-2026-09-12/execution.jsonl). +The temporary fixture-removal deploy is retained as evidence text, not a +permanent deploy that could delete a future instance with the same name. + +### Required operating rules + +1. **Exclusive parent ownership.** Only default-project `fast40-uplink` may + attach to `fast40` on any member. No instance or profile may attach a raw + macvlan/physical NIC to that parent, and no competing managed network may + claim it. Sandbox projects use `restricted.devices.nic=managed`; this is + already set by both the production sandbox adapter and spike helper. + Fleet checks default-project instances (including expanded devices), + profiles, and member-specific network configuration before OVN convergence. + The check reports conflicts and refuses to proceed; it never deletes them. + Default-project administrator changes must pass that fleet check. +2. **Central-up control plane.** OVN create/update/delete operations require + central to be available. A timed-out create may leave an `Errored` network + and an external address reservation. After central recovers, the reaper + can delete that network and retry cleanup; the experiment demonstrated + deletion-only recovery. Existing forwarding during an outage is a separate + dataplane property, not permission to perform control-plane operations. + +These rules are also recorded in session 019's `ARCHITECTURE_GO.md` and +`prompts/05-durable-ovn.md`. Incus +[#3986](https://github.com/lxc/incus/issues/3986) remains a legitimate report: +the parent conflict explains the attachment failure, but selecting that +unusable gateway without an actionable API error remains the reported behavior. +The northbound creation issue [#3985](https://github.com/lxc/incus/issues/3985) +is independent. Both #3985 and #3986 were automatically closed by the +repository's web-interface-only issue submission policy, not a technical +resolution. The root-cause update was posted to the existing #3986 as +requested; neither report has been resubmitted or reopened. + +### Ownership check and final verification + +The fleet OVN deploy now runs the read-only ownership check before any +convergence. It also rejects direct physical-uplink NICs and +`bridge.external_interfaces` claims, not only raw NIC `parent` fields. +Run the check independently from `fleet/cluster`: + +```sh +uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_parent_check.py -v --yes +``` + +The final live check passed without changes in **2.434 s**. The full fleet OVN +dry-run passed with **11 unchanged operations** in **4.514 s**. Fleet pytest +passed **47 tests**; mypy passed **18 source files**; Ruff passed. Regression +cases cover inherited/stopped-instance NICs, profile NICs, member-specific +network parents, direct physical-uplink NICs, bridge external interfaces, +allowed logical OVN NICs, and missing inspection data. The bridge-interface +case failed before the guard covered that attachment path and passed afterward. + +All four members remain ONLINE. Central's four units are active; no disposable +NB topology, keeper, or `soak01` remains. The address-plan site built with +`moon run docs:build`. Architecture and Phase 5 requirements were committed +to the personal journal branch without changing other session files. diff --git a/spikes/ovn/cycle.py b/spikes/ovn/cycle.py new file mode 100755 index 0000000..90274b0 --- /dev/null +++ b/spikes/ovn/cycle.py @@ -0,0 +1,993 @@ +#!/usr/bin/env python3 +"""One-command OVN create/probe/destroy cycle with bounded diagnostics. + +Invoked as: spikes/ovn/probe.sh cycle --evidence-dir PATH [--keep-on-failure] + +Reuses topology.py for lifecycle. Does not stop central, run keeper, or +clear neighbor/ARP state. One create attempt; no bootstrap retries. +""" + +import argparse +import json +import os +import shutil +import signal +import subprocess +import sys +import threading +import time +from datetime import datetime, timezone +from pathlib import Path +from urllib.parse import urlencode + +HERE = Path(__file__).resolve().parent +TOPOLOGY = HERE / "topology.py" +PROBE = HERE / "probe.sh" + +REMOTE = "nas01" +PROJECT = "ac-ovn-spike" +NETWORK = "default" +INSTANCE_ONE = "one" +INSTANCE_TWO = "two" +FORWARD_LISTEN = "10.10.40.79" +FORWARD_PORT = 8080 +MARKER = "ovn-spike-ok" +UPLINK_GATEWAY = "10.10.40.1" +DNS_NAME = "example.com" + +GATEWAY_KEY = Path("/Users/josh/.ssh/vyos-gateway") +SSH_SANDBOX = [ + "ssh", + "-o", + "BatchMode=yes", + "-o", + "ConnectTimeout=10", + "josh@sandbox01", +] +SSH_GATEWAY = [ + "ssh", + "-o", + "BatchMode=yes", + "-o", + "ConnectTimeout=10", + "-i", + str(GATEWAY_KEY), + "vyos@10.0.0.2", +] + +CREATE_TIMEOUT = 900 +DESTROY_TIMEOUT = 300 +PROBE_TIMEOUT = 600 +DIAG_TIMEOUT = 45 +TCPDUMP_READY_TIMEOUT = 15 +MONITOR_READY_TIMEOUT = 15 +TCPDUMP_BOUND = 180 +WEBSOCKET_READY = "Connected to the websocket:" +EVENTS_PATH = "/1.0/events" + + +def utcnow(): + return datetime.now(timezone.utc).isoformat() + + +def fail_preflight(message): + print(f"cycle: {message}", file=sys.stderr) + raise SystemExit(2) + + +class Capture: + """Background process with a stdout log and optional client-debug stderr.""" + + def __init__(self, name, args, log_path): + self.name = name + self.args = args + self.log_path = Path(log_path) + self.debug_path = None + self.proc = None + self.log = None + self.pid = None + self.started_at = None + self.stopped_at = None + self.returncode = None + self.ready = False + self.ready_line = None + self.error = None + self.thread = None + self.ready_event = threading.Event() + + def alive(self): + return self.proc is not None and self.proc.poll() is None + + +class Cycle: + def __init__(self, evidence_dir, keep_on_failure): + self.evidence = Path(evidence_dir) + self.keep_on_failure = keep_on_failure + self.commands_path = self.evidence / "commands.jsonl" + self.topology_log = self.evidence / "topology.jsonl" + self.started_at = utcnow() + self.t0 = time.monotonic() + self.captures = [] + self.check_failures = [] + self.capture_failures = [] + self.cleanup_failures = [] + self.external_ip = None + self.router_mac = None + self.create = None + self.probe = None + self.fallback = None + self.destroy = None + self.teardown = "not-attempted" + self.create_attempted = False + + def record(self, event): + event.setdefault("at", utcnow()) + with self.commands_path.open("a", encoding="utf-8") as fh: + fh.write(json.dumps(event, default=str) + "\n") + + def run(self, args, timeout=180, cwd=None): + started = time.monotonic() + try: + result = subprocess.run( + args, + stdin=subprocess.DEVNULL, + capture_output=True, + text=True, + timeout=timeout, + cwd=cwd, + ) + except subprocess.TimeoutExpired as exc: + stdout = ( + exc.stdout + if isinstance(exc.stdout, str) + else (exc.stdout or b"").decode("utf-8", "replace") + ) + stderr = ( + exc.stderr + if isinstance(exc.stderr, str) + else (exc.stderr or b"").decode("utf-8", "replace") + ) + event = { + "command": args, + "seconds": round(time.monotonic() - started, 3), + "exit_code": None, + "error": "timeout", + "stdout": stdout, + "stderr": stderr, + } + self.record(event) + return subprocess.CompletedProcess(args, 124, stdout, stderr) + event = { + "command": args, + "seconds": round(time.monotonic() - started, 3), + "exit_code": result.returncode, + "stdout": result.stdout, + "stderr": result.stderr, + "error": None + if result.returncode == 0 + else ( + result.stderr.strip() + or result.stdout.strip() + or f"exit {result.returncode}" + ), + } + self.record(event) + return result + + def _pump_monitor_stderr(self, cap): + kept = [] + try: + for raw in iter(cap.proc.stderr.readline, b""): + line = raw.decode("utf-8", "replace") + if "BEGIN CERTIFICATE" in line or "BEGIN PRIVATE" in line: + continue + if ( + WEBSOCKET_READY in line + and EVENTS_PATH in line + and "all-projects=true" in line + ): + kept.append(line) + if cap.ready_line is None or "all-projects" in line: + cap.ready_line = line.strip() + cap.ready_event.set() + elif "error" in line.lower() or "fail" in line.lower(): + kept.append(line) + finally: + if cap.debug_path is not None: + cap.debug_path.write_text("".join(kept), encoding="utf-8") + + def start_capture( + self, + name, + args, + log_name, + ready_needle=None, + ready_timeout=TCPDUMP_READY_TIMEOUT, + debug_log_name=None, + websocket_ready=False, + ): + path = self.evidence / log_name + cap = Capture(name, args, path) + cap.log = path.open("wb") + cap.started_at = utcnow() + popen_kwargs = { + "stdin": subprocess.DEVNULL, + "stdout": cap.log, + "start_new_session": True, + } + if websocket_ready: + cap.debug_path = self.evidence / debug_log_name + popen_kwargs["stderr"] = subprocess.PIPE + else: + popen_kwargs["stderr"] = subprocess.STDOUT + try: + cap.proc = subprocess.Popen(args, **popen_kwargs) + except OSError as exc: + cap.log.close() + cap.error = str(exc) + self.record( + {"command": args, "error": str(exc), "capture": name, "ready": False} + ) + self.capture_failures.append(f"{name}: failed to spawn: {exc}") + self.captures.append(cap) + return cap + cap.pid = cap.proc.pid + self.captures.append(cap) + if websocket_ready: + cap.thread = threading.Thread( + target=self._pump_monitor_stderr, args=(cap,), daemon=True + ) + cap.thread.start() + deadline = time.monotonic() + ready_timeout + while time.monotonic() < deadline: + if cap.ready_event.wait(timeout=0.05): + cap.ready = True + self.record( + { + "command": args, + "capture": name, + "pid": cap.pid, + "ready": True, + "ready_signal": cap.ready_line, + } + ) + return cap + if cap.proc.poll() is not None: + break + cap.error = f"no {WEBSOCKET_READY!r} {EVENTS_PATH} on client debug stderr within {ready_timeout}s" + if cap.proc.poll() is not None: + cap.returncode = cap.proc.returncode + cap.error = f"exited {cap.returncode} before websocket ready" + self.record( + { + "command": args, + "capture": name, + "pid": cap.pid, + "ready": False, + "error": cap.error, + } + ) + self.capture_failures.append(f"{name}: {cap.error}") + return cap + + deadline = time.monotonic() + ready_timeout + while time.monotonic() < deadline: + if cap.proc.poll() is not None: + break + cap.log.flush() + try: + text = path.read_text(errors="replace") + except OSError: + text = "" + if ready_needle and ready_needle in text: + cap.ready = True + cap.ready_line = ready_needle + self.record( + { + "command": args, + "capture": name, + "pid": cap.pid, + "ready": True, + "ready_signal": ready_needle, + } + ) + return cap + time.sleep(0.05) + cap.error = f"not ready ({ready_needle!r}) within {ready_timeout}s" + if cap.proc.poll() is not None: + cap.returncode = cap.proc.returncode + cap.error = f"exited {cap.returncode} before {ready_needle!r}" + self.record( + { + "command": args, + "capture": name, + "pid": cap.pid, + "ready": False, + "error": cap.error, + } + ) + self.capture_failures.append(f"{name}: {cap.error}") + return cap + + def stop_capture(self, cap, timeout=5): + if cap is None or cap.proc is None: + return + if cap.proc.poll() is None: + try: + os.killpg(cap.proc.pid, signal.SIGTERM) + except (ProcessLookupError, PermissionError, OSError): + cap.proc.terminate() + try: + cap.proc.wait(timeout=timeout) + except subprocess.TimeoutExpired: + try: + os.killpg(cap.proc.pid, signal.SIGKILL) + except (ProcessLookupError, PermissionError, OSError): + cap.proc.kill() + cap.proc.wait(timeout=timeout) + cap.returncode = cap.proc.returncode + cap.stopped_at = utcnow() + if cap.thread is not None: + cap.thread.join(timeout=2) + cap.thread = None + if cap.log is not None: + try: + cap.log.flush() + cap.log.close() + except OSError: + pass + cap.log = None + self.record( + { + "capture": cap.name, + "pid": cap.pid, + "exit_code": cap.returncode, + "stopped": True, + "log": str(cap.log_path), + "ready_signal": cap.ready_line, + } + ) + + def stop_all(self): + for cap in list(self.captures): + if cap.proc is not None and cap.log is not None: + self.stop_capture(cap) + + def parse_json(self, text): + text = (text or "").strip() + if not text: + return None + try: + return json.loads(text) + except json.JSONDecodeError: + return None + + def router_external_ipv4(self, network): + config = (network or {}).get("config") or {} + for key in ("ipv4.nat.address", "volatile.network.ipv4.address"): + value = config.get(key) + if value: + return value + ovn = (network or {}).get("ovn") or {} + return ovn.get("uplink_ipv4") or "" + + def query_network(self): + result = self.run( + ["incus", "query", f"{REMOTE}:/1.0/networks/{NETWORK}?project={PROJECT}"], + timeout=DIAG_TIMEOUT, + ) + if result.returncode != 0: + return None + return self.parse_json(result.stdout) + + def query_instances(self): + result = self.run( + [ + "incus", + "query", + f"{REMOTE}:/1.0/instances?project={PROJECT}&recursion=1", + ], + timeout=DIAG_TIMEOUT, + ) + if result.returncode != 0: + return [] + body = self.parse_json(result.stdout) + return body if isinstance(body, list) else [] + + def running_guests(self): + names = [] + for inst in self.query_instances(): + name = inst.get("name") + status = inst.get("status") + if name in (INSTANCE_ONE, INSTANCE_TWO) and status == "Running": + names.append(name) + return names + + def write_text(self, name, text): + path = self.evidence / name + path.write_text(text if text is not None else "", encoding="utf-8") + return path + + def collect_diagnostics(self, label, external_ip): + path = self.evidence / f"diagnostics-{label}.txt" + chunks = [] + mac = None + + def add(title, result): + chunks.append(f"=== {title} exit={result.returncode} ===\n") + if result.stdout: + chunks.append(result.stdout) + if not result.stdout.endswith("\n"): + chunks.append("\n") + if result.stderr: + chunks.append(result.stderr) + if not result.stderr.endswith("\n"): + chunks.append("\n") + if result.returncode and not ( + label == "after-teardown" and title.startswith("incus network") + ): + self.capture_failures.append( + f"{label}: {title} exited {result.returncode}" + ) + + show = self.run( + ["incus", "network", "show", f"{REMOTE}:{NETWORK}", "--project", PROJECT], + timeout=DIAG_TIMEOUT, + ) + add("incus network show", show) + + alloc = self.run( + [ + "incus", + "network", + "list-allocations", + f"{REMOTE}:", + "--project", + PROJECT, + ], + timeout=DIAG_TIMEOUT, + ) + add("incus network list-allocations", alloc) + if external_ip and alloc.stdout: + for line in alloc.stdout.splitlines(): + if external_ip in line: + parts = [p.strip() for p in line.strip("|").split("|")] + if len(parts) >= 5: + candidate = parts[-1] + if ":" in candidate and candidate.lower() != "mac address": + mac = candidate + + ip = external_ip or "" + sandbox_script = "\n".join( + [ + "set -e", + "echo '=== ovn-nbctl show ==='", + "sudo -n ovn-nbctl show", + "echo '=== ovn-sbctl show ==='", + "sudo -n ovn-sbctl show", + "echo '=== ovn-nbctl list Logical_Router_Port ==='", + "sudo -n ovn-nbctl list Logical_Router_Port", + "echo '=== ovn-sbctl find Port_Binding type=chassisredirect ==='", + "sudo -n ovn-sbctl find Port_Binding type=chassisredirect", + "echo '=== ovn-nbctl list HA_Chassis_Group ==='", + "sudo -n ovn-nbctl list HA_Chassis_Group", + "echo '=== ovn-nbctl list HA_Chassis ==='", + "sudo -n ovn-nbctl list HA_Chassis", + "echo '=== ovn-sbctl list Chassis ==='", + "sudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis", + "echo '=== ip neigh ==='", + f"if [ -n '{ip}' ]; then ip neigh show {ip}; else ip neigh; fi", + ] + ) + sandbox = self.run(SSH_SANDBOX + [sandbox_script], timeout=DIAG_TIMEOUT) + add("sandbox01 nb/sb/neigh", sandbox) + if mac is None and sandbox.stdout and ip: + current_mac = None + for raw in sandbox.stdout.splitlines(): + line = raw.strip() + if not line: + current_mac = None + if line.startswith("mac "): + current_mac = line.split(":", 1)[-1].strip().strip('"') + if ip in line and current_mac: + mac = current_mac + + if ip: + gw = self.run(SSH_GATEWAY + [f"ip neigh show {ip}"], timeout=DIAG_TIMEOUT) + else: + gw = self.run(SSH_GATEWAY + ["ip neigh"], timeout=DIAG_TIMEOUT) + add("gateway neigh", gw) + + for member in ("lab01", "lab02", "lab03", "nas01"): + params = urlencode( + { + "target": member, + "unit": "ovs-vswitchd.service", + "since": self.started_at, + } + ) + journal = self.run( + [ + "bash", + "-o", + "pipefail", + "-c", + f"incus query '{REMOTE}:/os/1.0/debug/log?{params}'" + " | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'", + ], + timeout=DIAG_TIMEOUT, + ) + add(f"{member} ovs-vswitchd journal since cycle start", journal) + + if mac: + mac = mac.strip('[]"').split()[0] + path.write_text("".join(chunks), encoding="utf-8") + self.record({"diagnostics": label, "path": str(path), "router_mac": mac}) + if mac and not self.router_mac: + self.router_mac = mac + return path + + def guest_exec(self, name, command): + return self.run( + [ + "incus", + "exec", + f"{REMOTE}:{name}", + "--project", + PROJECT, + "--", + "sh", + "-c", + command, + ], + timeout=DIAG_TIMEOUT, + ) + + def run_fallback(self, guests): + rows = [] + result = self.run( + ["incus", "list", f"{REMOTE}:", "--project", PROJECT, "--format", "json"] + ) + addresses = {} + for instance in self.parse_json(result.stdout) or []: + for address in ( + instance.get("state", {}) + .get("network", {}) + .get("eth0", {}) + .get("addresses", []) + ): + if address["family"] == "inet" and address["scope"] == "global": + addresses[instance["name"]] = address["address"] + for name in guests: + other = INSTANCE_TWO if name == INSTANCE_ONE else INSTANCE_ONE + if other not in addresses: + rows.append( + { + "guest": name, + "check": "cross-member-ping", + "exit_code": None, + "error": "peer has no global IPv4", + } + ) + for title, command in ( + *( + [("cross-member-ping", f"ping -c 3 -W 2 {addresses[other]}")] + if other in addresses + else [] + ), + ("gateway-ping", f"ping -c 3 -W 2 {UPLINK_GATEWAY}"), + ("dns", f"nslookup {DNS_NAME} {UPLINK_GATEWAY}"), + ("wget", f"wget -T 15 -qO /dev/null https://{DNS_NAME}"), + ): + result = self.guest_exec(name, command) + rows.append( + { + "guest": name, + "check": title, + "command": command, + "exit_code": result.returncode, + "stdout": result.stdout, + "stderr": result.stderr, + } + ) + self.write_text("fallback-checks.json", json.dumps(rows, indent=2) + "\n") + return rows + + def capture_summary(self): + rows = [] + for cap in self.captures: + size = 0 + if cap.log_path.exists(): + size = cap.log_path.stat().st_size + rows.append( + { + "name": cap.name, + "ready": cap.ready, + "pid": cap.pid, + "returncode": cap.returncode, + "error": cap.error, + "log": str(cap.log_path), + "bytes": size, + "ready_signal": cap.ready_line, + "started_at": cap.started_at, + "stopped_at": cap.stopped_at, + } + ) + return rows + + def summary(self, exit_code): + datapath_ok = ( + bool( + self.create + and self.create.get("ok") + and self.probe + and self.probe.get("ok") + ) + and not self.check_failures + ) + captures_ok = not self.capture_failures + cleanup_ok = not self.cleanup_failures + return { + "ok": datapath_ok and captures_ok and cleanup_ok, + "datapath_ok": datapath_ok, + "captures_ok": captures_ok, + "cleanup_ok": cleanup_ok, + "exit_code": exit_code, + "keep_on_failure": self.keep_on_failure, + "teardown": self.teardown, + "started_at": self.started_at, + "ended_at": utcnow(), + "seconds": round(time.monotonic() - self.t0, 3), + "external_ip": self.external_ip, + "router_mac": self.router_mac, + "create": self.create, + "probe": self.probe, + "fallback_checks": self.fallback, + "destroy": self.destroy, + "captures": self.capture_summary(), + "failures": { + "checks": self.check_failures, + "captures": self.capture_failures, + "cleanup": self.cleanup_failures, + }, + "evidence_dir": str(self.evidence), + } + + def write_summary(self, body): + path = self.evidence / "cycle.json" + path.write_text( + json.dumps(body, indent=2, default=str) + "\n", encoding="utf-8" + ) + return path + + def monitor_args(self): + return [ + "incus", + "--debug", + "monitor", + f"{REMOTE}:", + "--type=logging", + "--pretty", + "--loglevel=debug", + "--all-projects", + ] + + def start_monitor(self, name, log_name, debug_name): + return self.start_capture( + name, + self.monitor_args(), + log_name, + websocket_ready=True, + debug_log_name=debug_name, + ready_timeout=MONITOR_READY_TIMEOUT, + ) + + def note_capture_failure(self, message): + if message not in self.capture_failures: + self.capture_failures.append(message) + + def require_capture_log(self, name, required): + if not required: + return + cap = next((c for c in self.captures if c.name == name), None) + if cap is None: + self.note_capture_failure(f"{name}: not started") + return + if not cap.ready: + self.note_capture_failure(f"{name}: not ready") + return + if not cap.log_path.exists() or cap.log_path.stat().st_size == 0: + self.note_capture_failure(f"{name}: empty log") + + def run_create(self): + monitor = self.start_monitor( + "monitor-create", "monitor-create.log", "monitor-create.debug.log" + ) + if not monitor.ready: + raise RuntimeError("create monitor did not establish its event websocket") + self.create_attempted = True + result = self.run( + [sys.executable, str(TOPOLOGY), "--log", str(self.topology_log), "create"], + timeout=CREATE_TIMEOUT, + ) + self.stop_capture(monitor) + self.write_text("create.stdout.json", result.stdout) + self.write_text("create.stderr.txt", result.stderr) + body = self.parse_json(result.stdout) or {} + self.create = { + "ok": result.returncode == 0, + "exit_code": result.returncode, + "result": body, + "stderr": result.stderr, + } + if result.returncode != 0: + error = ( + body.get("error") + or result.stderr.strip() + or f"exit {result.returncode}" + ) + if "refusing to adopt existing project" in error: + self.create_attempted = False + self.check_failures.append(f"create: {error}") + if "apk" in error.lower(): + self.create["note"] = ( + "setup failed during guest package install; " + "fallback gateway/DNS/wget collected; " + "not classified as a package-name error" + ) + else: + self.external_ip = body.get("external_ip") or self.external_ip + if not self.external_ip: + network = self.query_network() + self.external_ip = self.router_external_ipv4(network) or None + self.require_capture_log("monitor-create", required=True) + if monitor.ready and (result.returncode == 0 or self.external_ip): + text = "" + if monitor.log_path.exists(): + text = monitor.log_path.read_text(errors="replace") + if not text.strip(): + self.note_capture_failure( + "monitor-create: no logging events captured during create" + ) + + def run_probe_or_fallback(self): + guests = self.running_guests() + want_tcpdump = bool(self.external_ip) and bool(guests) + tcpdump = None + if want_tcpdump: + remote = ( + f"sudo -n timeout {TCPDUMP_BOUND} tcpdump -nne -l -i enp2s0 " + f"arp and host {self.external_ip}" + ) + tcpdump = self.start_capture( + "tcpdump-arp", + SSH_SANDBOX[:1] + ["-tt"] + SSH_SANDBOX[1:] + [remote], + "tcpdump-arp.log", + ready_needle="listening on", + ready_timeout=TCPDUMP_READY_TIMEOUT, + ) + elif guests and not self.external_ip: + self.note_capture_failure("tcpdump-arp: no allocated router IP to filter") + + if self.create and self.create.get("ok"): + url = f"http://{FORWARD_LISTEN}:{FORWARD_PORT}/index.html" + result = self.run( + [ + "bash", + str(PROBE), + REMOTE, + PROJECT, + NETWORK, + INSTANCE_ONE, + INSTANCE_TWO, + url, + MARKER, + ], + timeout=PROBE_TIMEOUT, + ) + self.write_text("probe.stdout.txt", result.stdout) + self.write_text("probe.stderr.txt", result.stderr) + self.probe = { + "ok": result.returncode == 0, + "exit_code": result.returncode, + "stdout": result.stdout, + "stderr": result.stderr, + } + if result.returncode != 0: + detail = ( + result.stderr.strip() + or result.stdout.strip() + or f"exit {result.returncode}" + ) + self.check_failures.append(f"probe: {detail}") + else: + if guests: + self.fallback = self.run_fallback(guests) + else: + self.fallback = [] + if self.create_attempted and not ( + self.create and self.create.get("ok") + ): + self.record({"fallback": "skipped", "reason": "no running guests"}) + + if tcpdump is not None: + self.stop_capture(tcpdump) + self.require_capture_log("tcpdump-arp", required=True) + elif want_tcpdump: + self.require_capture_log("tcpdump-arp", required=True) + + def run_destroy(self): + failed = bool(self.check_failures or self.capture_failures) + if failed and self.keep_on_failure: + self.teardown = "skipped" + self.destroy = {"ok": True, "skipped": True, "reason": "keep-on-failure"} + return + monitor = self.start_monitor( + "monitor-delete", "monitor-delete.log", "monitor-delete.debug.log" + ) + result = self.run( + [sys.executable, str(TOPOLOGY), "--log", str(self.topology_log), "destroy"], + timeout=DESTROY_TIMEOUT, + ) + self.stop_capture(monitor) + self.write_text("destroy.stdout.json", result.stdout) + self.write_text("destroy.stderr.txt", result.stderr) + body = self.parse_json(result.stdout) or {} + self.destroy = { + "ok": result.returncode == 0, + "skipped": False, + "exit_code": result.returncode, + "result": body, + "stderr": result.stderr, + } + if result.returncode != 0: + error = ( + body.get("error") + or result.stderr.strip() + or f"exit {result.returncode}" + ) + failures = body.get("failures") or [] + if failures: + error = "; ".join(str(item) for item in failures) + self.cleanup_failures.append(f"destroy: {error}") + self.teardown = "failed" + else: + self.teardown = "done" + self.require_capture_log("monitor-delete", required=True) + + def execute(self): + try: + self.run_create() + self.collect_diagnostics("before-probe", self.external_ip) + self.run_probe_or_fallback() + self.collect_diagnostics("after-probe", self.external_ip) + except (Exception, KeyboardInterrupt) as exc: + self.record({"cycle_error": str(exc) or type(exc).__name__}) + if not self.capture_failures: + self.check_failures.append(str(exc) or type(exc).__name__) + finally: + try: + if self.create_attempted: + self.run_destroy() + if self.teardown in ("done", "failed"): + self.collect_diagnostics("after-teardown", self.external_ip) + except (Exception, KeyboardInterrupt) as exc: + self.cleanup_failures.append(str(exc) or type(exc).__name__) + self.teardown = "failed" + finally: + self.stop_all() + exit_code = ( + 0 + if not ( + self.check_failures or self.capture_failures or self.cleanup_failures + ) + else 1 + ) + body = self.summary(exit_code) + self.write_summary(body) + json.dump(body, sys.stdout, indent=2, default=str) + sys.stdout.write("\n") + raise SystemExit(exit_code) + + +def validate_evidence_dir(raw): + path = Path(raw).expanduser() + if not path.is_absolute(): + path = Path.cwd() / path + if path.exists() and not path.is_dir(): + fail_preflight(f"evidence-dir is not a directory: {path}") + if path.exists() and any(path.iterdir()): + fail_preflight(f"evidence-dir is not empty: {path}") + if not path.exists(): + parent = path.parent + if not parent.exists() or not parent.is_dir(): + fail_preflight(f"evidence-dir parent does not exist: {parent}") + try: + path.mkdir() + except OSError as exc: + fail_preflight(f"cannot create evidence-dir {path}: {exc}") + if not os.access(path, os.W_OK): + fail_preflight(f"evidence-dir is not writable: {path}") + return path + + +def check_dependencies(): + for name in ("incus", "curl", "jq", "ssh", "python3", "bash"): + if shutil.which(name) is None: + fail_preflight(f"missing dependency on PATH: {name}") + if not TOPOLOGY.is_file(): + fail_preflight(f"missing topology helper: {TOPOLOGY}") + if not PROBE.is_file(): + fail_preflight(f"missing probe script: {PROBE}") + if not GATEWAY_KEY.is_file(): + fail_preflight(f"missing gateway ssh key: {GATEWAY_KEY}") + + +def check_ssh(cycle): + sandbox = cycle.run(SSH_SANDBOX + ["true"], timeout=15) + if sandbox.returncode != 0: + fail_preflight( + "ssh josh@sandbox01 failed: " + + ( + sandbox.stderr.strip() + or sandbox.stdout.strip() + or f"exit {sandbox.returncode}" + ) + ) + gateway = cycle.run(SSH_GATEWAY + ["true"], timeout=15) + if gateway.returncode != 0: + fail_preflight( + "ssh vyos@10.0.0.2 failed: " + + ( + gateway.stderr.strip() + or gateway.stdout.strip() + or f"exit {gateway.returncode}" + ) + ) + + project = cycle.run(["incus", "project", "show", f"{REMOTE}:{PROJECT}"], timeout=15) + if project.returncode == 0: + fail_preflight( + f"refusing existing project {PROJECT}; destroy it explicitly first" + ) + if not any( + text in project.stderr.lower() + for text in ("not found", "does not exist", "doesn't exist") + ): + fail_preflight( + f"cannot establish that {PROJECT} is absent: {project.stderr.strip()}" + ) + + +def main(argv=None): + parser = argparse.ArgumentParser( + description="Create, probe, diagnose, and destroy the disposable OVN topology.", + epilog="Invoke as spikes/ovn/probe.sh cycle --evidence-dir PATH [--keep-on-failure]. " + "Does not stop OVN central, run keeper, or clear neighbor caches.", + ) + parser.add_argument( + "--evidence-dir", + required=True, + help="directory for cycle.json and capture logs", + ) + parser.add_argument( + "--keep-on-failure", + action="store_true", + help="leave owned resources in place when create/probe/capture fails", + ) + args = parser.parse_args(argv) + evidence = validate_evidence_dir(args.evidence_dir) + check_dependencies() + cycle = Cycle(evidence, args.keep_on_failure) + print(f"cycle: evidence-dir={evidence}", file=sys.stderr) + check_ssh(cycle) + + def interrupted(_signum, _frame): + raise KeyboardInterrupt + + signal.signal(signal.SIGTERM, interrupted) + cycle.execute() + + +if __name__ == "__main__": + main() diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/cleanup-after-h3.json b/spikes/ovn/diagnosis-2026-09-12/clean-1/cleanup-after-h3.json new file mode 100644 index 0000000..1bda585 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/cleanup-after-h3.json @@ -0,0 +1,29 @@ +{ + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-delete", + "ready": true, + "pid": 24451, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.log", + "bytes": 37778, + "ready_signal": "time=\"2026-09-11T22:53:36-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T05:53:36.622460+00:00", + "stopped_at": "2026-09-12T05:53:40.097467+00:00" + } + ], + "cleanup_failures": [], + "capture_failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/clean-1/commands.jsonl new file mode 100644 index 0000000..2bcdabf --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/commands.jsonl @@ -0,0 +1,49 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.091, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T05:47:32.496766+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.304, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T05:47:32.801013+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.088, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T05:47:32.888924+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 89205, "ready": true, "ready_signal": "time=\"2026-09-11T22:47:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:47:32.966001+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/topology.jsonl", "create"], "seconds": 10.051, "exit_code": 1, "stdout": "{\n \"error\": \"WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\\nERROR: unable to select packages:\\n busybox-extras (no such package):\\n required by: world[busybox-extras]\\n curl (no such package):\\n required by: world[curl]\"\n}\n", "stderr": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]\n", "error": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]", "at": "2026-09-12T05:47:43.017751+00:00"} +{"capture": "monitor-create", "pid": 89205, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.log", "ready_signal": "time=\"2026-09-11T22:47:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:47:43.022728+00:00"} +{"command": ["incus", "query", "nas01:/1.0/networks/default?project=ac-ovn-spike"], "seconds": 0.087, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": [\n\t\t\"/1.0/instances/two?project=ac-ovn-spike\",\n\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t]\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:43.110815+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.083, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:43.194754+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.089, "exit_code": 0, "stdout": "+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b4:b0:c4 |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:0a:69:79 |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:43.284458+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.122, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch d3e72649-17ff-459c-b7a5-ac3497645dfa (incus-net24-ls-int)\n port incus-net24-ls-int-lsp-router\n type: router\n router-port: incus-net24-lr-lrp-int\n port incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0\n addresses: [\"10:66:6a:b4:b0:c4 dynamic\"]\n port incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0\n addresses: [\"10:66:6a:0a:69:79 dynamic\"]\nswitch 3711f4b7-04cc-4a50-80e6-dd4713723bf8 (incus-net24-ls-ext)\n port incus-net24-ls-ext-lsp-router\n type: router\n router-port: incus-net24-lr-lrp-ext\n port incus-net24-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter a7e9d484-ab5b-4809-8eea-f7035fb486c4 (incus-net24-lr)\n port incus-net24-lr-lrp-int\n mac: \"10:66:6a:49:f5:82\"\n ipv6-lla: \"fe80::1266:6aff:fe49:f582\"\n networks: [\"10.253.73.1/24\"]\n port incus-net24-lr-lrp-ext\n mac: \"10:66:6a:49:f5:82\"\n ipv6-lla: \"fe80::1266:6aff:fe49:f582\"\n networks: [\"10.10.40.64/24\"]\n nat 2f5b47a8-33cc-41f5-b743-b9d026e64b34\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net24-lr-lrp-ext\n Port_Binding incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 0e9dad28-87db-4c24-9f59-c170e37d6cca\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:49:f5:82\"\nname : incus-net24-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 5dfb7a6b-c283-4425-9059-ba708a6c15d5\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 6368b1fa-61f8-4094-9df3-69389416a25d\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:49:f5:82\"\nname : incus-net24-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 743a5cc5-a6a4-41f1-9cf3-dfc9540a6cd4\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 9f3766c9-6182-4567-a72a-4a0cef0dc8db\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f02842e8-3f33-43a1-be58-a61efa64b253\nlogical_port : cr-incus-net24-lr-lrp-ext\nmac : [\"10:66:6a:49:f5:82 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net24-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:48:93:53 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T05:47:43.406867+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.314, "exit_code": 0, "stdout": "10.10.40.64 dev br40 INCOMPLETE \n", "stderr": "", "error": null, "at": "2026-09-12T05:47:43.721843+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.167, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192054041880\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01268|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192054042040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01269|bridge|INFO|bridge incusovn16: using datapath ID 0000261ad7c9334d\"\n },\n {\n \"at\": \"1789192054042059\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01270|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192054043803\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01271|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054043869\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054043896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054043909\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054043938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054043949\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054043963\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054043976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054043996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044029\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044039\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044057\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054044093\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044104\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044121\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044140\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044150\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044162\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044185\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044206\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054044219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01272|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044233\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044244\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044256\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044279\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044290\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044301\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044311\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044320\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044336\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044354\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044380\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054044429\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044443\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044453\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044463\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044475\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044489\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044503\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044512\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044537\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054044550\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01273|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044577\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044597\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044610\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044622\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044631\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044646\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044658\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054044671\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044684\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044701\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044710\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044729\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044741\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054044756\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044765\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044793\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044802\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044813\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044824\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044833\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044844\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054139872\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01274|dpif|WARN|Dropped 873 log messages in last 10015 seconds (most recently, 10014 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192054139987\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054140034\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01276|bridge|WARN|Dropped 11077 log messages in last 10020 seconds (most recently, 10014 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192054140071\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01277|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054140111\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054140137\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01279|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054140429\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00001|bfd(handler101)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054140562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00002|bfd(handler101)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054140601\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054140639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054140672\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" my_disc:0x59c6c3e your_disc:0x0\"\n },\n {\n \"at\": \"1789192054140716\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140744\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140771\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054140798\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054140832\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054140860\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140887\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140921\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054140953\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054140981\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054141337\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054141453\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054141678\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141718\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054141761\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141821\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054141846\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054141874\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141902\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054141952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054141980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142019\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054142046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00003|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054142083\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054142117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054142153\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054142179\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054142215\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054142251\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054142278\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054142305\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054142334\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054142361\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054142386\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054142412\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054142444\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142471\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142514\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054142541\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054142573\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054142602\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054142629\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142669\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054142743\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054142779\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01281|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054142809\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00004|bfd(handler101)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054142859\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00005|bfd(handler101)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054142897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054142924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054142952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" my_disc:0x8755ef1c your_disc:0x0\"\n },\n {\n \"at\": \"1789192054142995\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054143024\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054143049\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054143081\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054143145\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143169\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143202\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332142ms\"\n },\n {\n \"at\": \"1789192054143230\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789192054143260\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054143289\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054143323\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054143349\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054143375\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054143412\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054143435\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054143462\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054143504\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054143531\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054143557\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054143596\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054143625\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054143659\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143685\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00006|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054143711\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054143740\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054143801\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143828\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143858\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054143890\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789192054143921\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054143956\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054143984\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054144007\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054144040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054144071\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144105\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144141\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054144168\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054144199\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054144225\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054144260\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144334\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144369\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054144404\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054144439\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01283|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054144478\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054144518\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01285|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054145464\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00007|bfd(handler101)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054145552\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00008|bfd(handler101)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054145590\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054145622\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054145649\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" my_disc:0x720ec121 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054145683\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054145710\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054145745\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054145771\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054145796\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054145827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054145853\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054145879\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332145ms\"\n },\n {\n \"at\": \"1789192054145905\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +659ms\"\n },\n {\n \"at\": \"1789192054145941\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -101ms\"\n },\n {\n \"at\": \"1789192054145981\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054146008\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054146033\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146056\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054146085\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146116\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054146171\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054146198\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146235\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054146272\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054146303\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146330\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054146365\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00009|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054146402\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054146428\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054146454\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054146477\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054146511\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054146538\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054146562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +659ms\"\n },\n {\n \"at\": \"1789192054146586\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -101ms\"\n },\n {\n \"at\": \"1789192054146612\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054146635\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054146667\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146693\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054146719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146747\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146773\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054146799\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054146834\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146860\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054146885\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146911\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146936\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054149248\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01286|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789192054149336\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789192054985637\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00010|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054985750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054985765\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054985777\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054985799\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054985812\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054985826\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054985841\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +758ms\"\n },\n {\n \"at\": \"1789192054985869\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -182ms\"\n },\n {\n \"at\": \"1789192054985897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054985908\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192054985934\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054985950\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054985968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054985984\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054985995\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054986007\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192054986020\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054986031\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054986044\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192054986058\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054986073\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055010868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00011|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055010956\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055010973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055010983\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055010998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055011015\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055011025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055011035\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +903ms\"\n },\n {\n \"at\": \"1789192055011060\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -57ms\"\n },\n {\n \"at\": \"1789192055011075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055011086\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055011101\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055011112\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192055011121\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055011138\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055011153\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055011173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055011184\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055011193\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192055011204\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055011219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055011228\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055139591\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01288|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192055139783\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01289|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192055433403\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01290|bridge|INFO|bridge br-int: added interface vethcc4bbe23 on port 15\"\n },\n {\n \"at\": \"1789192055693022\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00012|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055693116\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055693142\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055693157\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055693175\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055693191\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055693206\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055693226\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +181ms\"\n },\n {\n \"at\": \"1789192055693251\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -749ms\"\n },\n {\n \"at\": \"1789192055693274\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055693289\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055693302\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055693317\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192055693328\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055693337\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055693352\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055693369\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055693385\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055693398\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192055693414\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055693430\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055693444\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192056139719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01291|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192056140037\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192056659985\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01293|poll_loop|INFO|Dropped 6392 log messages in last 10019 seconds (most recently, 10014 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192056660083\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056660479\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01295|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056660965\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01296|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056661437\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01297|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056661909\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01298|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056662393\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01299|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056662874\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056663345\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01301|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056663873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01302|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056664372\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01303|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192057139757\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01304|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192057139975\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01305|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192058139539\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01306|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192058139649\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192059139897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01308|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192059140101\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01309|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192060139964\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01310|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192060140159\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192061139626\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01312|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192061139760\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01313|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192062139733\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01314|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192062139959\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01315|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192062659949\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01316|poll_loop|INFO|Dropped 12263 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192062660056\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01317|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192063139973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01318|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192063140159\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01319|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:43.888899+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.163, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192054036312\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00101|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192054036457\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00102|bridge|INFO|bridge incusovn16: using datapath ID 0000123ddc1aa34d\"\n },\n {\n \"at\": \"1789192054036472\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00103|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192054037354\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00104|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054037402\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054037426\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054037441\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054037451\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054037463\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054037475\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309036ms\"\n },\n {\n \"at\": \"1789192054037488\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -1555309036ms\"\n },\n {\n \"at\": \"1789192054037500\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -1555309036ms\"\n },\n {\n \"at\": \"1789192054037511\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054037525\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054037536\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054037548\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054037559\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054037571\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054037583\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054037595\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054037605\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054037616\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054037628\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054037639\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054037651\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054037662\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054044045\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00105|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044092\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044105\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044120\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044131\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044142\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044151\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044165\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044177\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044187\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044199\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044208\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044219\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054044229\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044242\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044253\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044262\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044271\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044283\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044294\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044303\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044314\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054044325\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00106|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044336\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044347\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044356\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044368\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044377\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044386\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044399\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044412\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044421\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044431\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044441\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044451\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054044461\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044471\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044481\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044490\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044500\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044509\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044528\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044538\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054133109\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00107|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192054133200\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00108|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789192054140549\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00109|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192054140624\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00110|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 10\"\n },\n {\n \"at\": \"1789192054930921\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00001|bfd(handler105)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054931063\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00002|bfd(handler105)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054931094\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054931131\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054931153\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" my_disc:0xa98f3f1e your_disc:0xfc85e91\"\n },\n {\n \"at\": \"1789192054931177\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054931199\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054931227\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054931249\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054931272\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054931294\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931316\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931346\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309930ms\"\n },\n {\n \"at\": \"1789192054931369\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +767ms\"\n },\n {\n \"at\": \"1789192054931402\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -33ms\"\n },\n {\n \"at\": \"1789192054931429\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054931454\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054931484\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054931509\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054931534\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054931559\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054931585\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054931609\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054931631\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054931653\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054931676\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054931698\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054931726\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054931747\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00003|bfd(handler105)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054931770\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054931791\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054931812\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054931832\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931858\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931879\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054931904\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +767ms\"\n },\n {\n \"at\": \"1789192054931926\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -33ms\"\n },\n {\n \"at\": \"1789192054932008\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054932036\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054932056\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054932077\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054932095\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932118\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932138\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054932159\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054932180\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054932200\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054932219\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932243\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932264\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939271\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00004|bfd(handler105)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054939315\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00005|bfd(handler105)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054939329\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054939339\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054939349\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" my_disc:0xca374396 your_disc:0x8755ef1c\"\n },\n {\n \"at\": \"1789192054939360\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054939370\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054939381\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054939390\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939410\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054939421\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939430\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939439\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309938ms\"\n },\n {\n \"at\": \"1789192054939449\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +749ms\"\n },\n {\n \"at\": \"1789192054939459\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -41ms\"\n },\n {\n \"at\": \"1789192054939472\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054939483\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054939493\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939503\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054939513\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939523\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939535\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054939544\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054939554\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939564\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054939576\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054939585\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939597\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939607\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00006|bfd(handler105)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054939617\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054939627\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939635\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054939645\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939655\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939664\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054939673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +749ms\"\n },\n {\n \"at\": \"1789192054939688\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -41ms\"\n },\n {\n \"at\": \"1789192054939697\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054939707\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054939716\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939727\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054939736\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939747\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939757\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054939767\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054939776\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939785\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054939793\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939804\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939813\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955400\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00007|bfd(handler105)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054955440\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00008|bfd(handler105)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054955454\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054955465\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054955477\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" my_disc:0x704f5285 your_disc:0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054955489\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054955499\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054955509\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054955518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955528\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054955539\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955548\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955558\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309954ms\"\n },\n {\n \"at\": \"1789192054955569\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -138ms\"\n },\n {\n \"at\": \"1789192054955580\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -918ms\"\n },\n {\n \"at\": \"1789192054955598\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054955609\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054955618\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955628\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054955640\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955649\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955662\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054955673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054955682\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955692\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054955702\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054955711\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955720\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955730\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00009|bfd(handler105)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054955743\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054955752\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955765\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054955776\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955786\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955796\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054955806\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -138ms\"\n },\n {\n \"at\": \"1789192054955816\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -918ms\"\n },\n {\n \"at\": \"1789192054955831\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054955840\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054955848\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955859\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054955869\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955879\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955888\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054955898\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054955907\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955917\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054955927\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955937\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955945\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192064039198\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00111|connmgr|INFO|br-int<->unix#7: 774 flow_mods in the 2 s starting 10 s ago (713 adds, 53 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:44.054334+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.16, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192054040695\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192054040886\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 0000064dfba3f74b\"\n },\n {\n \"at\": \"1789192054040910\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00107|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192054042644\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00108|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054042695\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054042714\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054042728\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054042742\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054042754\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054042767\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054042778\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054042789\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054042801\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054042813\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054042825\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054042837\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054042849\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054042861\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054042871\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054042883\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054042894\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054042906\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054042916\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054042930\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054042942\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054042953\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00109|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054042965\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054042976\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054042985\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054042997\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054043009\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054043019\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043030\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054043042\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043053\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043068\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054043079\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043090\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043102\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054043113\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054043124\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043138\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054043149\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043159\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043168\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054043178\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043188\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054043207\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00110|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054043219\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054043231\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054043242\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054043251\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054043262\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054043273\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043283\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043292\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043308\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054043318\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043330\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043343\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054043356\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054043366\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043376\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054043386\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043395\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043406\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054043416\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043430\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043439\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054137204\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00111|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192054137253\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00112|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789192054138105\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00001|bfd(handler102)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054138169\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00002|bfd(handler102)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054138210\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054138248\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054138274\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" my_disc:0x44c454d1 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054138301\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054138328\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054138352\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054138376\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054138400\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054138425\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054138449\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054138475\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054138500\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054138525\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054138555\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054138579\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054138608\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054138632\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054138660\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054138684\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054138709\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054138733\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054138766\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054138792\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054138821\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054138845\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054138871\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054138897\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00003|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054138926\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054138962\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054138988\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054139012\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054139036\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054139070\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054139103\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054139128\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054139151\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054139175\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054139198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054139228\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054139255\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139278\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139301\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054139326\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054139348\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054139375\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054139399\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139423\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139447\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054140365\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00004|bfd(handler102)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054140434\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00005|bfd(handler102)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054140467\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054140493\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054140520\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" my_disc:0xfc85e91 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054140546\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140571\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140595\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054140618\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054140641\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054140665\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140688\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140711\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209138ms\"\n },\n {\n \"at\": \"1789192054140741\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +792ms\"\n },\n {\n \"at\": \"1789192054140766\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054140789\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054140812\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054140836\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054140859\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054140883\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054140906\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054140929\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054140954\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054140985\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141010\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054141036\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054141068\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141093\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054141116\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00006|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054141140\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054141169\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054141193\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054141217\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054141238\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054141261\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054141284\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +792ms\"\n },\n {\n \"at\": \"1789192054141305\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054141328\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054141350\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054141373\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141395\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054141415\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141439\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141463\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054141487\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054141513\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141548\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054141572\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141595\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141620\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143660\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00113|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192054143739\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00114|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192054802666\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00007|bfd(handler102)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054802764\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00008|bfd(handler102)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054802797\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054802829\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054802852\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" my_disc:0x6af7c434 your_disc:0x720ec121\"\n },\n {\n \"at\": \"1789192054802880\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054802902\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054802930\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054802956\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054802977\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054803004\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803034\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803071\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209800ms\"\n },\n {\n \"at\": \"1789192054803094\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +180ms\"\n },\n {\n \"at\": \"1789192054803127\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789192054803153\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054803176\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054803200\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803224\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054803247\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803273\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803298\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054803321\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054803346\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803370\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054803397\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054803424\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803456\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054803486\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00009|bfd(handler102)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054803515\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054803537\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054803560\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054803583\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803607\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803628\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054803654\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +180ms\"\n },\n {\n \"at\": \"1789192054803677\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789192054803704\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054803726\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054803756\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803788\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054803820\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803844\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803865\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054803888\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054803909\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803933\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054803954\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803975\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054804000\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054968413\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00010|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054968506\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054968544\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054968569\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054968595\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054968618\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054968643\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054968670\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +154ms\"\n },\n {\n \"at\": \"1789192054968699\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -826ms\"\n },\n {\n \"at\": \"1789192054968723\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054968747\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192054968779\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054968805\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054968831\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054968864\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054968912\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054968938\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192054968965\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054968992\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054969022\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192054969047\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054969089\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055870269\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00011|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055870491\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055870536\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055870549\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055870563\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055870576\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055870588\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055870603\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +32ms\"\n },\n {\n \"at\": \"1789192055870615\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -938ms\"\n },\n {\n \"at\": \"1789192055870629\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055870641\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055870653\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055870664\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192055870676\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055870688\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055870700\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055870711\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055870722\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055870734\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192055870746\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055870756\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055870768\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192056231826\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00115|bridge|INFO|bridge br-int: added interface veth09ee9212 on port 13\"\n },\n {\n \"at\": \"1789192064044855\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00116|connmgr|INFO|br-int<->unix#7: 741 flow_mods in the 2 s starting 10 s ago (703 adds, 31 deletes, 7 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:44.215505+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.16, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192053840918\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192053841205\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 00009a00fdbf174f\"\n },\n {\n \"at\": \"1789192053841229\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00107|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192053939039\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00108|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192053939158\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00109|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789192053943960\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00110|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192053944010\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00111|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192054041410\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00112|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054041464\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054041489\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054041508\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054041523\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054041540\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054041564\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435905ms\"\n },\n {\n \"at\": \"1789192054041583\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now -1555435905ms\"\n },\n {\n \"at\": \"1789192054041598\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -1555435905ms\"\n },\n {\n \"at\": \"1789192054041614\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054041631\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054041646\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054041660\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054041675\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054041689\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054041705\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054041720\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054041735\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054041751\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054041767\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054041784\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054041799\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054042048\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054045420\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00001|bfd(handler113)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054045447\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00002|bfd(handler113)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054045464\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054045488\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054045507\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" my_disc:0xe25c7ef1 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054045523\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054045542\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054045558\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054045580\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054045597\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054045613\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054045628\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054045645\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054045663\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +917ms\"\n },\n {\n \"at\": \"1789192054045679\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789192054045696\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054045711\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054045730\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054045745\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054045759\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054045775\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054045792\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054045805\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054045823\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054045838\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054045854\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054045870\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054045888\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054045902\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00003|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054045928\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054045942\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054045958\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054045973\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054045988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054046003\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054046023\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +917ms\"\n },\n {\n \"at\": \"1789192054046037\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789192054046052\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054046067\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054046082\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046097\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054046111\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046126\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046146\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054046160\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054046176\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046191\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054046206\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046224\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046237\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054046253\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00113|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054046270\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054046284\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054046299\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054046314\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054046329\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054046349\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046364\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046382\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046399\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054046414\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046429\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046445\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054046462\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046477\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046492\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054046507\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046523\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046537\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054046552\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046568\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046583\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054046605\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00114|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054046625\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054046639\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054046655\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054046670\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054046684\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054046698\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046711\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046726\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046741\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054046756\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046771\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046784\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054046802\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046815\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046830\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054046845\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046860\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046875\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054046890\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046905\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046925\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054147715\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00004|bfd(handler113)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054147821\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00005|bfd(handler113)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054147848\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054147868\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054147883\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" my_disc:0xdc50ac8c your_disc:0x59c6c3e\"\n },\n {\n \"at\": \"1789192054147899\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054147924\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054147940\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054147955\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054147972\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054147988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054147999\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148015\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555436011ms\"\n },\n {\n \"at\": \"1789192054148027\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789192054148039\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789192054148051\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054148061\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054148073\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148088\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054148104\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148118\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148134\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054148149\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054148164\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148178\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054148213\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054148227\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148242\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148256\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00006|bfd(handler113)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054148273\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054148288\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148302\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054148317\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148331\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148344\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054148360\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789192054148374\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789192054148387\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054148401\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054148415\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148430\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054148443\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148458\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148472\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054148489\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054148503\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148518\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054148533\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148547\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148561\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148574\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00007|bfd(handler113)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054148597\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00008|bfd(handler113)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054148612\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054148630\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054148645\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" my_disc:0x83f7dd28 your_disc:0x44c454d1\"\n },\n {\n \"at\": \"1789192054148665\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054148679\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054148694\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054148707\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148721\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054148735\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148749\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148763\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555436012ms\"\n },\n {\n \"at\": \"1789192054148778\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +825ms\"\n },\n {\n \"at\": \"1789192054148793\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789192054148808\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054148821\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054148834\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148850\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054148866\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148880\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148893\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054148906\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054148925\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148939\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054148955\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054148970\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148983\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148997\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00009|bfd(handler113)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054149013\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054149029\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054149043\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054149057\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054149071\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054149084\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054149097\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +825ms\"\n },\n {\n \"at\": \"1789192054149114\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789192054149128\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054149143\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054149157\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054149170\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054149182\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149198\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149212\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054149229\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054149245\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054149259\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054149273\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149288\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149304\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055006585\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00010|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055006855\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055006869\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055006880\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055006893\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055006902\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055006920\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055006935\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +726ms\"\n },\n {\n \"at\": \"1789192055006954\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -44ms\"\n },\n {\n \"at\": \"1789192055006969\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055006982\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055006997\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055007007\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192055007018\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055007030\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055007041\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055007051\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055007064\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055007075\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192055007085\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055007094\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055007105\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192063844708\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00115|connmgr|INFO|br-int<->unix#7: 779 flow_mods in the 2 s starting 10 s ago (719 adds, 59 deletes, 1 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:44.377907+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-before-probe.txt", "router_mac": "[\"10:66:6a:49:f5:82 10.10.40.64/24\"]", "at": "2026-09-12T05:47:44.380577+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.104, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:47:34.951754192Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:47:35.515237521Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:47:35.738752966Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:47:36.315904669Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:44.484395+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 93590, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T05:47:44.607567+00:00"} +{"command": ["incus", "list", "nas01:", "--project", "ac-ovn-spike", "--format", "json"], "seconds": 0.105, "exit_code": 0, "stdout": "[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"5cd022be-c5ae-444a-99a4-562d72bdd717\",\"volatile.eth0.host_name\":\"vethcc4bbe23\",\"volatile.eth0.hwaddr\":\"10:66:6a:b4:b0:c4\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"cebae4d4-a24c-478a-8c68-53061fa95b35\",\"volatile.uuid.generation\":\"cebae4d4-a24c-478a-8c68-53061fa95b35\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T05:47:34.951754192Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"5cd022be-c5ae-444a-99a4-562d72bdd717\",\"volatile.eth0.host_name\":\"vethcc4bbe23\",\"volatile.eth0.hwaddr\":\"10:66:6a:b4:b0:c4\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"cebae4d4-a24c-478a-8c68-53061fa95b35\",\"volatile.uuid.generation\":\"cebae4d4-a24c-478a-8c68-53061fa95b35\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T05:47:35.515237521Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":4612096,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:feb4:b0c4\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":1010,\"bytes_sent\":1780,\"packets_received\":7,\"packets_sent\":16,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:b4:b0:c4\",\"host_name\":\"vethcc4bbe23\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4068503,\"processes\":3,\"cpu\":{\"usage\":181964000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T05:47:34.529999971Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\"volatile.eth0.host_name\":\"veth09ee9212\",\"volatile.eth0.hwaddr\":\"10:66:6a:0a:69:79\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"fd6c2444-0871-4d38-bbdb-195646066e68\",\"volatile.uuid.generation\":\"fd6c2444-0871-4d38-bbdb-195646066e68\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T05:47:35.738752966Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\"volatile.eth0.host_name\":\"veth09ee9212\",\"volatile.eth0.hwaddr\":\"10:66:6a:0a:69:79\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"fd6c2444-0871-4d38-bbdb-195646066e68\",\"volatile.uuid.generation\":\"fd6c2444-0871-4d38-bbdb-195646066e68\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T05:47:36.315904669Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":4902912,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe0a:6979\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:0a:69:79\",\"host_name\":\"veth09ee9212\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":12129,\"processes\":3,\"cpu\":{\"usage\":159571000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T05:47:36.319999933Z\",\"os_info\":null},\"snapshots\":null}]\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:44.713174+00:00"} +{"command": ["incus", "exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 3 -W 2 10.253.73.3"], "seconds": 2.523, "exit_code": 0, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=0.315 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.699 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.466 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.315/0.493/0.699 ms\n", "stderr": "", "error": null, "at": "2026-09-12T05:47:47.236287+00:00"} +{"command": ["incus", "exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 3 -W 2 10.10.40.1"], "seconds": 4.232, "exit_code": 1, "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", "stderr": "", "error": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss", "at": "2026-09-12T05:47:51.469202+00:00"} +{"command": ["incus", "exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "nslookup example.com 10.10.40.1"], "seconds": 5.393, "exit_code": 1, "stdout": ";; connection timed out; no servers could be reached\n\n", "stderr": "", "error": ";; connection timed out; no servers could be reached", "at": "2026-09-12T05:47:56.862897+00:00"} +{"command": ["incus", "exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "wget -T 15 -qO /dev/null https://example.com"], "seconds": 5.248, "exit_code": 1, "stdout": "", "stderr": "wget: bad address 'example.com'\n", "error": "wget: bad address 'example.com'", "at": "2026-09-12T05:48:02.111435+00:00"} +{"command": ["incus", "exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 3 -W 2 10.253.73.2"], "seconds": 2.233, "exit_code": 0, "stdout": "PING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.029 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.503 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.379 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.379/0.637/1.029 ms\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:04.345366+00:00"} +{"command": ["incus", "exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 3 -W 2 10.10.40.1"], "seconds": 4.444, "exit_code": 1, "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", "stderr": "", "error": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss", "at": "2026-09-12T05:48:08.789943+00:00"} +{"command": ["incus", "exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "nslookup example.com 10.10.40.1"], "seconds": 5.515, "exit_code": 1, "stdout": ";; connection timed out; no servers could be reached\n\n", "stderr": "", "error": ";; connection timed out; no servers could be reached", "at": "2026-09-12T05:48:14.305715+00:00"} +{"command": ["incus", "exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "wget -T 15 -qO /dev/null https://example.com"], "seconds": 5.343, "exit_code": 1, "stdout": "", "stderr": "wget: bad address 'example.com'\n", "error": "wget: bad address 'example.com'", "at": "2026-09-12T05:48:19.649443+00:00"} +{"capture": "tcpdump-arp", "pid": 93590, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T05:48:19.655092+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.422, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:20.077314+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.326, "exit_code": 0, "stdout": "+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b4:b0:c4 |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:0a:69:79 |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+--------------------------------------------+----------------+---------+----------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:20.403748+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.143, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch d3e72649-17ff-459c-b7a5-ac3497645dfa (incus-net24-ls-int)\n port incus-net24-ls-int-lsp-router\n type: router\n router-port: incus-net24-lr-lrp-int\n port incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0\n addresses: [\"10:66:6a:b4:b0:c4 dynamic\"]\n port incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0\n addresses: [\"10:66:6a:0a:69:79 dynamic\"]\nswitch 3711f4b7-04cc-4a50-80e6-dd4713723bf8 (incus-net24-ls-ext)\n port incus-net24-ls-ext-lsp-router\n type: router\n router-port: incus-net24-lr-lrp-ext\n port incus-net24-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter a7e9d484-ab5b-4809-8eea-f7035fb486c4 (incus-net24-lr)\n port incus-net24-lr-lrp-int\n mac: \"10:66:6a:49:f5:82\"\n ipv6-lla: \"fe80::1266:6aff:fe49:f582\"\n networks: [\"10.253.73.1/24\"]\n port incus-net24-lr-lrp-ext\n mac: \"10:66:6a:49:f5:82\"\n ipv6-lla: \"fe80::1266:6aff:fe49:f582\"\n networks: [\"10.10.40.64/24\"]\n nat 2f5b47a8-33cc-41f5-b743-b9d026e64b34\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net24-lr-lrp-ext\n Port_Binding incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 0e9dad28-87db-4c24-9f59-c170e37d6cca\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:49:f5:82\"\nname : incus-net24-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 5dfb7a6b-c283-4425-9059-ba708a6c15d5\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 6368b1fa-61f8-4094-9df3-69389416a25d\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:49:f5:82\"\nname : incus-net24-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 743a5cc5-a6a4-41f1-9cf3-dfc9540a6cd4\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 9f3766c9-6182-4567-a72a-4a0cef0dc8db\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f02842e8-3f33-43a1-be58-a61efa64b253\nlogical_port : cr-incus-net24-lr-lrp-ext\nmac : [\"10:66:6a:49:f5:82 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net24-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:48:93:53 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T05:48:20.549508+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.471, "exit_code": 0, "stdout": "10.10.40.64 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T05:48:21.021675+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.506, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192054041880\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01268|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192054042040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01269|bridge|INFO|bridge incusovn16: using datapath ID 0000261ad7c9334d\"\n },\n {\n \"at\": \"1789192054042059\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01270|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192054043803\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01271|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054043869\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054043896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054043909\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054043938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054043949\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054043963\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054043976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054043996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044029\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044039\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044057\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054044093\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044104\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044121\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044140\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044150\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044162\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044185\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044206\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054044219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01272|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044233\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044244\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044256\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044279\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044290\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044301\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044311\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044320\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044336\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044354\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044380\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054044429\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044443\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044453\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044463\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044475\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044489\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044503\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044512\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044537\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054044550\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01273|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044577\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044597\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044610\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044622\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044631\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044646\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044658\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054044671\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044684\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332044ms\"\n },\n {\n \"at\": \"1789192054044701\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044710\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044729\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044741\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054044756\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044765\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044793\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044802\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044813\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044824\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044833\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044844\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054139872\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01274|dpif|WARN|Dropped 873 log messages in last 10015 seconds (most recently, 10014 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192054139987\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054140034\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01276|bridge|WARN|Dropped 11077 log messages in last 10020 seconds (most recently, 10014 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192054140071\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01277|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054140111\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054140137\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01279|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054140429\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00001|bfd(handler101)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054140562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00002|bfd(handler101)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054140601\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054140639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054140672\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" my_disc:0x59c6c3e your_disc:0x0\"\n },\n {\n \"at\": \"1789192054140716\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140744\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140771\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054140798\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054140832\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054140860\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140887\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140921\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054140953\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054140981\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054141337\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054141453\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054141678\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141718\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054141761\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141821\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054141846\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054141874\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141902\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054141952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054141980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142019\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054142046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00003|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054142083\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054142117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054142153\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054142179\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054142215\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054142251\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054142278\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054142305\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -1506332140ms\"\n },\n {\n \"at\": \"1789192054142334\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054142361\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054142386\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054142412\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054142444\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142471\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142514\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054142541\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054142573\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054142602\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054142629\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142669\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054142706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054142743\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054142779\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01281|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054142809\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00004|bfd(handler101)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054142859\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00005|bfd(handler101)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054142897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054142924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054142952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" my_disc:0x8755ef1c your_disc:0x0\"\n },\n {\n \"at\": \"1789192054142995\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054143024\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054143049\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054143081\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054143145\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143169\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143202\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332142ms\"\n },\n {\n \"at\": \"1789192054143230\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789192054143260\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054143289\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054143323\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054143349\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054143375\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054143412\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054143435\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054143462\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054143504\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054143531\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054143557\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054143596\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054143625\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054143659\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143685\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00006|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054143711\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054143740\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054143801\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143828\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054143858\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054143890\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789192054143921\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054143956\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054143984\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054144007\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054144040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054144071\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144105\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144141\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054144168\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054144199\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054144225\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054144260\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144334\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054144369\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054144404\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054144439\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01283|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054144478\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192054144518\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01285|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192054145464\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00007|bfd(handler101)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054145552\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00008|bfd(handler101)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054145590\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054145622\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054145649\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" my_disc:0x720ec121 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054145683\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054145710\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054145745\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054145771\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054145796\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054145827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054145853\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054145879\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now -1506332145ms\"\n },\n {\n \"at\": \"1789192054145905\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +659ms\"\n },\n {\n \"at\": \"1789192054145941\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -101ms\"\n },\n {\n \"at\": \"1789192054145981\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054146008\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054146033\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146056\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054146085\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146116\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054146171\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054146198\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146235\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054146272\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054146303\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146330\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054146365\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00009|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054146402\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054146428\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054146454\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054146477\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054146511\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054146538\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054146562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +659ms\"\n },\n {\n \"at\": \"1789192054146586\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -101ms\"\n },\n {\n \"at\": \"1789192054146612\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054146635\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054146667\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146693\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054146719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146747\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146773\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054146799\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054146834\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054146860\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054146885\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146911\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054146936\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054149248\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01286|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789192054149336\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789192054985637\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00010|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054985750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054985765\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054985777\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054985799\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054985812\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054985826\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054985841\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +758ms\"\n },\n {\n \"at\": \"1789192054985869\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -182ms\"\n },\n {\n \"at\": \"1789192054985897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054985908\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192054985934\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054985950\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054985968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054985984\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054985995\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054986007\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192054986020\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054986031\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054986044\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192054986058\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054986073\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055010868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00011|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055010956\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055010973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055010983\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055010998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055011015\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055011025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055011035\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +903ms\"\n },\n {\n \"at\": \"1789192055011060\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -57ms\"\n },\n {\n \"at\": \"1789192055011075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055011086\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055011101\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055011112\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192055011121\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055011138\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055011153\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055011173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055011184\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055011193\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192055011204\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055011219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055011228\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055139591\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01288|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192055139783\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01289|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192055433403\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01290|bridge|INFO|bridge br-int: added interface vethcc4bbe23 on port 15\"\n },\n {\n \"at\": \"1789192055693022\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00012|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055693116\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055693142\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055693157\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055693175\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055693191\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055693206\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055693226\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Next TX Time: now +181ms\"\n },\n {\n \"at\": \"1789192055693251\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Last TX Time: now -749ms\"\n },\n {\n \"at\": \"1789192055693274\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055693289\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055693302\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055693317\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192055693328\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055693337\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055693352\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055693369\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055693385\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055693398\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192055693414\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055693430\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055693444\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192056139719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01291|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192056140037\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192056659985\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01293|poll_loop|INFO|Dropped 6392 log messages in last 10019 seconds (most recently, 10014 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192056660083\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056660479\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01295|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056660965\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01296|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056661437\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01297|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056661909\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01298|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056662393\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01299|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056662874\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056663345\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01301|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056663873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01302|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192056664372\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01303|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)\"\n },\n {\n \"at\": \"1789192057139757\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01304|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192057139975\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01305|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192058139539\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01306|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192058139649\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192059139897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01308|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192059140101\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01309|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192060139964\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01310|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192060140159\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192061139626\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01312|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192061139760\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01313|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192062139733\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01314|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192062139959\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01315|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192062659949\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01316|poll_loop|INFO|Dropped 12263 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192062660056\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01317|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192063139973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01318|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192063140159\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01319|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192064045727\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01320|connmgr|INFO|br-int<->unix#7: 768 flow_mods in the 2 s starting 10 s ago (723 adds, 38 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789192064139575\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01321|dpif|WARN|Dropped 2092 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192064139641\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01322|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192065139622\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01323|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192065139817\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01324|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192066139676\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01325|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192066139983\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192067139562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01327|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192067139686\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192068139805\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01329|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192068140030\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192068659515\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01331|poll_loop|INFO|Dropped 12451 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192068659589\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01332|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192069139851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01333|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192069140173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01334|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192070140056\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01335|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192070140270\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01336|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192071139704\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01337|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192071139821\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192072139540\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01339|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192072139725\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01340|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192073139770\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01341|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192073139959\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01342|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192074139514\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01343|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192074139623\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01344|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192074659851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01345|poll_loop|INFO|Dropped 12322 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192074660051\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192075139899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01347|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192075140075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01348|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192076139937\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01349|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192076140143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01350|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192077139731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01351|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192077139840\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01352|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192078139788\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01353|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192078140014\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192079139767\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01355|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192079139873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192080140029\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01357|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192080140266\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192080659591\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01359|poll_loop|INFO|Dropped 12312 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192080659667\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01360|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192081139951\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01361|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192081140005\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192082139923\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01363|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192082140155\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192083139662\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01365|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192083139772\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01366|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192084139651\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01367|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192084139912\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192085139580\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01369|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192085139723\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01370|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192086139514\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01371|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192086139622\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01372|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192086659810\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01373|poll_loop|INFO|Dropped 12213 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192086660074\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01374|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192087139638\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01375|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192087139734\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01376|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192088139627\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01377|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192088139850\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01378|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192089139532\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01379|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192089139627\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01380|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192090139542\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01381|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192090139865\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01382|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192091139543\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01383|dpif|WARN|Dropped 1998 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192091139658\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01384|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192092139942\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01385|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192092140143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01386|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192092659776\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01387|poll_loop|INFO|Dropped 12171 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192092659868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01388|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192093139600\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01389|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192093139687\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01390|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192094139824\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01391|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192094140050\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01392|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192095139706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01393|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192095139841\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01394|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192096140066\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01395|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192096140400\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01396|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192097139544\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01397|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192097139662\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01398|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192098139639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01399|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192098139847\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01400|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192098659570\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01401|poll_loop|INFO|Dropped 12311 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192098659658\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01402|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192099139570\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01403|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192099139670\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01404|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192100139544\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01405|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192100139704\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01406|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192101139712\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01407|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192101140022\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01408|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:21.528382+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.433, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192054036312\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00101|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192054036457\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00102|bridge|INFO|bridge incusovn16: using datapath ID 0000123ddc1aa34d\"\n },\n {\n \"at\": \"1789192054036472\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00103|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192054037354\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00104|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054037402\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054037426\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054037441\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054037451\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054037463\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054037475\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309036ms\"\n },\n {\n \"at\": \"1789192054037488\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -1555309036ms\"\n },\n {\n \"at\": \"1789192054037500\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -1555309036ms\"\n },\n {\n \"at\": \"1789192054037511\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054037525\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054037536\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054037548\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054037559\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054037571\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054037583\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054037595\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054037605\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054037616\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054037628\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054037639\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054037651\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054037662\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054044045\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00105|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044092\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044105\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044120\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044131\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044142\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044151\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044165\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044177\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044187\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044199\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044208\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044219\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054044229\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044242\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044253\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044262\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044271\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044283\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044294\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044303\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044314\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054044325\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00106|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054044336\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054044347\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054044356\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054044368\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054044377\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054044386\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044399\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044412\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -1555309043ms\"\n },\n {\n \"at\": \"1789192054044421\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054044431\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044441\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044451\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054044461\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054044471\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044481\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054044490\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054044500\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054044509\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054044518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044528\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054044538\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054133109\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00107|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192054133200\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00108|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789192054140549\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00109|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192054140624\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00110|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 10\"\n },\n {\n \"at\": \"1789192054930921\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00001|bfd(handler105)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054931063\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00002|bfd(handler105)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054931094\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054931131\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054931153\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" my_disc:0xa98f3f1e your_disc:0xfc85e91\"\n },\n {\n \"at\": \"1789192054931177\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054931199\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054931227\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054931249\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054931272\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054931294\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931316\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931346\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309930ms\"\n },\n {\n \"at\": \"1789192054931369\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +767ms\"\n },\n {\n \"at\": \"1789192054931402\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -33ms\"\n },\n {\n \"at\": \"1789192054931429\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054931454\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054931484\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054931509\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054931534\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054931559\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054931585\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054931609\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054931631\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054931653\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054931676\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054931698\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054931726\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054931747\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00003|bfd(handler105)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054931770\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054931791\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054931812\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054931832\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931858\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054931879\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054931904\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +767ms\"\n },\n {\n \"at\": \"1789192054931926\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -33ms\"\n },\n {\n \"at\": \"1789192054932008\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054932036\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054932056\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054932077\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054932095\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932118\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932138\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054932159\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054932180\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054932200\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054932219\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932243\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054932264\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939271\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00004|bfd(handler105)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054939315\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00005|bfd(handler105)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054939329\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054939339\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054939349\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" my_disc:0xca374396 your_disc:0x8755ef1c\"\n },\n {\n \"at\": \"1789192054939360\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054939370\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054939381\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054939390\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939410\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054939421\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939430\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939439\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309938ms\"\n },\n {\n \"at\": \"1789192054939449\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +749ms\"\n },\n {\n \"at\": \"1789192054939459\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -41ms\"\n },\n {\n \"at\": \"1789192054939472\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054939483\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054939493\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939503\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054939513\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939523\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939535\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054939544\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054939554\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939564\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054939576\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054939585\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939597\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939607\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00006|bfd(handler105)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054939617\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054939627\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054939635\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054939645\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939655\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054939664\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054939673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now +749ms\"\n },\n {\n \"at\": \"1789192054939688\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -41ms\"\n },\n {\n \"at\": \"1789192054939697\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054939707\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054939716\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939727\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0x8755ef1c\"\n },\n {\n \"at\": \"1789192054939736\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939747\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939757\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054939767\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054939776\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054939785\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0xca374396\"\n },\n {\n \"at\": \"1789192054939793\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939804\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054939813\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955400\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00007|bfd(handler105)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054955440\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00008|bfd(handler105)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054955454\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054955465\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054955477\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" my_disc:0x704f5285 your_disc:0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054955489\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054955499\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054955509\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054955518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955528\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054955539\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955548\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955558\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now -1555309954ms\"\n },\n {\n \"at\": \"1789192054955569\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -138ms\"\n },\n {\n \"at\": \"1789192054955580\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -918ms\"\n },\n {\n \"at\": \"1789192054955598\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054955609\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054955618\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955628\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054955640\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955649\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955662\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054955673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054955682\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955692\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054955702\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054955711\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955720\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955730\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00009|bfd(handler105)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054955743\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054955752\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054955765\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054955776\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955786\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054955796\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054955806\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Next TX Time: now -138ms\"\n },\n {\n \"at\": \"1789192054955816\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Last TX Time: now -918ms\"\n },\n {\n \"at\": \"1789192054955831\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054955840\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054955848\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955859\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054955869\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955879\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955888\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054955898\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054955907\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054955917\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054955927\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955937\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054955945\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192064039198\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00111|connmgr|INFO|br-int<->unix#7: 774 flow_mods in the 2 s starting 10 s ago (713 adds, 53 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:21.965471+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.488, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192054040695\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192054040886\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 0000064dfba3f74b\"\n },\n {\n \"at\": \"1789192054040910\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00107|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192054042644\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00108|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054042695\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054042714\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054042728\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054042742\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054042754\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054042767\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054042778\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054042789\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054042801\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054042813\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054042825\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054042837\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054042849\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054042861\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054042871\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054042883\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054042894\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054042906\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054042916\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054042930\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054042942\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054042953\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00109|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054042965\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054042976\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054042985\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054042997\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054043009\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054043019\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043030\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054043042\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043053\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043068\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054043079\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043090\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043102\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054043113\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054043124\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043138\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054043149\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043159\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043168\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054043178\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043188\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054043207\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00110|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054043219\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054043231\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054043242\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054043251\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054043262\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054043273\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043283\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043292\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209040ms\"\n },\n {\n \"at\": \"1789192054043308\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054043318\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043330\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043343\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054043356\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054043366\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043376\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054043386\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054043395\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054043406\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054043416\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043430\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054043439\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054137204\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00111|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192054137253\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00112|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789192054138105\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00001|bfd(handler102)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054138169\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00002|bfd(handler102)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054138210\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054138248\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054138274\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" my_disc:0x44c454d1 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054138301\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054138328\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054138352\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054138376\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054138400\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054138425\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054138449\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054138475\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054138500\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054138525\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054138555\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054138579\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054138608\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054138632\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054138660\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054138684\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054138709\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054138733\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054138766\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054138792\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054138821\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054138845\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054138871\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054138897\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00003|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054138926\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054138962\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054138988\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054139012\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054139036\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054139070\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054139103\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054139128\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -14209135ms\"\n },\n {\n \"at\": \"1789192054139151\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054139175\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054139198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054139228\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054139255\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139278\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139301\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054139326\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054139348\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054139375\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054139399\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139423\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054139447\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054140365\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00004|bfd(handler102)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054140434\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00005|bfd(handler102)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054140467\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054140493\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054140520\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" my_disc:0xfc85e91 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054140546\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140571\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054140595\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054140618\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054140641\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054140665\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140688\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054140711\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209138ms\"\n },\n {\n \"at\": \"1789192054140741\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +792ms\"\n },\n {\n \"at\": \"1789192054140766\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054140789\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054140812\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054140836\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054140859\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054140883\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054140906\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054140929\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054140954\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054140985\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141010\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054141036\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054141068\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141093\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054141116\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00006|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054141140\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054141169\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054141193\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054141217\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054141238\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054141261\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054141284\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +792ms\"\n },\n {\n \"at\": \"1789192054141305\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789192054141328\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054141350\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054141373\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141395\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192054141415\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141439\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141463\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054141487\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054141513\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054141548\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192054141572\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141595\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054141620\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054143660\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00113|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192054143739\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00114|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192054802666\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00007|bfd(handler102)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054802764\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00008|bfd(handler102)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054802797\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054802829\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054802852\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" my_disc:0x6af7c434 your_disc:0x720ec121\"\n },\n {\n \"at\": \"1789192054802880\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054802902\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054802930\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054802956\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054802977\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054803004\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803034\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803071\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now -14209800ms\"\n },\n {\n \"at\": \"1789192054803094\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +180ms\"\n },\n {\n \"at\": \"1789192054803127\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789192054803153\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054803176\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054803200\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803224\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054803247\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803273\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803298\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054803321\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054803346\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803370\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054803397\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054803424\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803456\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054803486\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00009|bfd(handler102)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054803515\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054803537\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054803560\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054803583\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803607\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054803628\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054803654\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +180ms\"\n },\n {\n \"at\": \"1789192054803677\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789192054803704\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054803726\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054803756\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803788\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x720ec121\"\n },\n {\n \"at\": \"1789192054803820\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803844\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803865\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054803888\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054803909\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054803933\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x6af7c434\"\n },\n {\n \"at\": \"1789192054803954\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054803975\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054804000\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054968413\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00010|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054968506\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054968544\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054968569\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054968595\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054968618\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054968643\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054968670\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +154ms\"\n },\n {\n \"at\": \"1789192054968699\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -826ms\"\n },\n {\n \"at\": \"1789192054968723\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054968747\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192054968779\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054968805\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054968831\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054968864\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054968912\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054968938\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192054968965\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054968992\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054969022\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192054969047\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054969089\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055870269\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00011|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055870491\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055870536\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055870549\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055870563\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055870576\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055870588\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055870603\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Next TX Time: now +32ms\"\n },\n {\n \"at\": \"1789192055870615\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Last TX Time: now -938ms\"\n },\n {\n \"at\": \"1789192055870629\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055870641\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055870653\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055870664\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Discriminator: 0xa98f3f1e\"\n },\n {\n \"at\": \"1789192055870676\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055870688\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055870700\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055870711\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055870722\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055870734\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Discriminator: 0xfc85e91\"\n },\n {\n \"at\": \"1789192055870746\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055870756\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055870768\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192056231826\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00115|bridge|INFO|bridge br-int: added interface veth09ee9212 on port 13\"\n },\n {\n \"at\": \"1789192064044855\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00116|connmgr|INFO|br-int<->unix#7: 741 flow_mods in the 2 s starting 10 s ago (703 adds, 31 deletes, 7 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:22.455650+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A47%3A32.405610%2B00%3A00"], "seconds": 0.43, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192053840918\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192053841205\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 00009a00fdbf174f\"\n },\n {\n \"at\": \"1789192053841229\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00107|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789192053939039\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00108|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192053939158\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00109|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789192053943960\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00110|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192053944010\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00111|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192054041410\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00112|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054041464\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054041489\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054041508\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054041523\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054041540\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054041564\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435905ms\"\n },\n {\n \"at\": \"1789192054041583\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now -1555435905ms\"\n },\n {\n \"at\": \"1789192054041598\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -1555435905ms\"\n },\n {\n \"at\": \"1789192054041614\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054041631\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054041646\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054041660\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054041675\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054041689\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054041705\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054041720\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054041735\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054041751\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054041767\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054041784\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054041799\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054042048\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789192054045420\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00001|bfd(handler113)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054045447\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00002|bfd(handler113)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054045464\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789192054045488\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054045507\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" my_disc:0xe25c7ef1 your_disc:0x0\"\n },\n {\n \"at\": \"1789192054045523\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054045542\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054045558\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054045580\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054045597\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054045613\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054045628\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054045645\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054045663\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +917ms\"\n },\n {\n \"at\": \"1789192054045679\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789192054045696\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054045711\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054045730\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054045745\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054045759\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054045775\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054045792\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054045805\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054045823\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054045838\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054045854\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054045870\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054045888\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054045902\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00003|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054045928\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054045942\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054045958\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054045973\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054045988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054046003\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054046023\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +917ms\"\n },\n {\n \"at\": \"1789192054046037\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789192054046052\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054046067\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054046082\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046097\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192054046111\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046126\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046146\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054046160\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789192054046176\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046191\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192054046206\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046224\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046237\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054046253\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00113|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054046270\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054046284\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054046299\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054046314\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054046329\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054046349\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046364\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046382\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046399\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054046414\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046429\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046445\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054046462\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046477\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046492\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054046507\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046523\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046537\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054046552\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046568\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046583\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054046605\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00114|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054046625\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054046639\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054046655\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054046670\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054046684\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789192054046698\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046711\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046726\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -1555435909ms\"\n },\n {\n \"at\": \"1789192054046741\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054046756\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046771\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046784\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054046802\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054046815\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046830\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054046845\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789192054046860\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054046875\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789192054046890\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046905\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054046925\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789192054147715\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00004|bfd(handler113)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054147821\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00005|bfd(handler113)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054147848\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054147868\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054147883\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" my_disc:0xdc50ac8c your_disc:0x59c6c3e\"\n },\n {\n \"at\": \"1789192054147899\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054147924\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054147940\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054147955\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054147972\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054147988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054147999\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148015\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555436011ms\"\n },\n {\n \"at\": \"1789192054148027\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789192054148039\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789192054148051\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054148061\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054148073\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148088\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054148104\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148118\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148134\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054148149\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054148164\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148178\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054148213\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054148227\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148242\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148256\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00006|bfd(handler113)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054148273\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054148288\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148302\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054148317\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148331\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148344\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054148360\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789192054148374\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789192054148387\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054148401\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054148415\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148430\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x59c6c3e\"\n },\n {\n \"at\": \"1789192054148443\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148458\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148472\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054148489\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054148503\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148518\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xdc50ac8c\"\n },\n {\n \"at\": \"1789192054148533\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148547\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148561\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148574\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00007|bfd(handler113)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789192054148597\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00008|bfd(handler113)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789192054148612\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789192054148630\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789192054148645\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" my_disc:0x83f7dd28 your_disc:0x44c454d1\"\n },\n {\n \"at\": \"1789192054148665\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054148679\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789192054148694\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789192054148707\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148721\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054148735\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148749\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054148763\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now -1555436012ms\"\n },\n {\n \"at\": \"1789192054148778\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +825ms\"\n },\n {\n \"at\": \"1789192054148793\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789192054148808\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054148821\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054148834\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148850\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054148866\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148880\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148893\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054148906\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054148925\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054148939\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054148955\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789192054148970\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054148983\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054148997\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00009|bfd(handler113)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192054149013\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192054149029\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192054149043\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192054149057\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054149071\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192054149084\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192054149097\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +825ms\"\n },\n {\n \"at\": \"1789192054149114\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789192054149128\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192054149143\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789192054149157\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054149170\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x44c454d1\"\n },\n {\n \"at\": \"1789192054149182\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149198\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149212\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192054149229\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789192054149245\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192054149259\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0x83f7dd28\"\n },\n {\n \"at\": \"1789192054149273\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149288\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192054149304\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055006585\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00010|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789192055006855\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789192055006869\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192055006880\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789192055006893\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055006902\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789192055006920\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789192055006935\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Next TX Time: now +726ms\"\n },\n {\n \"at\": \"1789192055006954\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Last TX Time: now -44ms\"\n },\n {\n \"at\": \"1789192055006969\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789192055006982\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789192055006997\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055007007\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Discriminator: 0x704f5285\"\n },\n {\n \"at\": \"1789192055007018\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055007030\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055007041\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789192055007051\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789192055007064\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789192055007075\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Discriminator: 0xe25c7ef1\"\n },\n {\n \"at\": \"1789192055007085\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789192055007094\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789192055007105\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789192063844708\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00115|connmgr|INFO|br-int<->unix#7: 779 flow_mods in the 2 s starting 10 s ago (719 adds, 59 deletes, 1 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:48:22.889800+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-probe.txt", "router_mac": "[\"10:66:6a:49:f5:82 10.10.40.64/24\"]", "at": "2026-09-12T05:48:22.893929+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 24451, "ready": true, "ready_signal": "time=\"2026-09-11T22:53:36-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:53:36.717313+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/topology.jsonl", "destroy"], "seconds": 3.378, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T05:53:40.095647+00:00"} +{"capture": "monitor-delete", "pid": 24451, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.log", "ready_signal": "time=\"2026-09-11T22:53:36-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:53:40.098010+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.092, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T05:53:40.190921+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.083, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T05:53:40.274227+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.141, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:48:93:53 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T05:53:40.415328+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.317, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T05:53:40.733217+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A53%3A36.621707%2B00%3A00"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192416659910\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02158|poll_loop|INFO|Dropped 12426 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192416659993\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192417139653\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02160|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192417174106\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02161|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192417593502\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02162|bridge|INFO|bridge br-int: deleted interface vethcc4bbe23 on port 15\"\n },\n {\n \"at\": \"1789192418140011\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02163|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192418140128\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192419139537\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02165|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192419139731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02166|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192419564686\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02167|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192419564821\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02168|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789192419583398\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02169|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789192419583481\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:53:40.842292+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T05%3A53%3A36.621707%2B00%3A00"], "seconds": 0.094, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192419560100\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00115|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192419560380\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00116|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192419560635\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00117|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192419578194\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00118|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 10\"\n },\n {\n \"at\": \"1789192419578235\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:53:40.936696+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T05%3A53%3A36.621707%2B00%3A00"], "seconds": 0.104, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192418582244\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00120|bridge|INFO|bridge br-int: deleted interface veth09ee9212 on port 13\"\n },\n {\n \"at\": \"1789192419562888\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00121|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192419563016\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00122|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192419563049\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00123|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192419583406\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00124|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192419583570\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:53:41.041122+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A53%3A36.621707%2B00%3A00"], "seconds": 0.093, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192419572538\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00119|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789192419572753\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00120|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192419572772\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00121|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789192419600629\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789192419603517\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00122|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:53:41.134260+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T05:53:41.135158+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/clean-1/create.stderr.txt new file mode 100644 index 0000000..80c41c1 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/create.stderr.txt @@ -0,0 +1,6 @@ +WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later) +ERROR: unable to select packages: + busybox-extras (no such package): + required by: world[busybox-extras] + curl (no such package): + required by: world[curl] diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/clean-1/create.stdout.json new file mode 100644 index 0000000..d087d19 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/create.stdout.json @@ -0,0 +1,3 @@ +{ + "error": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/cycle.json b/spikes/ovn/diagnosis-2026-09-12/clean-1/cycle.json new file mode 100644 index 0000000..3a903bc --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/cycle.json @@ -0,0 +1,128 @@ +{ + "ok": false, + "datapath_ok": false, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 1, + "keep_on_failure": true, + "teardown": "skipped", + "started_at": "2026-09-12T05:47:32.405610+00:00", + "ended_at": "2026-09-12T05:48:22.895000+00:00", + "seconds": 50.489, + "external_ip": "10.10.40.64", + "router_mac": "[\"10:66:6a:49:f5:82 10.10.40.64/24\"]", + "create": { + "ok": false, + "exit_code": 1, + "result": { + "error": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]" + }, + "stderr": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]\n" + }, + "probe": null, + "fallback_checks": [ + { + "guest": "one", + "check": "cross-member-ping", + "command": "ping -c 3 -W 2 10.253.73.3", + "exit_code": 0, + "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=0.315 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.699 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.466 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.315/0.493/0.699 ms\n", + "stderr": "" + }, + { + "guest": "one", + "check": "gateway-ping", + "command": "ping -c 3 -W 2 10.10.40.1", + "exit_code": 1, + "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", + "stderr": "" + }, + { + "guest": "one", + "check": "dns", + "command": "nslookup example.com 10.10.40.1", + "exit_code": 1, + "stdout": ";; connection timed out; no servers could be reached\n\n", + "stderr": "" + }, + { + "guest": "one", + "check": "wget", + "command": "wget -T 15 -qO /dev/null https://example.com", + "exit_code": 1, + "stdout": "", + "stderr": "wget: bad address 'example.com'\n" + }, + { + "guest": "two", + "check": "cross-member-ping", + "command": "ping -c 3 -W 2 10.253.73.2", + "exit_code": 0, + "stdout": "PING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.029 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.503 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.379 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.379/0.637/1.029 ms\n", + "stderr": "" + }, + { + "guest": "two", + "check": "gateway-ping", + "command": "ping -c 3 -W 2 10.10.40.1", + "exit_code": 1, + "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", + "stderr": "" + }, + { + "guest": "two", + "check": "dns", + "command": "nslookup example.com 10.10.40.1", + "exit_code": 1, + "stdout": ";; connection timed out; no servers could be reached\n\n", + "stderr": "" + }, + { + "guest": "two", + "check": "wget", + "command": "wget -T 15 -qO /dev/null https://example.com", + "exit_code": 1, + "stdout": "", + "stderr": "wget: bad address 'example.com'\n" + } + ], + "destroy": { + "ok": true, + "skipped": true, + "reason": "keep-on-failure" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 89205, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.log", + "bytes": 137164, + "ready_signal": "time=\"2026-09-11T22:47:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T05:47:32.889292+00:00", + "stopped_at": "2026-09-12T05:47:43.022590+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 93590, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1/tcpdump-arp.log", + "bytes": 188, + "ready_signal": "listening on", + "started_at": "2026-09-12T05:47:44.485075+00:00", + "stopped_at": "2026-09-12T05:48:19.655017+00:00" + } + ], + "failures": { + "checks": [ + "create: WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]" + ], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/clean-1" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/clean-1/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/clean-1/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-probe.txt new file mode 100644 index 0000000..ba134af --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-probe.txt @@ -0,0 +1,7141 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b4:b0:c4 | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:0a:69:79 | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch d3e72649-17ff-459c-b7a5-ac3497645dfa (incus-net24-ls-int) + port incus-net24-ls-int-lsp-router + type: router + router-port: incus-net24-lr-lrp-int + port incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0 + addresses: ["10:66:6a:b4:b0:c4 dynamic"] + port incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0 + addresses: ["10:66:6a:0a:69:79 dynamic"] +switch 3711f4b7-04cc-4a50-80e6-dd4713723bf8 (incus-net24-ls-ext) + port incus-net24-ls-ext-lsp-router + type: router + router-port: incus-net24-lr-lrp-ext + port incus-net24-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router a7e9d484-ab5b-4809-8eea-f7035fb486c4 (incus-net24-lr) + port incus-net24-lr-lrp-int + mac: "10:66:6a:49:f5:82" + ipv6-lla: "fe80::1266:6aff:fe49:f582" + networks: ["10.253.73.1/24"] + port incus-net24-lr-lrp-ext + mac: "10:66:6a:49:f5:82" + ipv6-lla: "fe80::1266:6aff:fe49:f582" + networks: ["10.10.40.64/24"] + nat 2f5b47a8-33cc-41f5-b743-b9d026e64b34 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net24-lr-lrp-ext + Port_Binding incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 0e9dad28-87db-4c24-9f59-c170e37d6cca +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:49:f5:82" +name : incus-net24-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 5dfb7a6b-c283-4425-9059-ba708a6c15d5 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 6368b1fa-61f8-4094-9df3-69389416a25d +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:49:f5:82" +name : incus-net24-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 743a5cc5-a6a4-41f1-9cf3-dfc9540a6cd4 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 9f3766c9-6182-4567-a72a-4a0cef0dc8db +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f02842e8-3f33-43a1-be58-a61efa64b253 +logical_port : cr-incus-net24-lr-lrp-ext +mac : ["10:66:6a:49:f5:82 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net24-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:48:93:53 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192054041880", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01268|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054042040", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01269|bridge|INFO|bridge incusovn16: using datapath ID 0000261ad7c9334d" + }, + { + "at": "1789192054042059", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01270|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054043803", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01271|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054043869", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054043896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054043909", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054043938", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043949", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043963", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054043976", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054043996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044029", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054044039", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044057", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054044093", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044104", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044121", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044140", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044150", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044162", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044185", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044206", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01272|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044233", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054044244", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044256", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044279", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044290", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044301", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054044311", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054044320", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044336", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054044354", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044371", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044380", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054044429", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044443", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044453", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044463", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044475", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044489", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044503", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044512", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044537", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044550", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01273|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044577", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054044597", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044610", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044622", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044631", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044646", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054044658", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054044671", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054044684", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044701", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054044710", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044729", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044741", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054044756", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044765", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044793", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044802", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044813", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044824", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044833", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044844", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054139872", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01274|dpif|WARN|Dropped 873 log messages in last 10015 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192054139987", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054140034", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01276|bridge|WARN|Dropped 11077 log messages in last 10020 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192054140071", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01277|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054140111", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054140137", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01279|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054140429", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00001|bfd(handler101)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054140562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00002|bfd(handler101)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054140601", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054140639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " flags: none" + }, + { + "at": "1789192054140672", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " my_disc:0x59c6c3e your_disc:0x0" + }, + { + "at": "1789192054140716", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054140744", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054140771", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054140798", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054140832", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054140860", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054140887", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054140921", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332140ms" + }, + { + "at": "1789192054140953", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332140ms" + }, + { + "at": "1789192054140981", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332140ms" + }, + { + "at": "1789192054141337", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054141453", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054141678", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141718", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054141761", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054141791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141821", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054141846", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054141874", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141902", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054141952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054141980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054142019", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054142046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00003|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054142083", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054142117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054142153", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054142179", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054142215", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054142251", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054142278", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332140ms" + }, + { + "at": "1789192054142305", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332140ms" + }, + { + "at": "1789192054142334", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054142361", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054142386", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054142412", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054142444", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054142471", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054142514", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054142541", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054142573", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054142602", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054142629", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054142669", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054142706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054142743", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054142779", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01281|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054142809", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00004|bfd(handler101)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054142859", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00005|bfd(handler101)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789192054142897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054142924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " flags: none" + }, + { + "at": "1789192054142952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " my_disc:0x8755ef1c your_disc:0x0" + }, + { + "at": "1789192054142995", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054143024", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054143049", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054143081", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054143117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054143145", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054143169", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054143202", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332142ms" + }, + { + "at": "1789192054143230", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789192054143260", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054143289", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054143323", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054143349", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054143375", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054143412", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054143435", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054143462", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054143504", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054143531", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054143557", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054143596", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054143625", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054143659", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054143685", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00006|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054143711", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054143740", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054143775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054143801", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054143828", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054143858", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054143890", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789192054143921", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054143956", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054143984", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054144007", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054144040", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054144071", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054144105", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054144141", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054144168", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054144199", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054144225", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054144260", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054144334", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054144369", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054144404", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054144439", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01283|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054144478", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054144518", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01285|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054145464", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00007|bfd(handler101)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054145552", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00008|bfd(handler101)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789192054145590", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054145622", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " flags: none" + }, + { + "at": "1789192054145649", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " my_disc:0x720ec121 your_disc:0x0" + }, + { + "at": "1789192054145683", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054145710", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054145745", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054145771", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054145796", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054145827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054145853", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054145879", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332145ms" + }, + { + "at": "1789192054145905", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +659ms" + }, + { + "at": "1789192054145941", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -101ms" + }, + { + "at": "1789192054145981", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054146008", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054146033", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146056", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054146085", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054146116", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054146171", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054146198", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146235", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x720ec121" + }, + { + "at": "1789192054146272", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054146303", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146330", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054146365", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00009|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054146402", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054146428", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054146454", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054146477", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054146511", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054146538", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054146562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +659ms" + }, + { + "at": "1789192054146586", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -101ms" + }, + { + "at": "1789192054146612", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054146635", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054146667", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146693", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054146719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054146747", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146773", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054146799", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054146834", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146860", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x720ec121" + }, + { + "at": "1789192054146885", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054146911", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146936", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054149248", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01286|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789192054149336", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789192054985637", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00010|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054985750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054985765", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054985777", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054985799", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054985812", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054985826", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054985841", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +758ms" + }, + { + "at": "1789192054985869", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -182ms" + }, + { + "at": "1789192054985897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054985908", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: init" + }, + { + "at": "1789192054985934", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054985950", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054985968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054985984", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054985995", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054986007", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: up" + }, + { + "at": "1789192054986020", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054986031", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x720ec121" + }, + { + "at": "1789192054986044", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192054986058", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054986073", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055010868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00011|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055010956", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192055010973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055010983", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055010998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055011015", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055011025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055011035", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +903ms" + }, + { + "at": "1789192055011060", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -57ms" + }, + { + "at": "1789192055011075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192055011086", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: init" + }, + { + "at": "1789192055011101", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055011112", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192055011121", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055011138", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055011153", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192055011173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: up" + }, + { + "at": "1789192055011184", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055011193", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x59c6c3e" + }, + { + "at": "1789192055011204", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055011219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055011228", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055139591", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01288|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192055139783", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01289|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192055433403", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01290|bridge|INFO|bridge br-int: added interface vethcc4bbe23 on port 15" + }, + { + "at": "1789192055693022", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00012|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055693116", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192055693142", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055693157", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055693175", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055693191", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055693206", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055693226", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +181ms" + }, + { + "at": "1789192055693251", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -749ms" + }, + { + "at": "1789192055693274", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192055693289", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: init" + }, + { + "at": "1789192055693302", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055693317", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192055693328", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055693337", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055693352", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192055693369", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: up" + }, + { + "at": "1789192055693385", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055693398", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x8755ef1c" + }, + { + "at": "1789192055693414", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055693430", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055693444", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192056139719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01291|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192056140037", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192056659985", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01293|poll_loop|INFO|Dropped 6392 log messages in last 10019 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192056660083", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056660479", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01295|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056660965", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01296|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056661437", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01297|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056661909", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01298|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056662393", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01299|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056662874", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056663345", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01301|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056663873", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01302|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056664372", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01303|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192057139757", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01304|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192057139975", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01305|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192058139539", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01306|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192058139649", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192059139897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01308|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192059140101", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01309|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192060139964", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01310|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192060140159", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192061139626", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01312|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192061139760", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01313|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192062139733", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01314|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192062139959", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01315|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192062659949", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01316|poll_loop|INFO|Dropped 12263 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192062660056", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01317|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192063139973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01318|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192063140159", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01319|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192064045727", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01320|connmgr|INFO|br-int<->unix#7: 768 flow_mods in the 2 s starting 10 s ago (723 adds, 38 deletes, 7 modifications)" + }, + { + "at": "1789192064139575", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01321|dpif|WARN|Dropped 2092 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192064139641", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01322|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192065139622", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01323|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192065139817", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01324|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192066139676", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01325|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192066139983", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192067139562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01327|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192067139686", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192068139805", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01329|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192068140030", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192068659515", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01331|poll_loop|INFO|Dropped 12451 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192068659589", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01332|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192069139851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01333|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192069140173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01334|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192070140056", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01335|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192070140270", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01336|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192071139704", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01337|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192071139821", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192072139540", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01339|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192072139725", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01340|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192073139770", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01341|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192073139959", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01342|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192074139514", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01343|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192074139623", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01344|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192074659851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01345|poll_loop|INFO|Dropped 12322 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192074660051", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192075139899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01347|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192075140075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01348|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192076139937", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01349|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192076140143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01350|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192077139731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01351|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192077139840", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01352|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192078139788", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01353|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192078140014", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192079139767", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01355|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192079139873", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192080140029", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01357|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192080140266", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192080659591", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01359|poll_loop|INFO|Dropped 12312 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192080659667", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01360|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192081139951", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01361|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192081140005", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192082139923", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01363|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192082140155", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192083139662", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01365|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192083139772", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01366|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192084139651", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01367|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192084139912", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192085139580", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01369|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192085139723", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01370|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192086139514", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01371|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192086139622", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01372|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192086659810", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01373|poll_loop|INFO|Dropped 12213 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192086660074", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01374|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192087139638", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01375|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192087139734", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01376|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192088139627", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01377|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192088139850", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01378|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192089139532", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01379|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192089139627", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01380|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192090139542", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01381|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192090139865", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01382|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192091139543", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01383|dpif|WARN|Dropped 1998 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192091139658", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01384|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192092139942", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01385|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192092140143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01386|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192092659776", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01387|poll_loop|INFO|Dropped 12171 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192092659868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01388|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192093139600", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01389|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192093139687", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01390|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192094139824", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01391|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192094140050", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01392|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192095139706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01393|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192095139841", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01394|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192096140066", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01395|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192096140400", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01396|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192097139544", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01397|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192097139662", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01398|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192098139639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01399|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192098139847", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01400|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192098659570", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01401|poll_loop|INFO|Dropped 12311 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192098659658", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01402|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192099139570", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01403|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192099139670", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01404|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192100139544", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01405|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192100139704", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01406|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192101139712", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01407|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192101140022", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01408|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192054036312", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00101|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054036457", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00102|bridge|INFO|bridge incusovn16: using datapath ID 0000123ddc1aa34d" + }, + { + "at": "1789192054036472", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00103|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054037354", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00104|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054037402", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054037426", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054037441", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054037451", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054037463", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054037475", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309036ms" + }, + { + "at": "1789192054037488", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -1555309036ms" + }, + { + "at": "1789192054037500", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -1555309036ms" + }, + { + "at": "1789192054037511", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054037525", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054037536", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054037548", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054037559", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054037571", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054037583", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054037595", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054037605", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054037616", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054037628", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054037639", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054037651", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054037662", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054044045", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00105|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044092", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054044105", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044120", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044131", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044142", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044151", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309043ms" + }, + { + "at": "1789192054044165", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -1555309043ms" + }, + { + "at": "1789192054044177", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -1555309043ms" + }, + { + "at": "1789192054044187", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054044199", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044208", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044219", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xfc85e91" + }, + { + "at": "1789192054044229", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044242", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044253", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044262", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044271", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044283", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044294", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044303", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044314", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044325", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00106|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044336", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054044347", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044356", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044368", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044377", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044386", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309043ms" + }, + { + "at": "1789192054044399", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -1555309043ms" + }, + { + "at": "1789192054044412", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -1555309043ms" + }, + { + "at": "1789192054044421", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054044431", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044441", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044451", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054044461", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044471", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044481", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044490", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044500", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044509", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044528", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044538", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054133109", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00107|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789192054133200", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00108|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789192054140549", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00109|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192054140624", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00110|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 10" + }, + { + "at": "1789192054930921", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00001|bfd(handler105)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054931063", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00002|bfd(handler105)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789192054931094", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054931131", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " flags: none" + }, + { + "at": "1789192054931153", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " my_disc:0xa98f3f1e your_disc:0xfc85e91" + }, + { + "at": "1789192054931177", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054931199", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054931227", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054931249", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054931272", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054931294", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054931316", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054931346", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309930ms" + }, + { + "at": "1789192054931369", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +767ms" + }, + { + "at": "1789192054931402", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -33ms" + }, + { + "at": "1789192054931429", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054931454", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054931484", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054931509", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xfc85e91" + }, + { + "at": "1789192054931534", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054931559", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054931585", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054931609", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054931631", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054931653", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054931676", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054931698", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054931726", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054931747", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00003|bfd(handler105)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054931770", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054931791", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054931812", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054931832", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054931858", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054931879", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054931904", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +767ms" + }, + { + "at": "1789192054931926", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -33ms" + }, + { + "at": "1789192054932008", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054932036", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054932056", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054932077", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xfc85e91" + }, + { + "at": "1789192054932095", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054932118", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054932138", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054932159", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054932180", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054932200", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054932219", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054932243", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054932264", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054939271", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00004|bfd(handler105)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054939315", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00005|bfd(handler105)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789192054939329", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054939339", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " flags: none" + }, + { + "at": "1789192054939349", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " my_disc:0xca374396 your_disc:0x8755ef1c" + }, + { + "at": "1789192054939360", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054939370", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054939381", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054939390", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054939410", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054939421", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054939430", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054939439", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309938ms" + }, + { + "at": "1789192054939449", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +749ms" + }, + { + "at": "1789192054939459", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -41ms" + }, + { + "at": "1789192054939472", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054939483", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054939493", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939503", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054939513", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054939523", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939535", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054939544", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054939554", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939564", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xca374396" + }, + { + "at": "1789192054939576", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054939585", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939597", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054939607", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00006|bfd(handler105)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054939617", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054939627", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054939635", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054939645", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054939655", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054939664", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054939673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +749ms" + }, + { + "at": "1789192054939688", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -41ms" + }, + { + "at": "1789192054939697", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054939707", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054939716", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939727", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054939736", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054939747", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939757", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054939767", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054939776", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939785", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xca374396" + }, + { + "at": "1789192054939793", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054939804", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939813", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054955400", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00007|bfd(handler105)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054955440", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00008|bfd(handler105)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054955454", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054955465", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " flags: none" + }, + { + "at": "1789192054955477", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " my_disc:0x704f5285 your_disc:0xe25c7ef1" + }, + { + "at": "1789192054955489", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054955499", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054955509", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054955518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054955528", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054955539", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054955548", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054955558", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309954ms" + }, + { + "at": "1789192054955569", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -138ms" + }, + { + "at": "1789192054955580", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -918ms" + }, + { + "at": "1789192054955598", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054955609", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054955618", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955628", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054955640", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054955649", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955662", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054955673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054955682", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955692", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x704f5285" + }, + { + "at": "1789192054955702", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054955711", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955720", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054955730", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00009|bfd(handler105)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054955743", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054955752", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054955765", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054955776", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054955786", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054955796", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054955806", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -138ms" + }, + { + "at": "1789192054955816", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -918ms" + }, + { + "at": "1789192054955831", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054955840", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054955848", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955859", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054955869", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054955879", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955888", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054955898", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054955907", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955917", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x704f5285" + }, + { + "at": "1789192054955927", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054955937", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955945", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192064039198", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00111|connmgr|INFO|br-int<->unix#7: 774 flow_mods in the 2 s starting 10 s ago (713 adds, 53 deletes, 8 modifications)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192054040695", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054040886", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 0000064dfba3f74b" + }, + { + "at": "1789192054040910", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00107|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054042644", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00108|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054042695", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054042714", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054042728", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054042742", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054042754", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054042767", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209040ms" + }, + { + "at": "1789192054042778", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209040ms" + }, + { + "at": "1789192054042789", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209040ms" + }, + { + "at": "1789192054042801", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054042813", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054042825", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054042837", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054042849", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054042861", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054042871", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054042883", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054042894", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054042906", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054042916", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054042930", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054042942", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054042953", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00109|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054042965", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054042976", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054042985", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054042997", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043009", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043019", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209040ms" + }, + { + "at": "1789192054043030", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054043042", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209040ms" + }, + { + "at": "1789192054043053", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209040ms" + }, + { + "at": "1789192054043068", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054043079", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054043090", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043102", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054043113", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054043124", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043138", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054043149", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054043159", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043168", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054043178", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054043188", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054043207", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00110|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054043219", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054043231", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054043242", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054043251", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043262", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043273", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209040ms" + }, + { + "at": "1789192054043283", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209040ms" + }, + { + "at": "1789192054043292", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209040ms" + }, + { + "at": "1789192054043308", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054043318", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054043330", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043343", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x720ec121" + }, + { + "at": "1789192054043356", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054043366", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043376", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054043386", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054043395", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043406", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054043416", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054043430", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043439", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054137204", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00111|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789192054137253", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00112|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789192054138105", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00001|bfd(handler102)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054138169", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00002|bfd(handler102)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054138210", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054138248", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " flags: none" + }, + { + "at": "1789192054138274", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " my_disc:0x44c454d1 your_disc:0x0" + }, + { + "at": "1789192054138301", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054138328", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054138352", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054138376", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054138400", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054138425", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054138449", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054138475", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209135ms" + }, + { + "at": "1789192054138500", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209135ms" + }, + { + "at": "1789192054138525", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209135ms" + }, + { + "at": "1789192054138555", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054138579", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054138608", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054138632", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054138660", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054138684", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054138709", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054138733", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054138766", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054138792", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x44c454d1" + }, + { + "at": "1789192054138821", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054138845", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054138871", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054138897", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00003|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054138926", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054138962", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054138988", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054139012", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054139036", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054139070", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054139103", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209135ms" + }, + { + "at": "1789192054139128", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209135ms" + }, + { + "at": "1789192054139151", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054139175", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054139198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054139228", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054139255", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054139278", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054139301", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054139326", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054139348", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054139375", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x44c454d1" + }, + { + "at": "1789192054139399", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054139423", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054139447", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054140365", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00004|bfd(handler102)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054140434", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00005|bfd(handler102)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789192054140467", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054140493", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " flags: none" + }, + { + "at": "1789192054140520", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " my_disc:0xfc85e91 your_disc:0x0" + }, + { + "at": "1789192054140546", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054140571", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054140595", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054140618", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054140641", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054140665", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054140688", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054140711", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209138ms" + }, + { + "at": "1789192054140741", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +792ms" + }, + { + "at": "1789192054140766", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054140789", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054140812", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054140836", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054140859", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054140883", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054140906", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054140929", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054140954", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054140985", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141010", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0xfc85e91" + }, + { + "at": "1789192054141036", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054141068", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141093", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054141116", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00006|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054141140", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054141169", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054141193", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054141217", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054141238", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054141261", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054141284", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +792ms" + }, + { + "at": "1789192054141305", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054141328", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054141350", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054141373", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141395", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054141415", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054141439", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141463", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054141487", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054141513", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141548", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0xfc85e91" + }, + { + "at": "1789192054141572", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054141595", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141620", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054143660", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00113|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192054143739", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00114|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192054802666", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00007|bfd(handler102)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054802764", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00008|bfd(handler102)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789192054802797", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054802829", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " flags: none" + }, + { + "at": "1789192054802852", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " my_disc:0x6af7c434 your_disc:0x720ec121" + }, + { + "at": "1789192054802880", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054802902", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054802930", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054802956", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054802977", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054803004", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054803034", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054803071", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209800ms" + }, + { + "at": "1789192054803094", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +180ms" + }, + { + "at": "1789192054803127", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789192054803153", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054803176", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054803200", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803224", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x720ec121" + }, + { + "at": "1789192054803247", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054803273", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054803298", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054803321", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: init" + }, + { + "at": "1789192054803346", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803370", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x6af7c434" + }, + { + "at": "1789192054803397", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054803424", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054803456", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054803486", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00009|bfd(handler102)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054803515", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054803537", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054803560", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054803583", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054803607", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054803628", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054803654", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +180ms" + }, + { + "at": "1789192054803677", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789192054803704", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054803726", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054803756", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803788", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x720ec121" + }, + { + "at": "1789192054803820", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054803844", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054803865", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054803888", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: init" + }, + { + "at": "1789192054803909", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803933", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x6af7c434" + }, + { + "at": "1789192054803954", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054803975", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054804000", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054968413", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00010|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054968506", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054968544", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054968569", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054968595", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054968618", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054968643", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054968670", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +154ms" + }, + { + "at": "1789192054968699", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -826ms" + }, + { + "at": "1789192054968723", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054968747", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: init" + }, + { + "at": "1789192054968779", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054968805", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054968831", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054968864", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054968912", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054968938", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: up" + }, + { + "at": "1789192054968965", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054968992", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x44c454d1" + }, + { + "at": "1789192054969022", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192054969047", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054969089", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055870269", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00011|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055870491", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192055870536", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055870549", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055870563", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055870576", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055870588", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055870603", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +32ms" + }, + { + "at": "1789192055870615", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -938ms" + }, + { + "at": "1789192055870629", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192055870641", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: init" + }, + { + "at": "1789192055870653", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055870664", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192055870676", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055870688", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055870700", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192055870711", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: up" + }, + { + "at": "1789192055870722", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055870734", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0xfc85e91" + }, + { + "at": "1789192055870746", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055870756", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055870768", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192056231826", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00115|bridge|INFO|bridge br-int: added interface veth09ee9212 on port 13" + }, + { + "at": "1789192064044855", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00116|connmgr|INFO|br-int<->unix#7: 741 flow_mods in the 2 s starting 10 s ago (703 adds, 31 deletes, 7 modifications)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192053840918", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192053841205", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 00009a00fdbf174f" + }, + { + "at": "1789192053841229", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00107|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192053939039", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00108|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789192053939158", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00109|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789192053943960", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00110|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192053944010", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00111|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192054041410", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00112|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054041464", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054041489", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054041508", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054041523", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054041540", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054041564", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435905ms" + }, + { + "at": "1789192054041583", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now -1555435905ms" + }, + { + "at": "1789192054041598", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -1555435905ms" + }, + { + "at": "1789192054041614", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054041631", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054041646", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054041660", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192054041675", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054041689", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054041705", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054041720", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054041735", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054041751", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054041767", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054041784", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054041799", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054042048", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054045420", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00001|bfd(handler113)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054045447", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00002|bfd(handler113)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789192054045464", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054045488", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " flags: none" + }, + { + "at": "1789192054045507", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " my_disc:0xe25c7ef1 your_disc:0x0" + }, + { + "at": "1789192054045523", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054045542", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054045558", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054045580", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054045597", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054045613", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054045628", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054045645", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435909ms" + }, + { + "at": "1789192054045663", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +917ms" + }, + { + "at": "1789192054045679", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789192054045696", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054045711", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054045730", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054045745", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192054045759", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054045775", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054045792", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054045805", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: down" + }, + { + "at": "1789192054045823", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054045838", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054045854", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054045870", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054045888", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054045902", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00003|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054045928", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054045942", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054045958", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054045973", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054045988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054046003", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054046023", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +917ms" + }, + { + "at": "1789192054046037", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789192054046052", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054046067", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054046082", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046097", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192054046111", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046126", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054046146", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054046160", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: down" + }, + { + "at": "1789192054046176", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046191", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054046206", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046224", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054046237", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054046253", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00113|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054046270", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054046284", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054046299", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054046314", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054046329", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054046349", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435909ms" + }, + { + "at": "1789192054046364", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now -1555435909ms" + }, + { + "at": "1789192054046382", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -1555435909ms" + }, + { + "at": "1789192054046399", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054046414", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054046429", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046445", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x44c454d1" + }, + { + "at": "1789192054046462", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046477", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046492", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054046507", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054046523", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046537", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054046552", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054046568", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046583", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054046605", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00114|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054046625", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054046639", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054046655", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054046670", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054046684", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054046698", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435909ms" + }, + { + "at": "1789192054046711", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now -1555435909ms" + }, + { + "at": "1789192054046726", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -1555435909ms" + }, + { + "at": "1789192054046741", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054046756", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054046771", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046784", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054046802", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046815", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046830", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054046845", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054046860", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046875", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054046890", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054046905", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046925", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054147715", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00004|bfd(handler113)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054147821", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00005|bfd(handler113)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789192054147848", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054147868", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " flags: none" + }, + { + "at": "1789192054147883", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " my_disc:0xdc50ac8c your_disc:0x59c6c3e" + }, + { + "at": "1789192054147899", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054147924", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054147940", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054147955", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054147972", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054147988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054147999", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054148015", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555436011ms" + }, + { + "at": "1789192054148027", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789192054148039", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789192054148051", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054148061", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054148073", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148088", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054148104", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148118", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148134", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054148149", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054148164", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148178", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054148213", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054148227", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148242", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054148256", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00006|bfd(handler113)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054148273", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054148288", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054148302", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054148317", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054148331", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054148344", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054148360", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789192054148374", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789192054148387", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054148401", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054148415", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148430", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054148443", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148458", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148472", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054148489", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054148503", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148518", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054148533", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148547", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148561", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054148574", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00007|bfd(handler113)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054148597", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00008|bfd(handler113)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789192054148612", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054148630", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " flags: none" + }, + { + "at": "1789192054148645", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " my_disc:0x83f7dd28 your_disc:0x44c454d1" + }, + { + "at": "1789192054148665", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054148679", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054148694", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054148707", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054148721", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054148735", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054148749", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054148763", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555436012ms" + }, + { + "at": "1789192054148778", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +825ms" + }, + { + "at": "1789192054148793", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789192054148808", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054148821", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054148834", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148850", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x44c454d1" + }, + { + "at": "1789192054148866", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148880", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148893", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054148906", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054148925", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148939", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054148955", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054148970", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148983", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054148997", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00009|bfd(handler113)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054149013", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054149029", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054149043", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054149057", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054149071", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054149084", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054149097", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +825ms" + }, + { + "at": "1789192054149114", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789192054149128", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054149143", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054149157", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054149170", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x44c454d1" + }, + { + "at": "1789192054149182", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054149198", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054149212", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054149229", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054149245", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054149259", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054149273", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054149288", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054149304", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055006585", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00010|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055006855", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192055006869", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055006880", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055006893", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055006902", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055006920", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055006935", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +726ms" + }, + { + "at": "1789192055006954", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -44ms" + }, + { + "at": "1789192055006969", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192055006982", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: init" + }, + { + "at": "1789192055006997", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055007007", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192055007018", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055007030", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055007041", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192055007051", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: up" + }, + { + "at": "1789192055007064", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055007075", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192055007085", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055007094", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055007105", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192063844708", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00115|connmgr|INFO|br-int<->unix#7: 779 flow_mods in the 2 s starting 10 s ago (719 adds, 59 deletes, 1 modifications)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-teardown.txt new file mode 100644 index 0000000..e6967ca --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-after-teardown.txt @@ -0,0 +1,222 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:48:93:53 STALE +=== gateway neigh exit=0 === +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192416659910", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02158|poll_loop|INFO|Dropped 12426 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192416659993", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192417139653", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02160|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192417174106", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02161|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192417593502", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02162|bridge|INFO|bridge br-int: deleted interface vethcc4bbe23 on port 15" + }, + { + "at": "1789192418140011", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02163|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192418140128", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192419139537", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02165|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192419139731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02166|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192419564686", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02167|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789192419564821", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02168|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789192419583398", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02169|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789192419583481", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192419560100", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00115|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789192419560380", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00116|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192419560635", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00117|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789192419578194", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00118|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 10" + }, + { + "at": "1789192419578235", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192418582244", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00120|bridge|INFO|bridge br-int: deleted interface veth09ee9212 on port 13" + }, + { + "at": "1789192419562888", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00121|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789192419563016", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00122|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192419563049", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00123|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789192419583406", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00124|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192419583570", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192419572538", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00119|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789192419572753", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00120|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192419572772", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00121|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789192419600629", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00002|ofproto_dpif_monitor(monitor129)|INFO|monitor thread terminated" + }, + { + "at": "1789192419603517", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00122|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-before-probe.txt new file mode 100644 index 0000000..71be711 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/diagnostics-before-probe.txt @@ -0,0 +1,6607 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab02 + - lab03 + - nas01 + - lab01 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b4:b0:c4 | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:0a:69:79 | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++--------------------------------------------+----------------+---------+----------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch d3e72649-17ff-459c-b7a5-ac3497645dfa (incus-net24-ls-int) + port incus-net24-ls-int-lsp-router + type: router + router-port: incus-net24-lr-lrp-int + port incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0 + addresses: ["10:66:6a:b4:b0:c4 dynamic"] + port incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0 + addresses: ["10:66:6a:0a:69:79 dynamic"] +switch 3711f4b7-04cc-4a50-80e6-dd4713723bf8 (incus-net24-ls-ext) + port incus-net24-ls-ext-lsp-router + type: router + router-port: incus-net24-lr-lrp-ext + port incus-net24-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router a7e9d484-ab5b-4809-8eea-f7035fb486c4 (incus-net24-lr) + port incus-net24-lr-lrp-int + mac: "10:66:6a:49:f5:82" + ipv6-lla: "fe80::1266:6aff:fe49:f582" + networks: ["10.253.73.1/24"] + port incus-net24-lr-lrp-ext + mac: "10:66:6a:49:f5:82" + ipv6-lla: "fe80::1266:6aff:fe49:f582" + networks: ["10.10.40.64/24"] + nat 2f5b47a8-33cc-41f5-b743-b9d026e64b34 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net24-instance-fd6c2444-0871-4d38-bbdb-195646066e68-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net24-lr-lrp-ext + Port_Binding incus-net24-instance-cebae4d4-a24c-478a-8c68-53061fa95b35-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 0e9dad28-87db-4c24-9f59-c170e37d6cca +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:49:f5:82" +name : incus-net24-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 5dfb7a6b-c283-4425-9059-ba708a6c15d5 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 6368b1fa-61f8-4094-9df3-69389416a25d +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:49:f5:82" +name : incus-net24-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 743a5cc5-a6a4-41f1-9cf3-dfc9540a6cd4 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 9f3766c9-6182-4567-a72a-4a0cef0dc8db +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f02842e8-3f33-43a1-be58-a61efa64b253 +logical_port : cr-incus-net24-lr-lrp-ext +mac : ["10:66:6a:49:f5:82 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net24-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:48:93:53 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 INCOMPLETE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192054041880", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01268|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054042040", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01269|bridge|INFO|bridge incusovn16: using datapath ID 0000261ad7c9334d" + }, + { + "at": "1789192054042059", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01270|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054043803", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01271|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054043869", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054043896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054043909", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054043938", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043949", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043963", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054043976", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054043996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044029", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054044039", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044057", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054044093", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044104", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044121", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044140", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044150", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044162", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044185", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044206", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01272|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044233", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054044244", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044256", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044279", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044290", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044301", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054044311", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054044320", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044336", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054044354", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044371", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044380", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054044429", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044443", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044453", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044463", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044475", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044489", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044503", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044512", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044537", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044550", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01273|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044577", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054044597", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044610", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044622", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044631", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044646", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054044658", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054044671", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054044684", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044701", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054044710", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044729", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044741", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054044756", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044765", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044793", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044802", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044813", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044824", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044833", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044844", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054139872", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01274|dpif|WARN|Dropped 873 log messages in last 10015 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192054139987", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054140034", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01276|bridge|WARN|Dropped 11077 log messages in last 10020 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192054140071", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01277|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054140111", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054140137", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01279|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054140429", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00001|bfd(handler101)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054140562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00002|bfd(handler101)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054140601", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054140639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " flags: none" + }, + { + "at": "1789192054140672", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " my_disc:0x59c6c3e your_disc:0x0" + }, + { + "at": "1789192054140716", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054140744", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054140771", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054140798", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054140832", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054140860", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054140887", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054140921", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332140ms" + }, + { + "at": "1789192054140953", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332140ms" + }, + { + "at": "1789192054140981", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332140ms" + }, + { + "at": "1789192054141337", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054141453", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054141678", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141718", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054141761", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054141791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141821", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054141846", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054141874", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141902", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054141952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054141980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054142019", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054142046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00003|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054142083", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054142117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054142153", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054142179", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054142215", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054142251", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054142278", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now -1506332140ms" + }, + { + "at": "1789192054142305", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -1506332140ms" + }, + { + "at": "1789192054142334", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054142361", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054142386", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054142412", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054142444", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054142471", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054142514", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054142541", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054142573", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054142602", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054142629", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054142669", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054142706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054142743", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054142779", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01281|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054142809", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00004|bfd(handler101)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054142859", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00005|bfd(handler101)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789192054142897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054142924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " flags: none" + }, + { + "at": "1789192054142952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " my_disc:0x8755ef1c your_disc:0x0" + }, + { + "at": "1789192054142995", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054143024", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054143049", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054143081", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054143117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054143145", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054143169", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054143202", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332142ms" + }, + { + "at": "1789192054143230", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789192054143260", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054143289", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054143323", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054143349", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054143375", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054143412", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054143435", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054143462", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054143504", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054143531", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054143557", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054143596", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054143625", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054143659", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054143685", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00006|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054143711", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054143740", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054143775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054143801", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054143828", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054143858", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054143890", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789192054143921", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054143956", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054143984", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054144007", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054144040", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054144071", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054144105", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054144141", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054144168", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054144199", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054144225", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054144260", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054144334", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054144369", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054144404", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054144439", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01283|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054144478", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054144518", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01285|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054145464", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00007|bfd(handler101)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054145552", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00008|bfd(handler101)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789192054145590", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054145622", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " flags: none" + }, + { + "at": "1789192054145649", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " my_disc:0x720ec121 your_disc:0x0" + }, + { + "at": "1789192054145683", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054145710", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054145745", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054145771", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054145796", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054145827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054145853", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054145879", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now -1506332145ms" + }, + { + "at": "1789192054145905", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +659ms" + }, + { + "at": "1789192054145941", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -101ms" + }, + { + "at": "1789192054145981", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054146008", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054146033", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146056", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054146085", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054146116", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054146171", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054146198", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146235", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x720ec121" + }, + { + "at": "1789192054146272", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054146303", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146330", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054146365", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00009|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054146402", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054146428", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054146454", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054146477", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054146511", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054146538", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054146562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +659ms" + }, + { + "at": "1789192054146586", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -101ms" + }, + { + "at": "1789192054146612", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054146635", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: down" + }, + { + "at": "1789192054146667", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146693", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054146719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054146747", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146773", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054146799", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: down" + }, + { + "at": "1789192054146834", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054146860", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x720ec121" + }, + { + "at": "1789192054146885", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054146911", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054146936", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054149248", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01286|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789192054149336", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789192054985637", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00010|bfd(handler101)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054985750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192054985765", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054985777", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054985799", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054985812", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054985826", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054985841", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +758ms" + }, + { + "at": "1789192054985869", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -182ms" + }, + { + "at": "1789192054985897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192054985908", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: init" + }, + { + "at": "1789192054985934", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054985950", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054985968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054985984", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054985995", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192054986007", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: up" + }, + { + "at": "1789192054986020", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054986031", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x720ec121" + }, + { + "at": "1789192054986044", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192054986058", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054986073", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055010868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00011|bfd(handler101)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055010956", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192055010973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055010983", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055010998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055011015", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055011025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055011035", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +903ms" + }, + { + "at": "1789192055011060", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -57ms" + }, + { + "at": "1789192055011075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192055011086", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: init" + }, + { + "at": "1789192055011101", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055011112", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192055011121", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055011138", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055011153", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192055011173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: up" + }, + { + "at": "1789192055011184", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055011193", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x59c6c3e" + }, + { + "at": "1789192055011204", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055011219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055011228", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055139591", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01288|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192055139783", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01289|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192055433403", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01290|bridge|INFO|bridge br-int: added interface vethcc4bbe23 on port 15" + }, + { + "at": "1789192055693022", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|00012|bfd(handler101)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055693116", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Forwarding: false" + }, + { + "at": "1789192055693142", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055693157", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055693175", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055693191", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055693206", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055693226", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Next TX Time: now +181ms" + }, + { + "at": "1789192055693251", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Last TX Time: now -749ms" + }, + { + "at": "1789192055693274", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Flags: none" + }, + { + "at": "1789192055693289", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Session State: init" + }, + { + "at": "1789192055693302", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055693317", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192055693328", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055693337", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055693352", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Flags: none" + }, + { + "at": "1789192055693369", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Session State: up" + }, + { + "at": "1789192055693385", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055693398", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Discriminator: 0x8755ef1c" + }, + { + "at": "1789192055693414", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055693430", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055693444", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192056139719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01291|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192056140037", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192056659985", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01293|poll_loop|INFO|Dropped 6392 log messages in last 10019 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192056660083", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056660479", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01295|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056660965", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01296|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056661437", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01297|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056661909", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01298|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056662393", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01299|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056662874", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056663345", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01301|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056663873", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01302|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192056664372", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01303|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (82% CPU usage)" + }, + { + "at": "1789192057139757", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01304|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192057139975", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01305|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192058139539", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01306|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192058139649", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192059139897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01308|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192059140101", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01309|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192060139964", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01310|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192060140159", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192061139626", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01312|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192061139760", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01313|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192062139733", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01314|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192062139959", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01315|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192062659949", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01316|poll_loop|INFO|Dropped 12263 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192062660056", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01317|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192063139973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01318|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192063140159", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|01319|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192054036312", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00101|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054036457", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00102|bridge|INFO|bridge incusovn16: using datapath ID 0000123ddc1aa34d" + }, + { + "at": "1789192054036472", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00103|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054037354", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00104|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054037402", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054037426", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054037441", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054037451", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054037463", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054037475", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309036ms" + }, + { + "at": "1789192054037488", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -1555309036ms" + }, + { + "at": "1789192054037500", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -1555309036ms" + }, + { + "at": "1789192054037511", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054037525", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054037536", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054037548", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054037559", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054037571", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054037583", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054037595", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054037605", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054037616", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054037628", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054037639", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054037651", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054037662", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054044045", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00105|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044092", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054044105", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044120", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044131", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044142", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044151", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309043ms" + }, + { + "at": "1789192054044165", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -1555309043ms" + }, + { + "at": "1789192054044177", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -1555309043ms" + }, + { + "at": "1789192054044187", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054044199", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044208", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044219", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xfc85e91" + }, + { + "at": "1789192054044229", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044242", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044253", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044262", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044271", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044283", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044294", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044303", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044314", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044325", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00106|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044336", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054044347", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044356", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044368", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044377", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044386", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309043ms" + }, + { + "at": "1789192054044399", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -1555309043ms" + }, + { + "at": "1789192054044412", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -1555309043ms" + }, + { + "at": "1789192054044421", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054044431", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044441", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044451", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054044461", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044471", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044481", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044490", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044500", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044509", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044528", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044538", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054133109", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00107|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789192054133200", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00108|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789192054140549", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00109|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192054140624", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00110|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 10" + }, + { + "at": "1789192054930921", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00001|bfd(handler105)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054931063", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00002|bfd(handler105)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789192054931094", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054931131", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " flags: none" + }, + { + "at": "1789192054931153", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " my_disc:0xa98f3f1e your_disc:0xfc85e91" + }, + { + "at": "1789192054931177", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054931199", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054931227", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054931249", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054931272", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054931294", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054931316", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054931346", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309930ms" + }, + { + "at": "1789192054931369", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +767ms" + }, + { + "at": "1789192054931402", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -33ms" + }, + { + "at": "1789192054931429", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054931454", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054931484", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054931509", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xfc85e91" + }, + { + "at": "1789192054931534", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054931559", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054931585", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054931609", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054931631", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054931653", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054931676", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054931698", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054931726", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054931747", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00003|bfd(handler105)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054931770", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054931791", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054931812", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054931832", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054931858", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054931879", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054931904", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +767ms" + }, + { + "at": "1789192054931926", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -33ms" + }, + { + "at": "1789192054932008", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054932036", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054932056", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054932077", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xfc85e91" + }, + { + "at": "1789192054932095", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054932118", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054932138", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054932159", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054932180", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054932200", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054932219", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054932243", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054932264", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054939271", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00004|bfd(handler105)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054939315", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00005|bfd(handler105)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789192054939329", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054939339", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " flags: none" + }, + { + "at": "1789192054939349", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " my_disc:0xca374396 your_disc:0x8755ef1c" + }, + { + "at": "1789192054939360", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054939370", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054939381", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054939390", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054939410", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054939421", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054939430", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054939439", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309938ms" + }, + { + "at": "1789192054939449", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +749ms" + }, + { + "at": "1789192054939459", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -41ms" + }, + { + "at": "1789192054939472", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054939483", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054939493", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939503", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054939513", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054939523", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939535", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054939544", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054939554", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939564", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xca374396" + }, + { + "at": "1789192054939576", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054939585", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939597", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054939607", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00006|bfd(handler105)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054939617", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054939627", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054939635", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054939645", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054939655", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054939664", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054939673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now +749ms" + }, + { + "at": "1789192054939688", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -41ms" + }, + { + "at": "1789192054939697", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054939707", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054939716", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939727", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0x8755ef1c" + }, + { + "at": "1789192054939736", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054939747", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939757", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054939767", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054939776", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054939785", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0xca374396" + }, + { + "at": "1789192054939793", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054939804", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054939813", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054955400", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00007|bfd(handler105)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054955440", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00008|bfd(handler105)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054955454", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054955465", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " flags: none" + }, + { + "at": "1789192054955477", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " my_disc:0x704f5285 your_disc:0xe25c7ef1" + }, + { + "at": "1789192054955489", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054955499", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054955509", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054955518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054955528", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054955539", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054955548", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054955558", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now -1555309954ms" + }, + { + "at": "1789192054955569", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -138ms" + }, + { + "at": "1789192054955580", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -918ms" + }, + { + "at": "1789192054955598", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054955609", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054955618", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955628", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054955640", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054955649", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955662", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054955673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054955682", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955692", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x704f5285" + }, + { + "at": "1789192054955702", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054955711", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955720", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054955730", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00009|bfd(handler105)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054955743", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Forwarding: false" + }, + { + "at": "1789192054955752", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054955765", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054955776", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054955786", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054955796", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054955806", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Next TX Time: now -138ms" + }, + { + "at": "1789192054955816", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Last TX Time: now -918ms" + }, + { + "at": "1789192054955831", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Flags: none" + }, + { + "at": "1789192054955840", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Session State: down" + }, + { + "at": "1789192054955848", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955859", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054955869", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054955879", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955888", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Flags: none" + }, + { + "at": "1789192054955898", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Session State: init" + }, + { + "at": "1789192054955907", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054955917", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Discriminator: 0x704f5285" + }, + { + "at": "1789192054955927", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054955937", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054955945", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192064039198", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00111|connmgr|INFO|br-int<->unix#7: 774 flow_mods in the 2 s starting 10 s ago (713 adds, 53 deletes, 8 modifications)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192054040695", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054040886", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 0000064dfba3f74b" + }, + { + "at": "1789192054040910", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00107|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054042644", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00108|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054042695", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054042714", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054042728", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054042742", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054042754", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054042767", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209040ms" + }, + { + "at": "1789192054042778", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209040ms" + }, + { + "at": "1789192054042789", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209040ms" + }, + { + "at": "1789192054042801", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054042813", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054042825", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054042837", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054042849", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054042861", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054042871", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054042883", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054042894", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054042906", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054042916", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054042930", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054042942", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054042953", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00109|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054042965", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054042976", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054042985", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054042997", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043009", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043019", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209040ms" + }, + { + "at": "1789192054043030", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054043042", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209040ms" + }, + { + "at": "1789192054043053", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209040ms" + }, + { + "at": "1789192054043068", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054043079", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054043090", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043102", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054043113", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054043124", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043138", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054043149", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054043159", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043168", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054043178", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054043188", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054043207", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00110|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054043219", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054043231", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054043242", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054043251", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043262", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043273", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209040ms" + }, + { + "at": "1789192054043283", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209040ms" + }, + { + "at": "1789192054043292", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209040ms" + }, + { + "at": "1789192054043308", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054043318", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054043330", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043343", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x720ec121" + }, + { + "at": "1789192054043356", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054043366", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043376", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054043386", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054043395", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054043406", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054043416", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054043430", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054043439", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054137204", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00111|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789192054137253", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00112|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789192054138105", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00001|bfd(handler102)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054138169", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00002|bfd(handler102)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054138210", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054138248", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " flags: none" + }, + { + "at": "1789192054138274", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " my_disc:0x44c454d1 your_disc:0x0" + }, + { + "at": "1789192054138301", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054138328", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054138352", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054138376", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054138400", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054138425", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054138449", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054138475", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209135ms" + }, + { + "at": "1789192054138500", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209135ms" + }, + { + "at": "1789192054138525", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209135ms" + }, + { + "at": "1789192054138555", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054138579", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054138608", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054138632", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054138660", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054138684", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054138709", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054138733", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054138766", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054138792", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x44c454d1" + }, + { + "at": "1789192054138821", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054138845", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054138871", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054138897", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00003|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054138926", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054138962", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054138988", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054139012", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054139036", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054139070", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054139103", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now -14209135ms" + }, + { + "at": "1789192054139128", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -14209135ms" + }, + { + "at": "1789192054139151", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054139175", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054139198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054139228", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054139255", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054139278", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054139301", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054139326", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054139348", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054139375", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x44c454d1" + }, + { + "at": "1789192054139399", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054139423", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054139447", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054140365", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00004|bfd(handler102)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054140434", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00005|bfd(handler102)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789192054140467", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054140493", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " flags: none" + }, + { + "at": "1789192054140520", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " my_disc:0xfc85e91 your_disc:0x0" + }, + { + "at": "1789192054140546", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054140571", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054140595", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054140618", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054140641", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054140665", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054140688", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054140711", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209138ms" + }, + { + "at": "1789192054140741", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +792ms" + }, + { + "at": "1789192054140766", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054140789", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054140812", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054140836", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054140859", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054140883", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054140906", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054140929", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054140954", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054140985", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141010", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0xfc85e91" + }, + { + "at": "1789192054141036", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054141068", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141093", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054141116", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00006|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054141140", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054141169", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054141193", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054141217", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054141238", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054141261", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054141284", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +792ms" + }, + { + "at": "1789192054141305", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789192054141328", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054141350", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054141373", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141395", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192054141415", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054141439", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141463", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054141487", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: down" + }, + { + "at": "1789192054141513", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054141548", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0xfc85e91" + }, + { + "at": "1789192054141572", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054141595", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054141620", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054143660", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00113|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192054143739", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00114|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192054802666", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00007|bfd(handler102)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054802764", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00008|bfd(handler102)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789192054802797", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054802829", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " flags: none" + }, + { + "at": "1789192054802852", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " my_disc:0x6af7c434 your_disc:0x720ec121" + }, + { + "at": "1789192054802880", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054802902", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054802930", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054802956", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054802977", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054803004", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054803034", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054803071", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now -14209800ms" + }, + { + "at": "1789192054803094", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +180ms" + }, + { + "at": "1789192054803127", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789192054803153", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054803176", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054803200", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803224", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x720ec121" + }, + { + "at": "1789192054803247", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054803273", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054803298", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054803321", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: init" + }, + { + "at": "1789192054803346", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803370", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x6af7c434" + }, + { + "at": "1789192054803397", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054803424", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054803456", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054803486", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00009|bfd(handler102)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054803515", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054803537", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054803560", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054803583", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054803607", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054803628", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054803654", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +180ms" + }, + { + "at": "1789192054803677", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789192054803704", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054803726", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: down" + }, + { + "at": "1789192054803756", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803788", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x720ec121" + }, + { + "at": "1789192054803820", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054803844", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054803865", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054803888", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: init" + }, + { + "at": "1789192054803909", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054803933", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x6af7c434" + }, + { + "at": "1789192054803954", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054803975", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054804000", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054968413", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00010|bfd(handler102)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054968506", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192054968544", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054968569", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054968595", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054968618", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054968643", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054968670", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +154ms" + }, + { + "at": "1789192054968699", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -826ms" + }, + { + "at": "1789192054968723", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192054968747", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: init" + }, + { + "at": "1789192054968779", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054968805", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054968831", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054968864", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054968912", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192054968938", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: up" + }, + { + "at": "1789192054968965", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054968992", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0x44c454d1" + }, + { + "at": "1789192054969022", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192054969047", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054969089", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055870269", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00011|bfd(handler102)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055870491", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Forwarding: false" + }, + { + "at": "1789192055870536", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055870549", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055870563", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055870576", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055870588", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055870603", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Next TX Time: now +32ms" + }, + { + "at": "1789192055870615", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Last TX Time: now -938ms" + }, + { + "at": "1789192055870629", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Flags: none" + }, + { + "at": "1789192055870641", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Session State: init" + }, + { + "at": "1789192055870653", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055870664", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Discriminator: 0xa98f3f1e" + }, + { + "at": "1789192055870676", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055870688", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055870700", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Flags: none" + }, + { + "at": "1789192055870711", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Session State: up" + }, + { + "at": "1789192055870722", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055870734", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Discriminator: 0xfc85e91" + }, + { + "at": "1789192055870746", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055870756", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055870768", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192056231826", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00115|bridge|INFO|bridge br-int: added interface veth09ee9212 on port 13" + }, + { + "at": "1789192064044855", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00116|connmgr|INFO|br-int<->unix#7: 741 flow_mods in the 2 s starting 10 s ago (703 adds, 31 deletes, 7 modifications)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192053840918", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00105|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192053841205", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00106|bridge|INFO|bridge incusovn16: using datapath ID 00009a00fdbf174f" + }, + { + "at": "1789192053841229", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00107|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192053939039", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00108|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789192053939158", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00109|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789192053943960", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00110|bridge|INFO|bridge incusovn16: added interface patch-incus-net24-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192053944010", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00111|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net24-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192054041410", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00112|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054041464", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054041489", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054041508", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054041523", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054041540", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054041564", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435905ms" + }, + { + "at": "1789192054041583", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now -1555435905ms" + }, + { + "at": "1789192054041598", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -1555435905ms" + }, + { + "at": "1789192054041614", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054041631", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054041646", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054041660", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192054041675", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054041689", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054041705", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054041720", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054041735", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054041751", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054041767", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054041784", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054041799", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054042048", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054045420", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00001|bfd(handler113)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054045447", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00002|bfd(handler113)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789192054045464", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054045488", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " flags: none" + }, + { + "at": "1789192054045507", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " my_disc:0xe25c7ef1 your_disc:0x0" + }, + { + "at": "1789192054045523", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054045542", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054045558", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054045580", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054045597", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054045613", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054045628", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054045645", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435909ms" + }, + { + "at": "1789192054045663", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +917ms" + }, + { + "at": "1789192054045679", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789192054045696", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054045711", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054045730", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054045745", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192054045759", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054045775", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054045792", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054045805", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: down" + }, + { + "at": "1789192054045823", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054045838", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054045854", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054045870", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054045888", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054045902", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00003|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054045928", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054045942", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054045958", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054045973", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054045988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054046003", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054046023", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +917ms" + }, + { + "at": "1789192054046037", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789192054046052", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054046067", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054046082", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046097", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192054046111", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046126", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054046146", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054046160", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: down" + }, + { + "at": "1789192054046176", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046191", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192054046206", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046224", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054046237", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054046253", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00113|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054046270", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054046284", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054046299", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054046314", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054046329", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054046349", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435909ms" + }, + { + "at": "1789192054046364", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now -1555435909ms" + }, + { + "at": "1789192054046382", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -1555435909ms" + }, + { + "at": "1789192054046399", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054046414", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054046429", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046445", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x44c454d1" + }, + { + "at": "1789192054046462", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046477", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046492", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054046507", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054046523", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046537", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054046552", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054046568", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046583", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054046605", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00114|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054046625", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054046639", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054046655", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054046670", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054046684", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054046698", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555435909ms" + }, + { + "at": "1789192054046711", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now -1555435909ms" + }, + { + "at": "1789192054046726", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -1555435909ms" + }, + { + "at": "1789192054046741", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054046756", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054046771", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046784", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054046802", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054046815", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046830", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054046845", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054046860", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054046875", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054046890", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054046905", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054046925", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054147715", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00004|bfd(handler113)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054147821", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00005|bfd(handler113)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789192054147848", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054147868", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " flags: none" + }, + { + "at": "1789192054147883", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " my_disc:0xdc50ac8c your_disc:0x59c6c3e" + }, + { + "at": "1789192054147899", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054147924", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054147940", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054147955", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054147972", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054147988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054147999", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054148015", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555436011ms" + }, + { + "at": "1789192054148027", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789192054148039", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789192054148051", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054148061", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054148073", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148088", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054148104", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148118", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148134", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054148149", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054148164", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148178", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054148213", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054148227", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148242", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054148256", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00006|bfd(handler113)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054148273", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054148288", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054148302", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054148317", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054148331", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054148344", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054148360", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789192054148374", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789192054148387", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054148401", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054148415", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148430", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x59c6c3e" + }, + { + "at": "1789192054148443", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148458", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148472", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054148489", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054148503", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148518", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054148533", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148547", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148561", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054148574", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00007|bfd(handler113)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054148597", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00008|bfd(handler113)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789192054148612", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789192054148630", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " flags: none" + }, + { + "at": "1789192054148645", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " my_disc:0x83f7dd28 your_disc:0x44c454d1" + }, + { + "at": "1789192054148665", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054148679", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789192054148694", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789192054148707", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054148721", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054148735", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054148749", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054148763", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now -1555436012ms" + }, + { + "at": "1789192054148778", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +825ms" + }, + { + "at": "1789192054148793", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789192054148808", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054148821", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054148834", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148850", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x44c454d1" + }, + { + "at": "1789192054148866", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054148880", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148893", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054148906", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054148925", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054148939", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054148955", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054148970", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054148983", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192054148997", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00009|bfd(handler113)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054149013", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192054149029", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054149043", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054149057", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054149071", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192054149084", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192054149097", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +825ms" + }, + { + "at": "1789192054149114", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789192054149128", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192054149143", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: down" + }, + { + "at": "1789192054149157", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054149170", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x44c454d1" + }, + { + "at": "1789192054149182", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054149198", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054149212", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192054149229", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: init" + }, + { + "at": "1789192054149245", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054149259", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0x83f7dd28" + }, + { + "at": "1789192054149273", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054149288", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192054149304", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192055006585", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00010|bfd(handler113)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192055006855", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Forwarding: false" + }, + { + "at": "1789192055006869", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192055006880", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192055006893", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192055006902", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789192055006920", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789192055006935", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Next TX Time: now +726ms" + }, + { + "at": "1789192055006954", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Last TX Time: now -44ms" + }, + { + "at": "1789192055006969", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Flags: none" + }, + { + "at": "1789192055006982", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Session State: init" + }, + { + "at": "1789192055006997", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192055007007", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Discriminator: 0x704f5285" + }, + { + "at": "1789192055007018", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192055007030", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055007041", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Flags: none" + }, + { + "at": "1789192055007051", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Session State: up" + }, + { + "at": "1789192055007064", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192055007075", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Discriminator: 0xe25c7ef1" + }, + { + "at": "1789192055007085", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789192055007094", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789192055007105", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789192063844708", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00115|connmgr|INFO|br-int<->unix#7: 779 flow_mods in the 2 s starting 10 s ago (719 adds, 59 deletes, 1 modifications)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/fallback-checks.json b/spikes/ovn/diagnosis-2026-09-12/clean-1/fallback-checks.json new file mode 100644 index 0000000..453cb45 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/fallback-checks.json @@ -0,0 +1,66 @@ +[ + { + "guest": "one", + "check": "cross-member-ping", + "command": "ping -c 3 -W 2 10.253.73.3", + "exit_code": 0, + "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=0.315 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.699 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.466 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.315/0.493/0.699 ms\n", + "stderr": "" + }, + { + "guest": "one", + "check": "gateway-ping", + "command": "ping -c 3 -W 2 10.10.40.1", + "exit_code": 1, + "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", + "stderr": "" + }, + { + "guest": "one", + "check": "dns", + "command": "nslookup example.com 10.10.40.1", + "exit_code": 1, + "stdout": ";; connection timed out; no servers could be reached\n\n", + "stderr": "" + }, + { + "guest": "one", + "check": "wget", + "command": "wget -T 15 -qO /dev/null https://example.com", + "exit_code": 1, + "stdout": "", + "stderr": "wget: bad address 'example.com'\n" + }, + { + "guest": "two", + "check": "cross-member-ping", + "command": "ping -c 3 -W 2 10.253.73.2", + "exit_code": 0, + "stdout": "PING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.029 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.503 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.379 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.379/0.637/1.029 ms\n", + "stderr": "" + }, + { + "guest": "two", + "check": "gateway-ping", + "command": "ping -c 3 -W 2 10.10.40.1", + "exit_code": 1, + "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", + "stderr": "" + }, + { + "guest": "two", + "check": "dns", + "command": "nslookup example.com 10.10.40.1", + "exit_code": 1, + "stdout": ";; connection timed out; no servers could be reached\n\n", + "stderr": "" + }, + { + "guest": "two", + "check": "wget", + "command": "wget -T 15 -qO /dev/null https://example.com", + "exit_code": 1, + "stdout": "", + "stderr": "wget: bad address 'example.com'\n" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.debug.log new file mode 100644 index 0000000..d6d2bbf --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-11T22:47:32-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.log new file mode 100644 index 0000000..96afad8 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-create.log @@ -0,0 +1,355 @@ +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Event listener server handler started" id=96fa3ed0-ec4e-4e4c-a8e4-14703e00328e local="10.10.10.14:8443" remote="100.122.142.76:60503" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60504" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60505" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60506" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60507" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60510" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60511" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60512" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60513" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60516" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60517" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:49:f5:82" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.24 +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:47:33Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net24 driver=ovn memberID=1 network=default priority=13217 project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60520" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60521" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60522" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60523" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60524" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60525" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60526" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60527" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60529" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Event listener server handler started" id=8fbab649-e41b-4998-9fea-f38fc209a7ea local="10.10.10.14:8443" remote="100.122.142.76:60529" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60530" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=3c50475c-9db5-4e0e-8e44-371351a775dd project=image-build +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=3c50475c-9db5-4e0e-8e44-371351a775dd project=image-build +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60531" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Event listener server handler started" id=1ea35a1e-9461-483c-9400-a847b618c909 local="10.10.10.14:8443" remote="100.122.142.76:60531" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60532" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=d8f00e86-574e-401c-aa32-fd3ff315afc9 project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=d8f00e86-574e-401c-aa32-fd3ff315afc9 project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60533" method=GET protocol=tls url="/1.0/operations/d8f00e86-574e-401c-aa32-fd3ff315afc9?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=d8f00e86-574e-401c-aa32-fd3ff315afc9 project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=d8f00e86-574e-401c-aa32-fd3ff315afc9 project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Event listener server handler stopped" listener=1ea35a1e-9461-483c-9400-a847b618c909 local="10.10.10.14:8443" remote="100.122.142.76:60531" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8fbab649-e41b-4998-9fea-f38fc209a7ea local="10.10.10.14:8443" remote="100.122.142.76:60529" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60534" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60535" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"7801d30c-5e48-45b3-916e-7aa5f14efe5b\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T05:47:34.925942485Z\",\n\t\t\"updated_at\": \"2026-09-12T05:47:34.925942485Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60536" method=GET protocol=tls url="/1.0/operations/7801d30c-5e48-45b3-916e-7aa5f14efe5b/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:34Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T05:47:34Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60537" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60538" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60539" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Event listener server handler started" id=3233de66-39d5-4117-9a81-7a2cdcc62611 local="10.10.10.14:8443" remote="100.122.142.76:60539" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60540" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:35Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 05:47:34.951754192 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60541" method=GET protocol=tls url="/1.0/operations/3cadc6f4-0fb7-4000-83ad-805331e9148a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:35Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 05:47:34.951754192 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Event listener server handler stopped" listener=3233de66-39d5-4117-9a81-7a2cdcc62611 local="10.10.10.14:8443" remote="100.122.142.76:60539" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60543" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60544" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"511f6649-85f6-4ca5-a9dc-0449b5f79bc8\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T05:47:35.693846785Z\",\n\t\t\"updated_at\": \"2026-09-12T05:47:35.693846785Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60545" method=GET protocol=tls url="/1.0/operations/511f6649-85f6-4ca5-a9dc-0449b5f79bc8/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:35Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T05:47:35Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60554" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60555" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60556" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Event listener server handler started" id=ec9785b4-65f0-43e0-ae8d-2ee6ac242ac2 local="10.10.10.14:8443" remote="100.122.142.76:60556" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60557" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 05:47:35.738752966 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60558" method=GET protocol=tls url="/1.0/operations/5c934a3a-f0ef-4e81-a113-f80a8a9e00b9?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:36Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 05:47:35.738752966 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ec9785b4-65f0-43e0-ae8d-2ee6ac242ac2 local="10.10.10.14:8443" remote="100.122.142.76:60556" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60559" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60560" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60565" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60566" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60567" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60568" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60569" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60570" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60571" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60572" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Event listener server handler started" id=95ae4fbe-fb3e-4257-a0bc-35dabc2a2801 local="10.10.10.14:8443" remote="100.122.142.76:60572" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60573" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60574" method=GET protocol=tls url="/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=58bb744d133cddde4d3aef101d21fd1a7f65877bb1bd19b7b8859361a8487790" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60574" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=58bb744d133cddde4d3aef101d21fd1a7f65877bb1bd19b7b8859361a8487790" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60575" method=GET protocol=tls url="/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=13dafb15cddd88fa5a4491971a2ecbf6427a761ca524d52c6bbd5c9fc3373035" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=13dafb15cddd88fa5a4491971a2ecbf6427a761ca524d52c6bbd5c9fc3373035" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60575" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60576" method=GET protocol=tls url="/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=c90eb77df4679f07a0c541f61c3ee97b5f57a99f51af885de24bd16f5da79493" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=c90eb77df4679f07a0c541f61c3ee97b5f57a99f51af885de24bd16f5da79493" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60576" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60577" method=GET protocol=tls url="/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=c76c1731a556f3af0c905cb4d60635125947bad9e6101f0d4e5ed1643c9141d3" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60577" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb/websocket?secret=c76c1731a556f3af0c905cb4d60635125947bad9e6101f0d4e5ed1643c9141d3" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60575" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60574" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60576" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60577" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60578" method=GET protocol=tls url="/1.0/operations/2acb90c4-67f0-40d5-9c13-d6181fc940eb?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Event listener server handler stopped" listener=95ae4fbe-fb3e-4257-a0bc-35dabc2a2801 local="10.10.10.14:8443" remote="100.122.142.76:60572" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60581" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60582" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Event listener server handler started" id=488b4407-eba0-4802-b204-bbc50fb793d0 local="10.10.10.14:8443" remote="100.122.142.76:60582" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"printf '%s\\\\n' 'https://dl-cdn.alpinelinux.org/alpine/v3.22/main' \\u003e /etc/apk/repositories\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60583" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60584" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60584" method=GET protocol=tls url="/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=fa4efb6b58088dd834c3c1f2b9e6c156c4ace353b7de74d49d486277053091e7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=fa4efb6b58088dd834c3c1f2b9e6c156c4ace353b7de74d49d486277053091e7" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60585" method=GET protocol=tls url="/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=f008035a741eda530c2a7f1d760ed78aea389d733066a715f0e733767866e0b8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60585" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=f008035a741eda530c2a7f1d760ed78aea389d733066a715f0e733767866e0b8" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60586" method=GET protocol=tls url="/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=1b31fdbabdf9eaec294dcb32e14d063a69911d5f08d9cd26c34460492b776557" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=1b31fdbabdf9eaec294dcb32e14d063a69911d5f08d9cd26c34460492b776557" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60586" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60587" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60587" method=GET protocol=tls url="/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=affa64117883823086364830d505686da256454a6325e7956a499684a24cb284" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1/websocket?secret=affa64117883823086364830d505686da256454a6325e7956a499684a24cb284" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.12:8443" target="100.122.142.76:60427" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60585" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60586" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60584" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60587" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.12:8443" target="100.122.142.76:60420" +time="2026-09-12T05:47:37Z" level=warning msg="[lab02] Failed to write close message" err="write vsock vm(4294967295):569676785->vm(912463262):8443: broken pipe" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.12:8443" target="100.122.142.76:60417" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.12:8443" target="100.122.142.76:60424" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Event listener server handler stopped" listener=692741bf-b038-445e-8223-ead02fcc6c4e local="10.10.10.14:8443" remote="100.122.142.76:60404" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60588" method=GET protocol=tls url="/1.0/operations/36d948af-c88d-46a1-963f-8e9ec6280db1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Event listener server handler stopped" listener=488b4407-eba0-4802-b204-bbc50fb793d0 local="10.10.10.14:8443" remote="100.122.142.76:60582" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60589" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60590" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Event listener server handler started" id=93aad0ad-94ca-419e-a533-54a31b023fc4 local="10.10.10.14:8443" remote="100.122.142.76:60590" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60591" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-cache curl busybox-extras\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60592" method=GET protocol=tls url="/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=0975fdb3f2020fd351869cae7331f7ac211c2b1b0afd56fd0e753aa7a82cf206" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60592" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=0975fdb3f2020fd351869cae7331f7ac211c2b1b0afd56fd0e753aa7a82cf206" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60593" method=GET protocol=tls url="/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=071eb841c009e5bb0b65d67dd7d96344beff2dc628a9c30b7840bb8dc263dbe7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60593" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=071eb841c009e5bb0b65d67dd7d96344beff2dc628a9c30b7840bb8dc263dbe7" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60594" method=GET protocol=tls url="/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=a405c58bddabd17b3ad03fc7c9c1e2632b52232104d84a17550cf62e729a770e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60594" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=a405c58bddabd17b3ad03fc7c9c1e2632b52232104d84a17550cf62e729a770e" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60595" method=GET protocol=tls url="/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=c3ab1fa5ecabcd6478d90d24c9c2e7d1a385328b44889f14308dfc4391ff9f6d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:60595" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4/websocket?secret=c3ab1fa5ecabcd6478d90d24c9c2e7d1a385328b44889f14308dfc4391ff9f6d" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60593" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:60596" method=GET protocol=tls url="/1.0/operations/019abcd7-f58a-4807-a07c-d0a8cb844ac4?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T05:47:38Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T05:47:41Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T05:47:41Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T05:47:41Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T05:47:41Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.168456841s +time="2026-09-12T05:47:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60594" +time="2026-09-12T05:47:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60592" +time="2026-09-12T05:47:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:60595" +time="2026-09-12T05:47:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=93aad0ad-94ca-419e-a533-54a31b023fc4 local="10.10.10.14:8443" remote="100.122.142.76:60590" diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.debug.log new file mode 100644 index 0000000..a310ad9 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-11T22:53:36-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.log new file mode 100644 index 0000000..679ce6b --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/monitor-delete.log @@ -0,0 +1,150 @@ +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Event listener server handler started" id=d5b83b65-7dac-427b-ab17-1bcec3db4fea local="10.10.10.14:8443" remote="100.122.142.76:61234" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61239" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61240" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61241" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61242" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T05:47:35.738752966Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T05:47:36.315904669Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T05:53:36Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T05:47:34.951754192Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T05:47:35.515237521Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61243" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61244" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Event listener server handler started" id=3d4fa3c2-37d4-4d6f-abff-847195f46e73 local="10.10.10.14:8443" remote="100.122.142.76:61245" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61245" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61246" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:37Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 05:47:34.951754192 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 05:47:35.515237521 +0000 UTC" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61247" method=GET protocol=tls url="/1.0/operations/a72ca8f4-7e77-439c-8531-6847e0a942aa?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61248" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:38Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 05:47:34.951754192 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 05:47:35.515237521 +0000 UTC" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61249" method=GET protocol=tls url="/1.0/operations/206ac2e0-c4cf-4c82-9f6b-9a4cb200f5c8?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 05:47:34.951754192 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 05:47:35.515237521 +0000 UTC" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Event listener server handler stopped" listener=3d4fa3c2-37d4-4d6f-abff-847195f46e73 local="10.10.10.14:8443" remote="100.122.142.76:61245" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61250" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61251" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61252" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Event listener server handler started" id=f47b8ccd-dbbf-400a-905d-0d8b8e39761a local="10.10.10.14:8443" remote="100.122.142.76:61252" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61253" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:38Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 05:47:35.738752966 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 05:47:36.315904669 +0000 UTC" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61254" method=GET protocol=tls url="/1.0/operations/775cc09c-333d-454d-a032-741b627139aa?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61255" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 05:47:35.738752966 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 05:47:36.315904669 +0000 UTC" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61256" method=GET protocol=tls url="/1.0/operations/bd01889f-591d-4214-9da0-374457649361?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 05:47:35.738752966 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 05:47:36.315904669 +0000 UTC" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=f47b8ccd-dbbf-400a-905d-0d8b8e39761a local="10.10.10.14:8443" remote="100.122.142.76:61252" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61257" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61258" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61259" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61260" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61261" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61262" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61263" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61264" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61265" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61266" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61267" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61268" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61269" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61270" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Event listener server handler started" id=92562aa9-bccd-41a6-9373-ae5134fc6532 local="10.10.10.14:8443" remote="100.122.142.76:61271" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61271" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61272" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=1ba216ca-eb9a-448e-9391-2f4abf07ede2 project=ac-ovn-spike +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=1ba216ca-eb9a-448e-9391-2f4abf07ede2 project=ac-ovn-spike +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=1ba216ca-eb9a-448e-9391-2f4abf07ede2 project=ac-ovn-spike +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61273" method=GET protocol=tls url="/1.0/operations/1ba216ca-eb9a-448e-9391-2f4abf07ede2?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=92562aa9-bccd-41a6-9373-ae5134fc6532 local="10.10.10.14:8443" remote="100.122.142.76:61271" +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61274" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61275" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:53:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/clean-1/tcpdump-arp.log new file mode 100644 index 0000000..4431c9a --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/tcpdump-arp.log @@ -0,0 +1,3 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/clean-1/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/clean-1/topology.jsonl new file mode 100644 index 0000000..a5b8a1d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/clean-1/topology.jsonl @@ -0,0 +1,32 @@ +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.08, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.38, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.692, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.114, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.087, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.226, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.386, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T05:47:34.925942485Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"7801d30c-5e48-45b3-916e-7aa5f14efe5b\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T05:47:34.925942485Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.38, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.421, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T05:47:35.693846785Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"511f6649-85f6-4ca5-a9dc-0449b5f79bc8\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T05:47:35.693846785Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.354, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.2, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 152523000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 5734400,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:feb4:b0c4\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 864,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"vethcc4bbe23\",\n\t\t\t\"hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4068503,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T05:47:34.529999971Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.223, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 126849000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 5984256,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe0a:6979\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 860,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"veth09ee9212\",\n\t\t\t\"hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 12129,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T05:47:36.319999933Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t},\n\t\"created_at\": \"2026-09-12T05:47:34.951754192Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T05:47:35.515237521Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t},\n\t\"created_at\": \"2026-09-12T05:47:35.738752966Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T05:47:36.315904669Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.255, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.523 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.523/1.523/1.523 ms\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "printf '%s\\n' 'https://dl-cdn.alpinelinux.org/alpine/v3.22/main' > /etc/apk/repositories"], "code": 0, "seconds": 0.562, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-cache curl busybox-extras"], "code": 2, "seconds": 5.273, "stdout": "fetch https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64/APKINDEX.tar.gz\n", "stderr": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]\n", "error": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]"} +{"args": ["create"], "code": 1, "seconds": 0, "stdout": "", "stderr": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]", "error": "WARNING: fetching https://dl-cdn.alpinelinux.org/alpine/v3.22/main: temporary error (try again later)\nERROR: unable to select packages:\n busybox-extras (no such package):\n required by: world[busybox-extras]\n curl (no such package):\n required by: world[curl]"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:47:34.951754192Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"5cd022be-c5ae-444a-99a4-562d72bdd717\",\n\t\t\t\"volatile.eth0.host_name\": \"vethcc4bbe23\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b4:b0:c4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\",\n\t\t\t\"volatile.uuid.generation\": \"cebae4d4-a24c-478a-8c68-53061fa95b35\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:47:35.515237521Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:47:35.738752966Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"84eef7cd-4620-460f-84ac-70b6cd14a4cd\",\n\t\t\t\"volatile.eth0.host_name\": \"veth09ee9212\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:0a:69:79\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"fd6c2444-0871-4d38-bbdb-195646066e68\",\n\t\t\t\"volatile.uuid.generation\": \"fd6c2444-0871-4d38-bbdb-195646066e68\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:47:36.315904669Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.376, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.93, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.087, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.146, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.078, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.079, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T05:47:35.772620572Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T05:47:34.817919566Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.16, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.112, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/cycle-table.json b/spikes/ovn/diagnosis-2026-09-12/cycle-table.json new file mode 100644 index 0000000..f28e637 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/cycle-table.json @@ -0,0 +1,149 @@ +{ + "verdict": "FALLBACK", + "criterion": "lab01 gateway fails before and after one authorized reboot; nas01 gateway control passes", + "cycles": [ + { + "cycle": "clean-1", + "ok": false, + "seconds": 50.489, + "router": "incus-net24-lr", + "gateway_chassis": "lab01.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:49:f5:82", + "teardown": "skipped", + "network_create_seconds": null + }, + { + "cycle": "keeper-1", + "ok": true, + "seconds": 29.756, + "router": "incus-net26-lr", + "gateway_chassis": "nas01.glab.lol", + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:ed:13:7f", + "teardown": "done", + "network_create_seconds": 0.382 + }, + { + "cycle": "keeper-2", + "ok": true, + "seconds": 32.19, + "router": "incus-net27-lr", + "gateway_chassis": "lab03.glab.lol", + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:6c:ad:18", + "teardown": "done", + "network_create_seconds": 0.374 + }, + { + "cycle": "keeper-3", + "ok": false, + "seconds": 61.306, + "router": "incus-net28-lr", + "gateway_chassis": "lab01.glab.lol", + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:14:21:7e", + "teardown": "done", + "network_create_seconds": 0.257 + }, + { + "cycle": "outage-fixture", + "ok": false, + "seconds": 55.432, + "router": "incus-net29-lr", + "gateway_chassis": "lab01.glab.lol", + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:ab:ba:f8", + "teardown": "retained-for-outage", + "network_create_seconds": 0.245 + }, + { + "cycle": "post-outage", + "ok": true, + "seconds": 31.078, + "router": "incus-net31-lr", + "gateway_chassis": "nas01.glab.lol", + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:ea:40:3b", + "teardown": "done", + "network_create_seconds": 0.306 + }, + { + "cycle": "gateway-pre-1", + "ok": true, + "seconds": 33.092, + "router": "incus-net32-lr", + "gateway_chassis": "lab02.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:33:3f:c7", + "teardown": "done", + "network_create_seconds": 0.576 + }, + { + "cycle": "gateway-pre-2", + "ok": true, + "seconds": 29.904, + "router": "incus-net33-lr", + "gateway_chassis": "lab02.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:74:95:5e", + "teardown": "done", + "network_create_seconds": 0.602 + }, + { + "cycle": "gateway-pre-3", + "ok": true, + "seconds": 31.142, + "router": "incus-net34-lr", + "gateway_chassis": "lab02.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:1f:21:eb", + "teardown": "done", + "network_create_seconds": 0.633 + }, + { + "cycle": "gateway-pre-4", + "ok": true, + "seconds": 32.274, + "router": "incus-net35-lr", + "gateway_chassis": "lab02.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:97:88:42", + "teardown": "done", + "network_create_seconds": 0.591 + }, + { + "cycle": "gateway-pre-5", + "ok": true, + "seconds": 32.47, + "router": "incus-net36-lr", + "gateway_chassis": "nas01.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:ef:03:ee", + "teardown": "done", + "network_create_seconds": 0.56 + }, + { + "cycle": "gateway-pre-6", + "ok": false, + "seconds": 60.817, + "router": "incus-net37-lr", + "gateway_chassis": "lab01.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:b2:7a:65", + "teardown": "done", + "network_create_seconds": 0.569 + }, + { + "cycle": "gateway-post-1", + "ok": false, + "seconds": 61.572, + "router": "incus-net38-lr", + "gateway_chassis": "lab01.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:43:84:fe", + "teardown": "done", + "network_create_seconds": 0.569 + } + ] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/execution.jsonl b/spikes/ovn/diagnosis-2026-09-12/execution.jsonl new file mode 100644 index 0000000..3e6401f --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/execution.jsonl @@ -0,0 +1,53 @@ +{"at": "2026-09-12T05:28:02.893649+00:00", "command": "incus query 'nas01:/1.0/projects?recursion=1'", "cwd": null, "seconds": 0.106, "exit_code": 0, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "stdout_projection": "Project reference counts replace unrelated resource names"} +{"at": "2026-09-12T05:28:03.032733+00:00", "command": "incus query 'nas01:/1.0/networks?recursion=1&project=default'", "cwd": null, "seconds": 0.138, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\t\"volatile.last_state.created\": \"false\"\n\t\t},\n\t\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\t\"locations\": [\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"fast40-uplink\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"physical\",\n\t\t\"used_by\": []\n\t},\n\t{\n\t\t\"config\": {\n\t\t\t\"ipv4.address\": \"10.57.139.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\"\n\t\t},\n\t\t\"description\": \"NAT bridge for the restricted image-build project\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"image-build\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"bridge\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/profiles/default?project=image-build\"\n\t\t]\n\t},\n\t{\n\t\t\"config\": {\n\t\t\t\"ipv4.address\": \"10.158.84.1/24\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"fd42:37d0:7f47:b4d::1/64\",\n\t\t\t\"ipv6.nat\": \"true\"\n\t\t},\n\t\t\"description\": \"Local network bridge (NAT)\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"incusbr0\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"bridge\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/profiles/default\",\n\t\t\t\"/1.0/instances/meshcommander\",\n\t\t\t\"/1.0/instances/phase4-alice\",\n\t\t\t\"/1.0/instances/soak01\",\n\t\t\t\"/1.0/instances/dntls-guac01\",\n\t\t\t\"/1.0/instances/dntls-rdp01\",\n\t\t\t\"/1.0/instances/dntls-ubuntu2404-template\"\n\t\t]\n\t},\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"locations\": null,\n\t\t\"managed\": false,\n\t\t\"name\": \"fast40\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"\",\n\t\t\"type\": \"vlan\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/networks/fast40-uplink\",\n\t\t\t\"/1.0/instances/soak01\"\n\t\t]\n\t}\n]\n\n", "stderr": ""} +{"at": "2026-09-12T05:28:03.163038+00:00", "command": "incus query 'nas01:/1.0/networks?recursion=1&project=image-build'", "cwd": null, "seconds": 0.13, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"ipv4.address\": \"10.57.139.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\"\n\t\t},\n\t\t\"description\": \"NAT bridge for the restricted image-build project\",\n\t\t\"locations\": [\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"image-build\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"bridge\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/profiles/default?project=image-build\"\n\t\t]\n\t}\n]\n\n", "stderr": ""} +{"at": "2026-09-12T05:28:03.318003+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'sudo systemctl is-active ovn-central ovn-northd ovn-ovsdb-server-nb ovn-ovsdb-server-sb; sudo ovn-nbctl show; sudo ovn-sbctl show'", "cwd": null, "seconds": 0.154, "exit_code": 0, "stdout": "active\nactive\nactive\nactive\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n", "stderr": ""} +{"at": "2026-09-12T05:28:16.160765+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 12.842, "exit_code": 0, "stdout": "", "stderr": "Using CPython 3.14.7 interpreter at: /opt/homebrew/opt/python@3.14/bin/python3.14\nCreating virtual environment at: .venv\n Building fleet-cluster @ file:///Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster\n Built fleet-cluster @ file:///Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster\nInstalled 38 packages in 141ms\n--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn.py\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=nas01)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab01)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab02)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab03)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=nas01)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab01)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab02)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab03)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] noop: Incus network default/fast40-macvlan is absent\n [@local] Loaded fact pyinfra_incus.facts.ClusterMembers (remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=nas01)\n [@local] noop: Incus cluster network default/fast40-uplink is unchanged\n [@local] Ready: src/fleet_cluster/deploys/ovn.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Ensure nas01 OVN chassis enabled - - \n Ensure lab01 OVN chassis enabled - - \n Ensure lab02 OVN chassis enabled - - \n Ensure lab03 OVN chassis enabled - - \n Ensure nas01 OVN northbound connection - - \n Ensure lab01 OVN northbound connection - - \n Ensure lab02 OVN northbound connection - - \n Ensure lab03 OVN northbound connection - - \n Ensure unused fast40-macvlan is absent - - \n Ensure clustered physical uplink fast40-uplink - - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T05:30:43.218016+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_keeper.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 0.79, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_keeper.py\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_keeper.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Ensure empty OVN keeper network 1 (@local) - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T05:31:07.339935+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'ip neigh show to 10.10.40.64 dev enp2s0; ip neigh show to 10.10.40.65 dev enp2s0; ip neigh show to 10.10.40.79 dev enp2s0'", "cwd": null, "seconds": 0.096, "exit_code": 0, "stdout": "10.10.40.64 lladdr 10:66:6a:48:93:53 STALE \n", "stderr": ""} +{"at": "2026-09-12T05:31:07.723826+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 'ip neigh show to 10.10.40.64 dev br40; ip neigh show to 10.10.40.65 dev br40; ip neigh show to 10.10.40.79 dev br40'", "cwd": null, "seconds": 0.483, "exit_code": 0, "stdout": "10.10.40.64 FAILED \n10.10.40.65 FAILED \n10.10.40.79 lladdr 10:66:6a:48:93:53 STALE \n", "stderr": ""} +{"at": "2026-09-12T05:46:03.326975+00:00", "command": "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=5'", "cwd": null, "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789182040099653\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor97)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789182040101556\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01264|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789182040101609\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01265|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net23-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789182040124814\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01266|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net23-ls-ext-lsp-provider on port 13\"\n },\n {\n \"at\": \"1789182046707118\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|01267|connmgr|INFO|br-int<->unix#7: 2073 flow_mods in the 3 s starting 10 s ago (680 adds, 1363 deletes, 30 modifications)\"\n }\n]\n", "stderr": "", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"at": "2026-09-12T05:48:00.202378+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 '/opt/vyatta/bin/vyatta-op-cmd-wrapper show arp interface br40'", "cwd": null, "seconds": 0.5, "exit_code": 0, "stdout": "Address Interface Link layer address State\n------------ ----------- -------------------- ---------\n10.10.40.203 br40 FAILED\n10.10.40.200 br40 10:66:6a:ef:62:a5 STALE\n10.10.40.64 br40 FAILED\n10.10.40.10 br40 38:05:25:34:25:d0 REACHABLE\n10.10.40.79 br40 10:66:6a:48:93:53 STALE\n10.10.40.65 br40 FAILED\n10.10.40.202 br40 10:66:6a:a9:11:bb STALE\n", "stderr": ""} +{"at": "2026-09-12T05:48:48.277776+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'pgrep -af \"tcpdump.*enp2s0\" || true'", "cwd": null, "seconds": 0.111, "exit_code": 0, "stdout": "588097 /usr/sbin/tailscaled be-child ssh --login-shell=/bin/bash --uid=1000 --gid=1000 --groups=1000,4,24,27,30,46,100,101,1001,107,981 --local-user=josh --home-dir=/home/josh --remote-user=[operator-email-redacted] --remote-ip=100.122.142.76 --has-tty=false --tty-name= --force-v1-behavior --cmd=pgrep -af \"tcpdump.*enp2s0\" || true\n588104 /bin/bash -c pgrep -af \"tcpdump.*enp2s0\" || true\n", "stderr": ""} +{"at": "2026-09-12T05:50:01.544014+00:00", "command": "incus query 'nas01:/1.0/networks/default?project=ac-ovn-spike'", "cwd": null, "seconds": 0.096, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": [\n\t\t\"/1.0/instances/one?project=ac-ovn-spike\",\n\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t]\n}\n\n", "stderr": ""} +{"at": "2026-09-12T05:50:01.811031+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 'ip neigh show to 10.10.40.64'", "cwd": null, "seconds": 0.266, "exit_code": 0, "stdout": "10.10.40.64 dev br40 FAILED \n", "stderr": ""} +{"at": "2026-09-12T05:50:02.370086+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 '/opt/vyatta/bin/vyatta-op-cmd-wrapper reset ip arp address 10.10.40.64'", "cwd": null, "seconds": 0.559, "exit_code": 0, "stdout": "", "stderr": ""} +{"at": "2026-09-12T05:50:07.090749+00:00", "command": "incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1", "cwd": null, "seconds": 4.701, "exit_code": 1, "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", "stderr": ""} +{"at": "2026-09-12T05:50:07.092299+00:00", "command": "incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1", "cwd": null, "seconds": 4.698, "exit_code": 1, "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", "stderr": ""} +{"at": "2026-09-12T05:50:07.398181+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 'ip neigh show to 10.10.40.64'", "cwd": null, "seconds": 0.305, "exit_code": 0, "stdout": "", "stderr": ""} +{"at": "2026-09-12T05:55:41.386457+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_keeper.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 2.191, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_keeper.py\n [@local] Ready: src/fleet_cluster/deploys/ovn_keeper.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Ensure empty OVN keeper network \n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Success\n\n--> Results:\n Operation Hosts Success Error No Change \n Ensure empty OVN keeper network 1 1 - - \n Grand total 1 1 - - \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T05:55:41.471480+00:00", "command": "incus query 'nas01:/1.0/networks/keeper?project=default'", "cwd": null, "seconds": 0.085, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"ipv4.address\": \"10.253.72.1/24\",\n\t\t\"ipv4.dhcp\": \"false\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"user.ovn-diagnosis\": \"keeper\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"Empty uplink consumer for the OVN recreate diagnosis\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"keeper\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": ""} +{"at": "2026-09-12T05:59:46.670404+00:00", "command": "incus list nas01: location=lab01 --project default --format csv --columns nsL", "cwd": null, "seconds": 0.135, "exit_code": 0, "stdout": "soak01,RUNNING,lab01\n", "stderr": ""} +{"at": "2026-09-12T06:00:02.449786+00:00", "command": "incus config device show nas01:soak01 --project default --expanded", "cwd": null, "seconds": 0.042, "exit_code": 1, "stdout": "", "stderr": "Error: unknown flag: --expanded\n"} +{"at": "2026-09-12T06:07:34.221979+00:00", "command": "incus query 'nas01:/1.0/networks/default?project=ac-ovn-spike'", "cwd": null, "seconds": 0.109, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": [\n\t\t\"/1.0/instances/one?project=ac-ovn-spike\",\n\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t]\n}\n\n", "stderr": ""} +{"at": "2026-09-12T06:07:34.505678+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 'ip neigh show to 10.10.40.65'", "cwd": null, "seconds": 0.283, "exit_code": 0, "stdout": "10.10.40.65 dev br40 FAILED \n", "stderr": ""} +{"at": "2026-09-12T06:07:35.021636+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 '/opt/vyatta/bin/vyatta-op-cmd-wrapper reset ip arp address 10.10.40.65'", "cwd": null, "seconds": 0.515, "exit_code": 0, "stdout": "", "stderr": ""} +{"at": "2026-09-12T06:07:39.524656+00:00", "command": "incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1", "cwd": null, "seconds": 4.494, "exit_code": 1, "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", "stderr": ""} +{"at": "2026-09-12T06:07:39.530026+00:00", "command": "incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1", "cwd": null, "seconds": 4.505, "exit_code": 1, "stdout": "PING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\n", "stderr": ""} +{"at": "2026-09-12T06:07:39.829086+00:00", "command": "ssh -o BatchMode=yes -i /Users/josh/.ssh/vyos-gateway vyos@10.0.0.2 'ip neigh show to 10.10.40.65'", "cwd": null, "seconds": 0.299, "exit_code": 0, "stdout": "", "stderr": ""} +{"at": "2026-09-12T15:31:36.893598+00:00", "command": "incus query 'nas01:/1.0/networks/keeper?project=default'", "cwd": null, "seconds": 0.476, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"ipv4.address\": \"10.253.72.1/24\",\n\t\t\"ipv4.dhcp\": \"false\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"user.ovn-diagnosis\": \"keeper\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"Empty uplink consumer for the OVN recreate diagnosis\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"keeper\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": ""} +{"at": "2026-09-12T15:31:38.281621+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_keeper.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 1.386, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_keeper.py\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_keeper.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Ensure empty OVN keeper network absent 1 (@local) - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T15:31:39.368762+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_keeper.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 1.087, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_keeper.py\n [@local] Ready: src/fleet_cluster/deploys/ovn_keeper.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Ensure empty OVN keeper network absent \n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Success\n\n--> Results:\n Operation Hosts Success Error No Change \n Ensure empty OVN keeper network absent 1 1 - - \n Grand total 1 1 - - \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T15:31:39.658016+00:00", "command": "incus query 'nas01:/1.0/networks?project=default&recursion=1'", "cwd": null, "seconds": 0.289, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\t\"volatile.last_state.created\": \"false\"\n\t\t},\n\t\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\t\"locations\": [\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\",\n\t\t\t\"lab01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"fast40-uplink\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"physical\",\n\t\t\"used_by\": []\n\t},\n\t{\n\t\t\"config\": {\n\t\t\t\"ipv4.address\": \"10.57.139.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\"\n\t\t},\n\t\t\"description\": \"NAT bridge for the restricted image-build project\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"image-build\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"bridge\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/profiles/default?project=image-build\"\n\t\t]\n\t},\n\t{\n\t\t\"config\": {\n\t\t\t\"ipv4.address\": \"10.158.84.1/24\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"fd42:37d0:7f47:b4d::1/64\",\n\t\t\t\"ipv6.nat\": \"true\"\n\t\t},\n\t\t\"description\": \"Local network bridge (NAT)\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"incusbr0\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"bridge\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/profiles/default\",\n\t\t\t\"/1.0/instances/soak01\",\n\t\t\t\"/1.0/instances/dntls-guac01\",\n\t\t\t\"/1.0/instances/dntls-rdp01\",\n\t\t\t\"/1.0/instances/dntls-ubuntu2404-template\",\n\t\t\t\"/1.0/instances/meshcommander\",\n\t\t\t\"/1.0/instances/phase4-alice\"\n\t\t]\n\t},\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"locations\": null,\n\t\t\"managed\": false,\n\t\t\"name\": \"fast40\",\n\t\t\"project\": \"default\",\n\t\t\"status\": \"\",\n\t\t\"type\": \"vlan\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/networks/fast40-uplink\",\n\t\t\t\"/1.0/instances/soak01\"\n\t\t]\n\t}\n]\n\n", "stderr": ""} +{"at": "2026-09-12T15:33:13.212286+00:00", "command": "incus query 'nas01:/1.0/networks/fast40?project=default&target=lab01'", "cwd": null, "seconds": 0.108, "exit_code": 0, "stdout": "{\n\t\"config\": {},\n\t\"description\": \"\",\n\t\"locations\": null,\n\t\"managed\": false,\n\t\"name\": \"fast40\",\n\t\"project\": \"default\",\n\t\"status\": \"\",\n\t\"type\": \"vlan\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/fast40-uplink\",\n\t\t\"/1.0/instances/soak01\"\n\t]\n}\n\n", "stderr": ""} +{"at": "2026-09-12T15:35:35.544468+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-11T23%3A00%3A00Z&until=2026-09-12T03%3A05%3A00Z'\"'\"' | jq '\"'\"'[.[] | select(.MESSAGE | test(\"fast40|incusovn.*(added|deleted)|Dropped\")) | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'\"'\"''", "cwd": null, "seconds": 0.757, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789181554581259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00047|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789181554581363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00049|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789181554678404\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554678541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181554680378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554680420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181554680462\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554680504\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181554681215\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00059|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554681324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00060|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181554683954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00061|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554683985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00062|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181554685521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554685553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554685782\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00065|bridge|INFO|bridge incusovn16: added interface patch-incus-net17-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789181554685861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181554687558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00068|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181555681570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00069|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181555681641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00070|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181556681879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00072|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181556682080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181557681875\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00084|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181557682016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181558681878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00086|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181558681980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181559681852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00088|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181559682115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181560681861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00090|dpif|WARN|Dropped 2087 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181560682083\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181561682024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00092|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181561682262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00093|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181562681821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00094|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181562681948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00095|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181563006206\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00096|poll_loop|INFO|Dropped 12233 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181563681820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00098|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181563681944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00099|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181564681919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00101|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181564682021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181565681999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00103|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181565682210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181566682010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00105|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181566682252\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181567681851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00107|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181567681964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181568681671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00109|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181568681900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00110|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181569006059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00111|poll_loop|INFO|Dropped 12283 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181569681826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00113|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181569682085\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181570681902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00115|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181570682167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181571682029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00117|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181571682254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181572681636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00119|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181572681763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181573681975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00121|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181573682212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181574681753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00123|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181574681894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00124|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181575005951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00125|poll_loop|INFO|Dropped 12340 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181575681837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00127|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181575681961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181576681795\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00129|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181576682103\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181577681908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00131|dpif|WARN|Dropped 2113 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181577682176\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181578682082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00133|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181578682316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181579681649\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00135|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181579681790\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181580682050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00137|dpif|WARN|Dropped 2101 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181580682283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00138|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181581005684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00139|poll_loop|INFO|Dropped 12479 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181581681985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00141|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181581682128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181582681698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00143|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181582681804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181583682018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00145|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181583682231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181584681632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00147|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181584681794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181585681932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00149|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181585682234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181586681641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00151|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181586681793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00152|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181587005828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00153|poll_loop|INFO|Dropped 12318 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181587681860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00155|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181587681965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181588681858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00157|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181588682114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181589682126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00159|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181589682464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181590681866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00161|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181590682005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181591681803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00163|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181591682059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181592682125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00165|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181592682380\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00166|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181593005551\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00167|poll_loop|INFO|Dropped 12434 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181593682196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00169|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181593682417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181594682057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00171|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181594682196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181595681954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00173|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181595682206\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181596681833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00175|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181596681944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181597681727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00177|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181597681927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181598681600\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00179|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181598681733\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00180|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181599005976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00181|poll_loop|INFO|Dropped 12582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181599681825\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00183|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181599681930\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181600681855\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00186|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181600681975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00187|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181601681784\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00188|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181601682030\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00189|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181602304267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789181602304331\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net17-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789181604277082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789181604277377\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00195|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789181604374510\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00199|dpif|WARN|Dropped 1343 log messages in last 3 seconds (most recently, 2 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181604374629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00200|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181604376968\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00201|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181604385301\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00202|bridge|INFO|bridge incusovn16: added interface patch-incus-net18-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789181604681614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00204|dpif|WARN|Dropped 558 log messages in last 0 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181604681685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181605681654\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00206|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181605681869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00207|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181606681838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00209|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181606682028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00210|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181607681704\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00211|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181607681855\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00212|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181608005800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00213|poll_loop|INFO|Dropped 8216 log messages in last 9 seconds (most recently, 3 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181608681943\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00215|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181608682150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00216|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181609681841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00217|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181609681949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00218|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181610681625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00219|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181610681850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00220|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181611005540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00221|poll_loop|INFO|Dropped 6143 log messages in last 3 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181611681873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00223|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181611682059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00224|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181612681582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00225|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181612681709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00226|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181613681879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00227|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181613682096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00228|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181614677561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00229|bridge|WARN|Dropped 119327 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181614677661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00230|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181614681838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00231|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181614681897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00232|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181615681597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00233|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181615681703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181616682006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00235|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181616682192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181617005964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00237|poll_loop|INFO|Dropped 12341 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181617681835\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00239|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181617681947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181618681794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00241|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181618681997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00242|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181619681895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00243|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181619682116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00244|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181620681787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00245|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181620681939\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00246|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181621681688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00247|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181621681787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00248|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181622681857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00249|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181622682074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00250|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181623005794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00251|poll_loop|INFO|Dropped 12216 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181623681621\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00253|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181623681733\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181624681734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00256|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181624681810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181625681511\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00258|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181625681726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181626681510\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00260|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181626681742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00261|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181627681837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00262|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181627682067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181628682003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00264|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181628682196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00265|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181629005715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00266|poll_loop|INFO|Dropped 12294 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181629681839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00268|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181629681954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00269|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181630681868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00270|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181630682112\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00271|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181631681858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00272|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181631681997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00273|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181632681888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00274|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181632682033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181633681796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00276|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181633681919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00277|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181634681626\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00278|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181634681861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00279|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181635005603\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00280|poll_loop|INFO|Dropped 12226 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181635681911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00282|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181635682129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00283|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181636681910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00284|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181636682014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00285|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181637681854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00286|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181637682007\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00287|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181638681843\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00288|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181638682057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00289|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181639682062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00290|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181639682300\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00291|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181640681660\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00292|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181640681774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00293|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181641005823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00294|poll_loop|INFO|Dropped 12313 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181641681909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00296|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181641682000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00297|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181642681788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00298|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181642717693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00299|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181643681893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00300|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181643682118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00301|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181644681701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00302|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181644681850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00303|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181645681567\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00304|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181645681778\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00305|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181646681823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00306|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181646682039\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181647005700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00308|poll_loop|INFO|Dropped 12266 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181647681621\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00310|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181647681737\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181648681732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00312|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181648682060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00313|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181649681694\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00314|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181649681794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00315|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181650681671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00316|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181650681780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00317|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181651681889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00318|dpif|WARN|Dropped 2053 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181651682130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00319|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181652681947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00320|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181652682231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00321|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181653005914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00322|poll_loop|INFO|Dropped 12309 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181653681946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00324|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181653682256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00325|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181654681677\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00326|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181654681806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00327|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181655681533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00328|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181655681775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00329|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181656681544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00330|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181656681754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00331|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181657682013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00332|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181657716354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00333|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181658681630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00334|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181658681758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00335|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181659005552\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00336|poll_loop|INFO|Dropped 12262 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181659681849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00338|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181659681978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00339|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181660682148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00340|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181660682405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181661681841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00342|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181661681985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00343|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181662681858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00344|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181662682111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00345|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181663681964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00346|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181663682225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00347|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181664681783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00348|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181664681924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00349|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181665005744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00350|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181665681789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00352|dpif|WARN|Dropped 2105 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181665681937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00353|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181666681963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00354|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181666682240\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00355|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181667682081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00356|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181667682359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00357|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181668682103\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00358|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181668682359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00359|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181669681544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00360|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181669681668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00361|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181670681707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00362|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181670681988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00363|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181671005761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00364|poll_loop|INFO|Dropped 12244 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181671681732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00366|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181671681852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00367|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181672681869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00368|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181672682101\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00369|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181673681782\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00370|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181673681892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181674677949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00372|bridge|WARN|Dropped 122637 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181674678064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00373|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181674681587\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00374|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181674681669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181675681648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00376|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181675681960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181676681864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00378|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181676682115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181677006102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00380|poll_loop|INFO|Dropped 12186 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181677681914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00382|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181677682136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181678681896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00384|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181678682012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181679681837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00386|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181679682073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181680681925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00388|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181680682084\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181681681670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00390|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181681681795\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181682681994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00392|dpif|WARN|Dropped 2053 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181682682217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00393|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181683005986\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00394|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181683681836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00396|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181683681948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00397|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181684681867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00399|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181684681952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00400|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181685681896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00401|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181685682132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00402|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181686681513\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00403|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181686681650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00404|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181687681953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00405|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181687682193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00406|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181688681558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00407|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181688681703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00408|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181689005874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00409|poll_loop|INFO|Dropped 12242 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181689681658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00411|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181689681827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00412|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181690681789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00413|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181690682028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00414|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181691681908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00415|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181691682176\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00416|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181692681534\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00417|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181692681671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00418|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181693681864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00419|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181693682137\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00420|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181694681672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00421|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181694681798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00422|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181695005981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00423|poll_loop|INFO|Dropped 12184 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181695682225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00425|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181695682352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00426|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181696681983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00427|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181696682233\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00428|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181697681810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00429|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181697681953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00430|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181698681701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00431|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181698681926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00432|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181699682034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00433|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181699682316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00434|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181700681989\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00435|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181700682100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00436|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181701006112\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00437|poll_loop|INFO|Dropped 12136 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181701681611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00439|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181701681729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181702681869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00441|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181702682114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00442|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181703681515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00443|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181703681633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00444|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181704681679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00445|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181704681948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00446|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181705681891\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00447|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181705682189\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00448|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181706681565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00449|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181706681733\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00450|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181707005677\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00451|poll_loop|INFO|Dropped 12166 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181707681756\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00453|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181707681885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00454|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181708681862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00455|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181708682136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00456|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181709681723\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00457|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181709681861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00458|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181710682066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00459|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181710682552\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00460|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181711681700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00461|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181711681823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00462|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181712681737\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00463|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181712681976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00464|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181713005689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00465|poll_loop|INFO|Dropped 12186 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181713681661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00467|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181713681787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00468|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181714681879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00469|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181714682145\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00470|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181715681616\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00471|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181715681769\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00472|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181716681568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00473|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181716681809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00474|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181717681964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00475|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181717682224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00476|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181718681560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00477|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181718681688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00478|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181719006200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00479|poll_loop|INFO|Dropped 12214 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181719681924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00481|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181719682038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00482|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181720681947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00483|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181720682200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00484|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181721681893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00485|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181721682052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00486|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181722681593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00487|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181722681698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00488|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181723681621\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00489|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181723681864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00490|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181724681928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00491|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181724682163\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00492|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181725005911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00493|poll_loop|INFO|Dropped 12147 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181725681783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00495|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181725681882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00496|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181726681648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00497|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181726681892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00498|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181727681895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00499|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181727682150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00500|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181728681933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00501|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181728682189\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00502|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181729681638\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00503|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181729681783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00504|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181730681751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00505|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181730681992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00506|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181731005690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00507|poll_loop|INFO|Dropped 12192 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181731681928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00509|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181731682182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00510|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181732681620\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00511|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181732681732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00512|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181733681802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00513|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181733682066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00514|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181734677854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00515|bridge|WARN|Dropped 121835 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181734677970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00516|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181734681875\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00517|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181734682019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00518|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181735681556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00519|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181735681703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00520|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181736681885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00521|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181736682164\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00522|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181737005718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00523|poll_loop|INFO|Dropped 12164 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181737681775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00525|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181737681906\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181738681753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00527|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181738681871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181739681655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00529|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181739681935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181740682024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00531|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181740682253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181741681966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00533|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181741682233\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181742681779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00535|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181742681889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00536|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181743005796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00537|poll_loop|INFO|Dropped 12166 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181743681539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00539|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181743681638\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181744681694\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00541|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181744681901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181745681860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00543|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181745682124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00544|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181746681868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00545|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181746682115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00546|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181747681707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00547|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181747681802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00548|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181748681524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00549|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181748681875\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00550|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181749005546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00551|poll_loop|INFO|Dropped 12243 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181749681902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00553|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181749682115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00554|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181750681995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00555|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181750682224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00556|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181751681941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00557|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181751682054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00558|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181752681757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00559|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181752681866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00560|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181753681970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00561|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181753682288\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00562|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181754682004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00563|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181754682253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00564|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181755005799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00565|poll_loop|INFO|Dropped 12157 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181755681683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00567|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181755681765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00568|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181756681887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00569|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181756682166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181757681714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00571|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181757681867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181758681931\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00573|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181758682176\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181759681520\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00575|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181759681628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181760681964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00577|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181760682179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181761005738\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00579|poll_loop|INFO|Dropped 12282 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181761681577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00581|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181761681666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00582|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181762681972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00583|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181762682202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181763681701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00585|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181763681806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181764681943\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00587|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181764682249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181765681574\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00589|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181765681727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181766681780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00591|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181766716454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181767005702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00593|poll_loop|INFO|Dropped 12225 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181767681745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00595|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181767681891\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00596|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181768681930\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00597|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181768682186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181769681706\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00599|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181769681860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00600|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181770640079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00601|bridge|INFO|bridge incusovn16: added interface patch-incus-net20-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789181770681766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00603|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181770681874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00604|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181771682043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00605|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181771682299\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00606|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181772681929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00608|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181772682102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00609|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181773006024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00610|poll_loop|INFO|Dropped 12198 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181773681882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00612|dpif|WARN|Dropped 2119 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181773681993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00613|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181774239847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00614|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net18-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789181774513589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00616|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789181774513697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00617|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net20-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789181776460967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00619|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789181776461261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00621|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789181776559613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00625|dpif|WARN|Dropped 1708 log messages in last 3 seconds (most recently, 2 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181776559661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00626|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181776559709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00627|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181776565673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00628|bridge|INFO|bridge incusovn16: added interface patch-incus-net21-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789181776681548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00630|dpif|WARN|Dropped 196 log messages in last 0 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181776681612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00631|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181777681905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00632|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181777682011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00633|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181778681637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00635|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181778681859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00636|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181779040972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00637|poll_loop|INFO|Dropped 3187 log messages in last 6 seconds (most recently, 4 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181779682016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00639|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181779682241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00640|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181780681639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00642|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181780681713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00643|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181781681912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00644|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181781682179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00645|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181782682080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00646|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181782682321\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00647|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181783681985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00648|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181783682131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00649|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181784682149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00650|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181784682325\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181785005830\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00652|poll_loop|INFO|Dropped 12260 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181785681748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00654|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181785681860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00655|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181786681715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00656|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181786681954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181787681669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00658|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181787681809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00659|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181788681842\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00660|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181788682100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181789681809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00662|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181789681945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00663|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181790682035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00664|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181790682266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00665|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181791005714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00666|poll_loop|INFO|Dropped 12459 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181791682020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00668|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181791682115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00669|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181792681709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00670|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181792681830\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00671|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181793681670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00672|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181793681893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00673|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181794677684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00674|bridge|WARN|Dropped 118241 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181794677793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00675|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181794681597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00676|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181794681668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00677|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181795681726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00678|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181795681972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00679|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181796681682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00680|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181796681799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00681|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181797005993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00682|poll_loop|INFO|Dropped 12254 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181797681643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00684|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181797681786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00685|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181798681747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00686|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181798681955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00687|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181799681982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00688|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181799682212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00689|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181800682021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00690|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181800682217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181801681813\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00692|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181801681958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181802681838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00694|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181802682085\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181803005771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00696|poll_loop|INFO|Dropped 12162 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181803681773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00698|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181803682048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181804681884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00700|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181804681983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00701|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181805681794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00702|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181805682045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00703|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181806681957\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00704|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181806682191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00705|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181807681765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00706|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181807681918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00707|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181808681868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00708|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181808682121\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00709|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181809006067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00710|poll_loop|INFO|Dropped 12307 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181809681864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00712|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181809681985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00713|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181810682065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00714|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181810682325\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00715|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181811681861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00716|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181811681995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00717|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181812681987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00718|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181812682217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00719|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181813681614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00720|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181813681730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00721|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181814681725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00722|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181814682010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00723|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181815005597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00724|poll_loop|INFO|Dropped 12243 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181815681787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00726|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181815681997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00727|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181816681725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00728|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181816681866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00729|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181817681985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00730|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181817682235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00731|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181818681827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00732|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181818681928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00733|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181819681843\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00734|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181819682094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00735|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181820681832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00736|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181820681966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00737|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181821005646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00738|poll_loop|INFO|Dropped 12333 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181821682029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00740|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181821682218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00741|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181822681917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00742|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181822682055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00743|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181823681664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00744|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181823681771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00745|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181824681889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00746|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181824682148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00747|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181825681802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00748|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181825681931\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00749|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181826681708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00750|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181826681823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00751|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181827005650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00752|poll_loop|INFO|Dropped 12264 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181827682110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00754|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181827682281\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00755|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181828681961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00756|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181828682204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00757|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181829681741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00758|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181829681856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00759|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181830681978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00760|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181830682178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00761|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181831681750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00762|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181831681900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00763|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181832681631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00764|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181832681867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00765|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181833005668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00766|poll_loop|INFO|Dropped 12518 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181833681737\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00768|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181833681916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00769|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181834682019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00770|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181834682345\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00771|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181835681815\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00772|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181835681926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00773|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181836681867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00774|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181836682126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00775|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181837681638\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00776|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181837681741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00777|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181838681977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00778|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181838682238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00779|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181839005785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00780|poll_loop|INFO|Dropped 12407 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181839681653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00782|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181839681788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00783|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181840682041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00785|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181840682153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00786|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181841681683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00787|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181841681904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00788|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181842681718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00789|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181842681918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00790|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181843682070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00791|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181843682323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00792|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181844682018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00793|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181844682174\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00794|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181845005763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00795|poll_loop|INFO|Dropped 12252 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181845681793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00797|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181845681897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00798|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181846682160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00799|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181846682427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00800|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181847681622\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00801|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181847681760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00802|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181848681688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00803|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181848681943\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00804|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181849681970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00805|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181849682232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00806|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181850681921\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00807|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181850682048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00808|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181851005898\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00809|poll_loop|INFO|Dropped 12268 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181851682078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00811|dpif|WARN|Dropped 2051 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181851682323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00812|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181852681679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00813|dpif|WARN|Dropped 2106 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181852681833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00814|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181853681691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00815|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181853681941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00816|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181854678050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00817|bridge|WARN|Dropped 123090 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181854678166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00818|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181854682106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00819|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181854682298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00820|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181855681754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00821|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181855681895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00822|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181856681899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00823|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181856682096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00824|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181857005969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00825|poll_loop|INFO|Dropped 12340 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181857681916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00827|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181857682138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00828|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181858681742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00829|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181858681866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00830|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181859681870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00831|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181859682113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00832|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181860681917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00833|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181860682168\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00834|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181861681776\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00835|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181861681921\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00836|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181862682066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00837|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181862682330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00838|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181863006127\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00839|poll_loop|INFO|Dropped 12329 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181863681940\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00841|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181863682032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00842|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181864681726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00843|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181864681935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00844|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181865681943\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00845|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181865682169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00846|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181866681998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00847|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181866682242\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00848|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181867681567\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00849|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181867681682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00850|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181868682028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00851|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181868682355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00852|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181869005978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00853|poll_loop|INFO|Dropped 12298 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181869682093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00855|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181869682370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00856|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181870681672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00857|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181870681814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00858|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181871681735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00859|dpif|WARN|Dropped 2087 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181871681981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00860|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181872681939\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00861|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181872682183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00862|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181873681673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00863|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181873681834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00864|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181874681638\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00865|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181874681902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00866|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181875005915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00867|poll_loop|INFO|Dropped 12310 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181875681678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00869|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181875681923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00870|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181876682064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00871|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181876682325\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00872|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181877682075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00873|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181877682297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00874|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181878682150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00875|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181878682458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00876|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181879681691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00877|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181879681813\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00878|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181880681793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00879|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181880681999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00880|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181881005803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00881|poll_loop|INFO|Dropped 12113 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181881681818\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00883|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181881682014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00884|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181882681641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00885|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181882681767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00886|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181883682082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00887|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181883682314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00888|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181884681706\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00889|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181884681857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00890|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181885682050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00891|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181885682314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00892|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181886682006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00893|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181886682138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00894|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181887005984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00895|poll_loop|INFO|Dropped 12312 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181887681726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00897|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181887681847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00898|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181888681810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00899|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181888682092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00900|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181889681648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00901|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181889681784\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00902|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181890681971\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00903|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181890682223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00904|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181891682090\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00905|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181891682308\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00906|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181892681657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00907|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181892681772\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00908|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181893005798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00909|poll_loop|INFO|Dropped 12398 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181893681994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00911|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181893682122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00912|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181894681994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00913|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181894682237\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00914|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181895681783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00915|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181895681907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00916|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181896681924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00917|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181896682249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00918|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181897681702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00919|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181897681892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00920|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181898681859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00921|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181898682099\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00922|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181899006126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00923|poll_loop|INFO|Dropped 12297 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181899681619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00925|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181899681758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00926|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181900681806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00927|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181900682076\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00928|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181901681795\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00929|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181901681939\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00930|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181902681632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00931|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181902681740\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00932|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181903681522\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00933|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181903681748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00934|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181904681814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00935|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181904682077\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00936|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181905005954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00937|poll_loop|INFO|Dropped 12194 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181905681929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00939|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181905682109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00940|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181906681571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00941|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181906681687\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00942|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181907681860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00943|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181907682081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00944|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181908681724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00945|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181908681854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00946|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181909681878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00947|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181909682104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00948|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181910681936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00949|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181910682177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00950|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181911006078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00951|poll_loop|INFO|Dropped 12318 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181911682109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00953|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181911682360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00954|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181912681727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00955|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181912681884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00956|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181913681770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00957|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181913682023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00958|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181914677833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00959|bridge|WARN|Dropped 122964 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181914677972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00960|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181914682023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00961|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181914682186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00962|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181915681885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00963|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181915682019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00964|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181916681985\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00965|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181916682244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00966|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181917005967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00967|poll_loop|INFO|Dropped 12308 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181917681817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00969|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181917681951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00970|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181918681967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00971|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181918682214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00972|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181919682115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00973|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181919682366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00974|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181920681519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00975|dpif|WARN|Dropped 1986 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181920681637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00976|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181921681555\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00977|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181921681763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00978|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181922681901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00979|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181922682148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00980|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181923005574\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00981|poll_loop|INFO|Dropped 12070 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181923681904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00983|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181923682131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00984|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181924681671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00985|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181924681810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00986|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181925681717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00987|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181925681958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00988|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181926681988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00989|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181926682238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00990|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181927681841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00991|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181927681964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00992|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181928681803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00993|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181928682104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00994|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181929005896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00995|poll_loop|INFO|Dropped 12251 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181929681798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00997|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181929681918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00998|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181930681658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00999|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181930681804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01000|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181931681801\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01001|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181931682147\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01002|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181932681700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01003|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181932681846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01004|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181933682109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01005|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181933682318\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181934681882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01007|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181934682029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01008|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181935005917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01009|poll_loop|INFO|Dropped 12249 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181935681755\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01011|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181935681866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181936682109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01013|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181936682360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181937681706\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01015|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181937681813\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181938681692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01017|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181938681910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181939681615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01019|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181939681758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01020|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181940682008\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01021|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181940682239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01022|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181941005684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01023|poll_loop|INFO|Dropped 12165 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181941682072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01025|dpif|WARN|Dropped 2090 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181941682303\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01026|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181942682065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01027|dpif|WARN|Dropped 2051 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181942731789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01028|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181943681807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01029|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181943681928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01030|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181944681945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01031|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181944682166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01032|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181945681967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01033|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181945682210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01034|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181946682037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01035|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181946682300\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01036|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181947005873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01037|poll_loop|INFO|Dropped 12191 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181947681605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01039|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181947681746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01040|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181948682062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01041|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181948682417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01042|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181949682005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01043|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181949682160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01044|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181950681755\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01045|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181950681879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01046|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181951681886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01047|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181951682155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01048|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181952681883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01049|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181952681993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01050|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181953006116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01051|poll_loop|INFO|Dropped 12229 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181953681839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01053|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181953681925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181954682019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01055|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181954682256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01056|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181955682001\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01057|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181955682149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01058|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181956681642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01059|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181956681808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181957681863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01061|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181957682130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181958681665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01063|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181958681803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181959005950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01065|poll_loop|INFO|Dropped 12168 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181959681929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01067|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181959682111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01068|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181960681737\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01069|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181960682006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01070|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181961681928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01071|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181961682167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01072|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181962682018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01073|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181962682260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01074|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181963681918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01075|dpif|WARN|Dropped 1992 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181963682033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01076|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181964682137\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01077|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181964682390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01078|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181965006547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01079|poll_loop|INFO|Dropped 11951 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181965681964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01081|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181965682131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01082|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181966682026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01083|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181966682263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01084|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181967681776\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01085|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181967681934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01086|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181968681758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01087|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181968682020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01088|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181969681783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01089|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181969682046\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01090|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181970681909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01091|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181970682171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01092|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181971006027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01093|poll_loop|INFO|Dropped 12072 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181971682063\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01095|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181971682305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01096|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181972681940\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01097|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181972682088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181973681819\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01099|dpif|WARN|Dropped 2053 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181973681970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181974678062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01101|bridge|WARN|Dropped 121521 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181974678317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01102|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789181974681792\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01103|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181974681833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181975681735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01105|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181975681992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181976681918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01107|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181976682144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181977005903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01109|poll_loop|INFO|Dropped 12188 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181977681936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01111|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181977682196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181978681946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01113|dpif|WARN|Dropped 1996 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181978682057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181979681761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01115|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181979681920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181980681839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01117|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181980682088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181981681645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01119|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181981681796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181982681527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01121|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181982681792\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181983005703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01123|poll_loop|INFO|Dropped 12087 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181983681857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01125|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181983682118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01126|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181984681885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01127|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181984682112\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181985681935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01129|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181985682169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181986681874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01131|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181986681990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181987681945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01133|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181987682130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181988681695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01135|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181988681836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181989005821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01137|poll_loop|INFO|Dropped 12025 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181989681772\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01139|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181989681881\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181990681886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01141|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181990682212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181991681895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01143|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181991682143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181992681949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01145|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181992682162\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181993681775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01147|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181993681903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181994681648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01149|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181994681914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181995005767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01151|poll_loop|INFO|Dropped 12058 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181995681624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01153|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181995681802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01154|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181996681895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01155|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181996682171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181997681979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01157|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181997682229\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181998681661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01159|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181998681821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789181999681617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01161|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789181999681861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182000681745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01163|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182000682025\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182001005750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01165|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182001682014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01167|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182001682231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182002681693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01169|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182002681827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182003681685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01171|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182003681925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182004681739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01173|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182004682022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182005681777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01175|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182005681995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182006681636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01177|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182006681741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182007005948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01179|poll_loop|INFO|Dropped 12127 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182007681810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01181|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182007681960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01182|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182008681722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01183|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182008681972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182009681746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01185|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182009682020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01186|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182010681725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01187|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182010681826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01188|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182011681752\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01189|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182011681870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01190|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182012681759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01191|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182012681893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01192|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182013005923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01193|poll_loop|INFO|Dropped 12056 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182013681703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01195|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182013681829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01196|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182014681750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01197|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182014681993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01198|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182015681979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01199|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182015682241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01200|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182016682057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01201|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182016682310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01202|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182017681665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01203|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182017681789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01204|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182018681949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01205|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182018682195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01206|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182019005728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01207|poll_loop|INFO|Dropped 12110 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182019681806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01209|dpif|WARN|Dropped 1985 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182019681912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01210|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182020681899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01211|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182020682138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01212|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182021681650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01213|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182021681763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01214|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182022681570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01215|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182022681794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01216|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182023681645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01217|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182023681876\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01218|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182024681796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01219|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182024682033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01220|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182025005630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01221|poll_loop|INFO|Dropped 12254 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182025681727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01223|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182025681861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01224|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182026681998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01225|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182026682232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01226|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182027681543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01227|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182027681657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01228|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182028681840\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01229|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182028682058\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182029681821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01231|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182029681925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01232|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182030681714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01233|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182030681817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182031005674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01235|poll_loop|INFO|Dropped 12339 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182031681899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01237|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182031682006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01238|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182032681694\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01239|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182032681891\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182033681686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01241|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182033681797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01242|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182034677816\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01243|bridge|WARN|Dropped 121460 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182034677906\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01244|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789182034681611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01245|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182034681651\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01246|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182035681704\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01247|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182035681944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01248|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182036681666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01249|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182036681764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01250|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182036722284\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01251|bridge|INFO|bridge incusovn16: added interface patch-incus-net23-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789182037005578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01253|poll_loop|INFO|Dropped 12329 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182037681990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01256|dpif|WARN|Dropped 1968 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182037682164\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182038681599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01258|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182038681704\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182039681719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01260|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789182039681955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01261|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789182039814773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01262|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net21-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789182040101556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01264|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789182040101609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|01265|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net23-ls-ext-lsp-provider-to-br-int on port 2\"\n }\n]\n", "stderr": ""} +{"at": "2026-09-12T15:36:41.161947+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/1.0/instances/soak01?project=default'\"'\"' | jq '\"'\"'{name,status,location,expanded_devices}'\"'\"''", "cwd": null, "seconds": 0.104, "exit_code": 0, "stdout": "{\n \"name\": \"soak01\",\n \"status\": \"Running\",\n \"location\": \"lab01\",\n \"expanded_devices\": {\n \"eth0\": {\n \"name\": \"eth0\",\n \"network\": \"incusbr0\",\n \"type\": \"nic\"\n },\n \"eth1\": {\n \"nictype\": \"macvlan\",\n \"parent\": \"fast40\",\n \"type\": \"nic\"\n },\n \"root\": {\n \"path\": \"/\",\n \"pool\": \"data\",\n \"type\": \"disk\"\n }\n }\n}\n", "stderr": ""} +{"at": "2026-09-12T15:36:41.374403+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/1.0/instances/soak01/state?project=default'\"'\"' | jq '\"'\"'{status,eth1:(.network.eth1|{state,host_name,mtu,type})}'\"'\"''", "cwd": null, "seconds": 0.212, "exit_code": 0, "stdout": "{\n \"status\": \"Running\",\n \"eth1\": {\n \"state\": \"up\",\n \"host_name\": \"fast40\",\n \"mtu\": 1500,\n \"type\": \"broadcast\"\n }\n}\n", "stderr": ""} +{"at": "2026-09-12T15:41:53.378391+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_reboot.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 0.779, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_reboot.py\n [@local] Ready: src/fleet_cluster/deploys/ovn_reboot.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Reboot nas01:lab01 request phase3-recreate-lab01-20260912 receipt /Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/reboot-receipts 1 (@local) - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T15:46:27.407273+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1'\"'\"' | jq '\"'\"'[.[] | {boot_id: ._BOOT_ID, at: .__REALTIME_TIMESTAMP, message: .MESSAGE}]'\"'\"''", "cwd": null, "seconds": 0.11, "exit_code": 0, "stdout": "[\n {\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"at\": \"1789227943757519\",\n \"message\": \"ovs|84416|connmgr|INFO|br-int<->unix#7: 862 flow_mods in the 2 s starting 44 s ago (45 adds, 817 deletes)\"\n }\n]\n", "stderr": ""} +{"at": "2026-09-12T15:46:27.514476+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/1.0?target=lab01'\"'\"' | jq '\"'\"'.environment | {server_name,server_version,os_version,kernel_version}'\"'\"''", "cwd": null, "seconds": 0.107, "exit_code": 0, "stdout": "{\n \"server_name\": \"lab01\",\n \"server_version\": \"7.4\",\n \"os_version\": \"202608242359\",\n \"kernel_version\": \"7.1.10-zabbly+\"\n}\n", "stderr": ""} +{"at": "2026-09-12T15:56:33.263674+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'sudo -n systemctl is-active ovn-central ovn-northd ovn-ovsdb-server-nb ovn-ovsdb-server-sb'", "cwd": null, "seconds": 0.13, "exit_code": 0, "stdout": "active\nactive\nactive\nactive\n", "stderr": ""} +{"at": "2026-09-12T15:56:33.443559+00:00", "command": "incus query 'nas01:/1.0/projects?recursion=1'", "cwd": null, "seconds": 0.179, "exit_code": 0, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "stdout_projection": "Project reference counts replace unrelated resource names"} +{"at": "2026-09-12T15:56:33.444327+00:00", "phase": "authorized-lab01-reboot", "request": {"FLEET_OVN_REBOOT_MEMBER": "lab01", "FLEET_OVN_REBOOT_REQUEST_ID": "phase3-recreate-lab01-20260912", "FLEET_OVN_REBOOT_RECEIPT_DIR": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/reboot-receipts", "FLEET_OVN_REBOOT_CONFIRM": "1"}, "pre_boot_id": "f9f71dd5a051466283d7da6fb860c528", "failed_cycle": "gateway-pre-6", "passing_control": "gateway-pre-5"} +{"at": "2026-09-12T15:56:34.789834+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_reboot.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 1.345, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_reboot.py\n [@local] Ready: src/fleet_cluster/deploys/ovn_reboot.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Reboot nas01:lab01 request phase3-recreate-lab01-20260912 receipt /Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/reboot-receipts \n [@local] Success\n\n--> Results:\n Operation Hosts Success Error No Change \n Reboot nas01:lab01 request phase3-recreate-lab01-20260912 receipt /Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/reboot-receipts 1 1 - - \n Grand total 1 1 - - \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T15:59:31.211688+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/1.0?target=lab01'\"'\"' | jq '\"'\"'.environment | {server_name,server_version,os_version,kernel_version}'\"'\"''", "cwd": null, "seconds": 0.166, "exit_code": 0, "stdout": "{\n \"server_name\": \"lab01\",\n \"server_version\": \"7.4\",\n \"os_version\": \"202609100026\",\n \"kernel_version\": \"7.2.4-zabbly+\"\n}\n", "stderr": ""} +{"at": "2026-09-12T15:59:31.410510+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/1.0/instances/soak01?project=default'\"'\"' | jq '\"'\"'{name,status,location,expanded_devices}'\"'\"''", "cwd": null, "seconds": 0.197, "exit_code": 0, "stdout": "{\n \"name\": \"soak01\",\n \"status\": \"Running\",\n \"location\": \"lab01\",\n \"expanded_devices\": {\n \"eth0\": {\n \"name\": \"eth0\",\n \"network\": \"incusbr0\",\n \"type\": \"nic\"\n },\n \"eth1\": {\n \"nictype\": \"macvlan\",\n \"parent\": \"fast40\",\n \"type\": \"nic\"\n },\n \"root\": {\n \"path\": \"/\",\n \"pool\": \"data\",\n \"type\": \"disk\"\n }\n }\n}\n", "stderr": ""} +{"at": "2026-09-12T15:59:31.723331+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/1.0/instances/soak01/state?project=default'\"'\"' | jq '\"'\"'{status,eth1:(.network.eth1|{state,host_name,mtu,type})}'\"'\"''", "cwd": null, "seconds": 0.312, "exit_code": 0, "stdout": "{\n \"status\": \"Running\",\n \"eth1\": {\n \"state\": \"up\",\n \"host_name\": \"fast40\",\n \"mtu\": 1500,\n \"type\": \"broadcast\"\n }\n}\n", "stderr": ""} +{"at": "2026-09-12T16:13:30.695453+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 3.429, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn.py\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=nas01)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab01)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab02)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab03)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=nas01)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab01)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab02)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab03)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] noop: Incus network default/fast40-macvlan is absent\n [@local] Loaded fact pyinfra_incus.facts.ClusterMembers (remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=nas01)\n [@local] noop: Incus cluster network default/fast40-uplink is unchanged\n [@local] Ready: src/fleet_cluster/deploys/ovn.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Ensure nas01 OVN chassis enabled - - \n Ensure lab01 OVN chassis enabled - - \n Ensure lab02 OVN chassis enabled - - \n Ensure lab03 OVN chassis enabled - - \n Ensure nas01 OVN northbound connection - - \n Ensure lab01 OVN northbound connection - - \n Ensure lab02 OVN northbound connection - - \n Ensure lab03 OVN northbound connection - - \n Ensure unused fast40-macvlan is absent - - \n Ensure clustered physical uplink fast40-uplink - - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T16:13:31.392263+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_keeper.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 0.696, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_keeper.py\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] noop: Incus network default/keeper is absent\n [@local] Ready: src/fleet_cluster/deploys/ovn_keeper.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Ensure empty OVN keeper network absent - - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T16:13:31.529728+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'sudo -n systemctl is-active ovn-central ovn-northd ovn-ovsdb-server-nb ovn-ovsdb-server-sb; sudo -n ovn-nbctl show; sudo -n ovn-sbctl show'", "cwd": null, "seconds": 0.137, "exit_code": 0, "stdout": "active\nactive\nactive\nactive\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n", "stderr": ""} +{"at": "2026-09-12T16:13:31.631837+00:00", "command": "incus query 'nas01:/1.0/projects?recursion=1'", "cwd": null, "seconds": 0.102, "exit_code": 0, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "stdout_projection": "Project reference counts replace unrelated resource names"} +{"at": "2026-09-12T16:13:31.786115+00:00", "command": "incus network list nas01: --project default", "cwd": null, "seconds": 0.154, "exit_code": 0, "stdout": "+---------------+----------+---------+----------------+--------------------------+---------------------------------------------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------------+----------+---------+----------------+--------------------------+---------------------------------------------------+---------+---------+\n| fast40 | vlan | NO | | | | 2 | |\n+---------------+----------+---------+----------------+--------------------------+---------------------------------------------------+---------+---------+\n| fast40-uplink | physical | YES | | | physical OVN uplink on IncusOS fast40 | 0 | CREATED |\n+---------------+----------+---------+----------------+--------------------------+---------------------------------------------------+---------+---------+\n| image-build | bridge | YES | 10.57.139.1/24 | none | NAT bridge for the restricted image-build project | 1 | CREATED |\n+---------------+----------+---------+----------------+--------------------------+---------------------------------------------------+---------+---------+\n| incusbr0 | bridge | YES | 10.158.84.1/24 | fd42:37d0:7f47:b4d::1/64 | Local network bridge (NAT) | 7 | CREATED |\n+---------------+----------+---------+----------------+--------------------------+---------------------------------------------------+---------+---------+\n", "stderr": ""} +{"at": "2026-09-12T16:13:31.907094+00:00", "command": "incus cluster list nas01:", "cwd": null, "seconds": 0.121, "exit_code": 0, "stdout": "+-------+--------------------------+------------------+--------------+----------------+-------------+--------+-------------------+\n| NAME | URL | ROLES | ARCHITECTURE | FAILURE DOMAIN | DESCRIPTION | STATUS | MESSAGE |\n+-------+--------------------------+------------------+--------------+----------------+-------------+--------+-------------------+\n| lab01 | https://10.10.10.11:8443 | database-standby | x86_64 | default | | ONLINE | Fully operational |\n+-------+--------------------------+------------------+--------------+----------------+-------------+--------+-------------------+\n| lab02 | https://10.10.10.12:8443 | database | x86_64 | default | | ONLINE | Fully operational |\n+-------+--------------------------+------------------+--------------+----------------+-------------+--------+-------------------+\n| lab03 | https://10.10.10.13:8443 | database | x86_64 | default | | ONLINE | Fully operational |\n+-------+--------------------------+------------------+--------------+----------------+-------------+--------+-------------------+\n| nas01 | https://10.10.10.14:8443 | database-leader | x86_64 | default | | ONLINE | Fully operational |\n| | | database | | | | | |\n+-------+--------------------------+------------------+--------------+----------------+-------------+--------+-------------------+\n", "stderr": ""} +{"at": "2026-09-12T16:17:47.986945+00:00", "command": "bash spikes/ovn/probe.sh cycle --help", "cwd": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis", "seconds": 0.098, "exit_code": 0, "stdout": "usage: cycle.py [-h] --evidence-dir EVIDENCE_DIR [--keep-on-failure]\n\nCreate, probe, diagnose, and destroy the disposable OVN topology.\n\noptions:\n -h, --help show this help message and exit\n --evidence-dir EVIDENCE_DIR\n directory for cycle.json and capture logs\n --keep-on-failure leave owned resources in place when\n create/probe/capture fails\n\nInvoke as spikes/ovn/probe.sh cycle --evidence-dir PATH [--keep-on-failure].\nDoes not stop OVN central, run keeper, or clear neighbor caches.\n", "stderr": ""} +{"at": "2026-09-12T16:19:24.987580+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'pgrep -af '\"'\"'[t]cpdump.*enp2s0'\"'\"''", "cwd": null, "seconds": 0.176, "exit_code": 1, "stdout": "", "stderr": ""} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/commands.jsonl new file mode 100644 index 0000000..2cc63bc --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.106, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T16:01:36.403183+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.313, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T16:01:36.717094+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.141, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T16:01:36.858256+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 71187, "ready": true, "ready_signal": "time=\"2026-09-12T09:01:36-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T16:01:36.958356+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/topology.jsonl", "create"], "seconds": 9.764, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.569,\n \"first_cross_member_ping_seconds\": 3.047,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:46.722308+00:00"} +{"capture": "monitor-create", "pid": 71187, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.log", "ready_signal": "time=\"2026-09-12T09:01:36-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T16:01:46.727387+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.093, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:46.820803+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.098, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d9:78:08 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8f:56:95 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:46.918749+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.152, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 2d55097d-204e-41d0-8eb5-9cc1c55adc9d (incus-net38-ls-int)\n port incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0\n addresses: [\"10:66:6a:8f:56:95 dynamic\"]\n port incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0\n addresses: [\"10:66:6a:d9:78:08 dynamic\"]\n port incus-net38-ls-int-lsp-router\n type: router\n router-port: incus-net38-lr-lrp-int\nswitch 2611bfc6-bdb5-44f6-a09e-9eb8763a2cb2 (incus-net38-ls-ext)\n port incus-net38-ls-ext-lsp-router\n type: router\n router-port: incus-net38-lr-lrp-ext\n port incus-net38-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter 13cb6f52-142b-42be-9fc9-d07b5a432cc9 (incus-net38-lr)\n port incus-net38-lr-lrp-int\n mac: \"10:66:6a:43:84:fe\"\n ipv6-lla: \"fe80::1266:6aff:fe43:84fe\"\n networks: [\"10.253.73.1/24\"]\n port incus-net38-lr-lrp-ext\n mac: \"10:66:6a:43:84:fe\"\n ipv6-lla: \"fe80::1266:6aff:fe43:84fe\"\n networks: [\"10.10.40.64/24\"]\n nat 5fae479d-e83a-4345-9aff-819b51257038\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net38-lr-lrp-ext\n Port_Binding incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 71527675-42da-4982-894c-c52663cdd4c2\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 80ca99c2-2647-418e-83bc-912afdfa528d\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:43:84:fe\"\nname : incus-net38-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : 13e4bb8d-2e09-4bae-85d8-ded30bc8185f\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:43:84:fe\"\nname : incus-net38-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 62b79c31-2ea0-46f1-a016-51d740ca723e\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 69f2ce8e-ada9-4fff-864e-591908009cd1\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 8cf3d44d-d3cc-4e98-8ce8-345cfd643311\nlogical_port : cr-incus-net38-lr-lrp-ext\nmac : [\"10:66:6a:43:84:fe 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net38-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : 80ca99c2-2647-418e-83bc-912afdfa528d\nexternal_ids : {}\nha_chassis : [04daa0d0-7900-4bae-8267-6dafc1b6f9dd, 1f7024f7-1abf-4c67-a9b7-1e1065b829d5, 3695bc80-f75a-4ed9-9cf4-9b373c4274b1, ffee2173-5fe8-4a45-8659-20e9ec744920]\nname : incus-net38\n=== ovn-nbctl list HA_Chassis ===\n_uuid : 3695bc80-f75a-4ed9-9cf4-9b373c4274b1\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 17040\n\n_uuid : 04daa0d0-7900-4bae-8267-6dafc1b6f9dd\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 11633\n\n_uuid : 1f7024f7-1abf-4c67-a9b7-1e1065b829d5\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 32081\n\n_uuid : ffee2173-5fe8-4a45-8659-20e9ec744920\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 30804\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T16:01:47.071274+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.305, "exit_code": 0, "stdout": "10.10.40.64 dev br40 INCOMPLETE \n", "stderr": "", "error": null, "at": "2026-09-12T16:01:47.376311+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.175, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899275202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00043|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899275575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00044|bridge|INFO|bridge incusovn16: using datapath ID 00002ee577a07046\"\n },\n {\n \"at\": \"1789228899275595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00045|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899277423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00046|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899277483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899277503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899277530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899277545\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899277564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899277581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899277650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899277695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899277708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899277732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899277773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899277813\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00047|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899277828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899277839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899277857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899277869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899277880\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899277892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899277938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899277978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899277990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278001\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899278011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899278047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899278081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor33)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899278094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00048|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899278108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899278119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899278129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899278140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899278150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899278161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278176\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899278211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278227\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899278255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899278266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899278289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278304\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899278327\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278342\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278353\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899290962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler1)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899291032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler1)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899291065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899291097\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899291120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x35a20d9 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899291148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899291212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899291249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291264\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899291370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899291390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899291425\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291443\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291463\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899291480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899291509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899291554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899291571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291610\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899291630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899291647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899291679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291694\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899291731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899291781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899291798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899291831\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291865\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899291882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899291899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899291937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler1)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899296184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler1)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899296212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899296238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899296260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x4f842aca your_disc:0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899296314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899296338\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899296363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296383\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899296405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214299ms\"\n },\n {\n \"at\": \"1789228899296479\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789228899296503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -18ms\"\n },\n {\n \"at\": \"1789228899296526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899296547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899296564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296580\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899296652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899296673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899296711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899296728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler1)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899296781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899296798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296816\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899296833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899296884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789228899296902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -18ms\"\n },\n {\n \"at\": \"1789228899296920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899296938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899296955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899297089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler1)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899297156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler1)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899297177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899297195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899297212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xd5bc00a8 your_disc:0x752e80e1\"\n },\n {\n \"at\": \"1789228899297232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899297250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899297267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899297285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899297323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214300ms\"\n },\n {\n \"at\": \"1789228899297381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +921ms\"\n },\n {\n \"at\": \"1789228899297401\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -19ms\"\n },\n {\n \"at\": \"1789228899297419\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899297434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899297451\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899297486\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297501\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297516\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899297585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899297602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297635\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler1)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899297655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899297670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899297702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297736\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899297753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +921ms\"\n },\n {\n \"at\": \"1789228899297771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -19ms\"\n },\n {\n \"at\": \"1789228899297828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899297844\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899297859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297877\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899297893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899297994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899298011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899298026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899373949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899374056\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899374277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899374330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899375364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899375439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899376218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899376241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899377021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899377055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899377866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00059|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228899377910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899377923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00061|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2\"\n },\n {\n \"at\": \"1789228899379010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899379810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899380595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228900202282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900202409\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900202420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900202428\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900202441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900202452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900202464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900202472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +116ms\"\n },\n {\n \"at\": \"1789228900202480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -824ms\"\n },\n {\n \"at\": \"1789228900202488\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900202498\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900202507\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900202515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228900202524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202531\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900202549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900202558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900202565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228900202577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900202589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900376948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00065|dpif|WARN|Dropped 1950 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228900377154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228900629527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00067|bridge|INFO|bridge br-int: added interface veth907501d5 on port 3\"\n },\n {\n \"at\": \"1789228901376650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00068|dpif|WARN|Dropped 1882 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228901376717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228902376343\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00070|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228902376664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228902381712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00072|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902382186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00073|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902382722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00074|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902383206\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00075|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902383720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00076|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902384129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00077|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902384744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00078|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902385146\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902385744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00080|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902386175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00081|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228903376673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00082|dpif|WARN|Dropped 1927 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228903376846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228904376908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00084|dpif|WARN|Dropped 1937 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228904377088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228905376863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00086|dpif|WARN|Dropped 1947 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228905376940\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228906376435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00088|dpif|WARN|Dropped 1917 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228906376535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228907376363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00090|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228907376589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:47.552045+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.194, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899183506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899183615\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge incusovn16: using datapath ID 00009208b9915e49\"\n },\n {\n \"at\": \"1789228899183626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00264|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899185431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00265|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185588\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185606\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185656\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185680\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185707\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899185786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185804\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185843\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185863\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185896\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185923\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00266|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899186002\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899186025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899186042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899186084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186118\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186136\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899186209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899186226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899186263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899186280\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler359)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899186650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler359)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899186677\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899186701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899186723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x17f0052 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899186742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899186760\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899186780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899186797\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899186815\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899186833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186850\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186871\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154186ms\"\n },\n {\n \"at\": \"1789228899186890\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +909ms\"\n },\n {\n \"at\": \"1789228899186911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789228899186929\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186946\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899186964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186982\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899186999\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187034\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899187050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899187071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187088\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899187109\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899187126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899187167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899187185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899187201\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899187218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899187235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899187252\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899187269\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899187290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +909ms\"\n },\n {\n \"at\": \"1789228899187307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789228899187324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899187339\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899187354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899187388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187434\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899187451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899187468\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899187501\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187521\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187540\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261253\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00267|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899261289\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899261312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899261352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899261373\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899261400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261454\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261485\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899261504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899261566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899261585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261606\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899261625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261675\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899261697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899268288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler358)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899268361\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler358)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899268387\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899268417\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899268436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x23ec2b8f your_disc:0x0\"\n },\n {\n \"at\": \"1789228899268457\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899268514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268552\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268623\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268685\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268704\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268724\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899268745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268764\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268785\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268804\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268823\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268842\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899268862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899268881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268920\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899268940\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899268959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268976\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268992\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899269005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899269015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899269030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899269038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899269046\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899269054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899269061\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899269086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899269094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899269102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899269110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269119\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899281411\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00268|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899281448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228899283745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899283775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00271|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228900088485\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900088626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900088640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900088651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900088662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900088672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900088682\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900088696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228900088705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -802ms\"\n },\n {\n \"at\": \"1789228900088715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900088730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900088746\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900088756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228900088765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088784\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900088794\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900088803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900088812\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228900088821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900088830\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088838\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900160502\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler359)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900160596\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler359)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900160626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900160652\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900160674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xfbce566e your_disc:0xc3aebc58\"\n },\n {\n \"at\": \"1789228900160698\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900160720\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900160747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900160769\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900160790\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900160810\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900160834\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900160856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592155159ms\"\n },\n {\n \"at\": \"1789228900160877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228900160901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228900160931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900160952\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900160973\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900160998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900161020\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161041\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900161082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900161104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900161144\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900161165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900161205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler359)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900161230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900161249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900161270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900161291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900161312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900161340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900161361\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228900161380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228900161421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900161451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900161478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161501\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900161523\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900161584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900161604\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900161644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161664\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900886981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900887298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900887327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900887348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900887370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900887416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900887437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900887459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +39ms\"\n },\n {\n \"at\": \"1789228900887482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -791ms\"\n },\n {\n \"at\": \"1789228900887514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900887534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900887553\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900887572\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900887591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887611\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887629\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900887650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900887672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900887693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900887713\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900887734\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:47.747006+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.19, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899183349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00290|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899183846\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00291|bridge|INFO|bridge incusovn16: using datapath ID 00002654629f1141\"\n },\n {\n \"at\": \"1789228899183886\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00292|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899185533\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00293|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185595\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185631\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185646\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185658\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185669\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185680\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899185723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185734\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185755\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185765\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185776\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185786\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185796\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185809\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185822\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00294|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185835\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185847\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185886\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185925\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899185956\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185987\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185997\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899261010\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00295|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899261076\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899261108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899261156\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899261178\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899261201\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261226\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261280\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899261302\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261323\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261345\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899261368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899261392\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261416\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899261439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899261516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261539\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261564\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899267924\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler354)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899267964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler354)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899267979\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899267996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899268011\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x752e80e1 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899268023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268035\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899268057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268077\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268099\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268166\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268192\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899268204\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268216\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268238\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268268\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899268281\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899268290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268340\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899268353\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899268363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899268419\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268453\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268466\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899268486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268522\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899268567\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268580\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899280146\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00296|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899280179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00297|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228899286270\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00298|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899286333\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00299|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228900001516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler362)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900001623\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler362)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900001660\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900001689\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900001715\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x1172530f your_disc:0xcfd32de8\"\n },\n {\n \"at\": \"1789228900001741\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900001818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900001846\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900001875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900001897\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900001921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900001942\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900001966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054999ms\"\n },\n {\n \"at\": \"1789228900001989\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +134ms\"\n },\n {\n \"at\": \"1789228900002021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -816ms\"\n },\n {\n \"at\": \"1789228900002047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900002082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900002108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900002160\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002183\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900002226\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900002252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002280\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900002306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900002389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900002445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler362)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900002474\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900002498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900002521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900002545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900002568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900002590\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900002616\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +134ms\"\n },\n {\n \"at\": \"1789228900002644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -816ms\"\n },\n {\n \"at\": \"1789228900002674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900002705\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900002736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900002804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002838\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900002894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900002926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002954\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900002986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900003021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900003045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900096225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler357)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900096322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler357)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900096362\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900096389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900096410\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x87bd04ca your_disc:0x17f0052\"\n },\n {\n \"at\": \"1789228900096438\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900096463\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900096486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900096510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900096531\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900096560\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900096587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900096609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51055094ms\"\n },\n {\n \"at\": \"1789228900096635\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +699ms\"\n },\n {\n \"at\": \"1789228900096664\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51ms\"\n },\n {\n \"at\": \"1789228900096692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900096716\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900096738\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900096767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900096794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900096816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900096843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900096870\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900096939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900096962\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900096986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900097021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900097080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler357)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900097108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900097133\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900097193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900097218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900097241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900097265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900097288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +699ms\"\n },\n {\n \"at\": \"1789228900097315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51ms\"\n },\n {\n \"at\": \"1789228900097341\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900097363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900097385\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900097408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900097431\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097484\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900097507\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900097536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900097563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900097584\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097605\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900208233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900208584\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900208617\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900208642\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900208667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900208688\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900208712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900208744\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +78ms\"\n },\n {\n \"at\": \"1789228900208769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -922ms\"\n },\n {\n \"at\": \"1789228900208795\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900208819\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900208852\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900208876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228900208899\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900208921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900208944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900208966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900208990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900209019\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228900209043\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900209085\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900209113\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228901384909\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00300|bridge|INFO|bridge br-int: added interface veth5c0c349e on port 38\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:47.937316+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.197, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899062010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00266|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899062147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00267|bridge|INFO|bridge incusovn16: using datapath ID 0000c2a8a0e84b40\"\n },\n {\n \"at\": \"1789228899062160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00268|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899159484\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899159607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228899164947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00271|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899165007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00272|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789228899185637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00273|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185659\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185676\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185702\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185725\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185737\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185761\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185782\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899185806\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185818\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185827\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185839\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185849\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185860\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185870\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185885\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00274|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185931\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185956\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185966\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186006\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899186068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899186078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186087\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899186097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186107\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186117\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186157\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899191871\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler369)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899192013\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler369)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899192036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899192066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899192083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xcfd32de8 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899192144\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899192166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899192182\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899192197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899192228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192244\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281055ms\"\n },\n {\n \"at\": \"1789228899192278\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +815ms\"\n },\n {\n \"at\": \"1789228899192295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228899192316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899192330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899192348\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899192378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899192427\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899192447\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899192479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899192494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899192545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899192559\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899192589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192618\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899192640\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +814ms\"\n },\n {\n \"at\": \"1789228899192656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228899192674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899192689\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899192703\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192720\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899192734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899192780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899192794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899192823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192862\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899267280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00275|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899267322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899267341\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899267352\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899267362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899267378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899267389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267431\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267442\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899267454\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899267464\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899267475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899267490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899267500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899267525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899267535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899267545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899267554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267576\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899291694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler369)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899291856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler369)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899291879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899291894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899291910\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xc3aebc58 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899291935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291950\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291965\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899291980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899292010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292025\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281155ms\"\n },\n {\n \"at\": \"1789228899292054\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +874ms\"\n },\n {\n \"at\": \"1789228899292076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -106ms\"\n },\n {\n \"at\": \"1789228899292092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899292113\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899292134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292153\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899292169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292184\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899292213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899292228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292242\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899292265\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899292279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292297\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899292312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899292330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899292349\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899292364\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899292379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899292423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +874ms\"\n },\n {\n \"at\": \"1789228899292437\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -106ms\"\n },\n {\n \"at\": \"1789228899292457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899292471\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899292488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899292517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292546\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899292567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899292581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899292610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292646\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899373920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler369)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899374037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler369)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899374055\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899374078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899374093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x36cbd78 your_disc:0x35a20d9\"\n },\n {\n \"at\": \"1789228899374111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899374128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899374141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899374156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374172\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899374193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374215\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374230\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281237ms\"\n },\n {\n \"at\": \"1789228899374246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +823ms\"\n },\n {\n \"at\": \"1789228899374262\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -87ms\"\n },\n {\n \"at\": \"1789228899374282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899374298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899374313\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899374344\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374354\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899374374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899374390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899374412\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899374422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler369)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899374465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899374483\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374496\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899374510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899374554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +822ms\"\n },\n {\n \"at\": \"1789228899374571\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -88ms\"\n },\n {\n \"at\": \"1789228899374592\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899374607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899374617\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374626\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899374636\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374648\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374658\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899374667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899374677\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374687\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899374697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374707\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374716\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900141572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900142029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900142072\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900142110\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900142139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900142168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900142197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900142227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +815ms\"\n },\n {\n \"at\": \"1789228900142256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -135ms\"\n },\n {\n \"at\": \"1789228900142285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900142312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900142358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900142382\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900142406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900142488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900142510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900142528\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900142548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900142566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142586\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900242168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900242357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900242396\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900242426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900242453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900242484\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900242514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900242541\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +853ms\"\n },\n {\n \"at\": \"1789228900242578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789228900242609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900242638\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900242667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900242694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900242717\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242729\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242739\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900242754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900242768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900242784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900242799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900242814\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:48.135209+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-before-probe.txt", "router_mac": "10:66:6a:43:84:fe", "at": "2026-09-12T16:01:48.136544+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.103, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T16:01:40.121693432Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T16:01:40.752800494Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T16:01:40.94318346Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T16:01:41.46956009Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T16:01:48.239195+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 71881, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T16:01:48.400418+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 42.965, "exit_code": 1, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.097 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.096 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\"volatile.eth0.host_name\":\"veth907501d5\",\"volatile.eth0.hwaddr\":\"10:66:6a:d9:78:08\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90400719-d170-40f8-8690-7e17fde270db\",\"volatile.uuid.generation\":\"90400719-d170-40f8-8690-7e17fde270db\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T16:01:40.121693432Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\"volatile.eth0.host_name\":\"veth907501d5\",\"volatile.eth0.hwaddr\":\"10:66:6a:d9:78:08\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90400719-d170-40f8-8690-7e17fde270db\",\"volatile.uuid.generation\":\"90400719-d170-40f8-8690-7e17fde270db\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T16:01:40.752800494Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9334784,\"usage_peak\":0,\"total\":65256516000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fed9:7808\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:d9:78:08\",\"host_name\":\"veth907501d5\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":3719,\"processes\":4,\"cpu\":{\"usage\":492034000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T16:01:39.75999999Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"485b965e-64de-42a8-8c9a-938f4e93afce\",\"volatile.eth0.host_name\":\"veth5c0c349e\",\"volatile.eth0.hwaddr\":\"10:66:6a:8f:56:95\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\"volatile.uuid.generation\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T16:01:40.94318346Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"485b965e-64de-42a8-8c9a-938f4e93afce\",\"volatile.eth0.host_name\":\"veth5c0c349e\",\"volatile.eth0.hwaddr\":\"10:66:6a:8f:56:95\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\"volatile.uuid.generation\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T16:01:41.46956009Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11636736,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe8f:5695\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:8f:56:95\",\"host_name\":\"veth5c0c349e\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":37953,\"processes\":4,\"cpu\":{\"usage\":494971000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T16:01:41.480000019Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.147 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.262 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.271 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.294 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.828 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.502 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.502/0.874/1.294 ms\nelapsed_seconds=2.286 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.053 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.795 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.356 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.356/0.734/1.053 ms\nelapsed_seconds=2.273 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.229 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.268 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.269 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.267 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.306 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5003 milliseconds\nelapsed_seconds=5.273 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5011 ms: Timeout was reached\nelapsed_seconds=5.028 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.211140 bytes_per_second=473619399\nelapsed_seconds=0.668 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.497 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.142038 bytes_per_second=704036947\nelapsed_seconds=0.435 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.522 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n", "error": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed", "at": "2026-09-12T16:02:31.365062+00:00"} +{"capture": "tcpdump-arp", "pid": 71881, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T16:02:31.367381+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.104, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab01\n - lab02\n - lab03\n - nas01\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:31.472226+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.094, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d9:78:08 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8f:56:95 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:31.566939+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.148, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 2d55097d-204e-41d0-8eb5-9cc1c55adc9d (incus-net38-ls-int)\n port incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0\n addresses: [\"10:66:6a:8f:56:95 dynamic\"]\n port incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0\n addresses: [\"10:66:6a:d9:78:08 dynamic\"]\n port incus-net38-ls-int-lsp-router\n type: router\n router-port: incus-net38-lr-lrp-int\nswitch 2611bfc6-bdb5-44f6-a09e-9eb8763a2cb2 (incus-net38-ls-ext)\n port incus-net38-ls-ext-lsp-router\n type: router\n router-port: incus-net38-lr-lrp-ext\n port incus-net38-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter 13cb6f52-142b-42be-9fc9-d07b5a432cc9 (incus-net38-lr)\n port incus-net38-lr-lrp-int\n mac: \"10:66:6a:43:84:fe\"\n ipv6-lla: \"fe80::1266:6aff:fe43:84fe\"\n networks: [\"10.253.73.1/24\"]\n port incus-net38-lr-lrp-ext\n mac: \"10:66:6a:43:84:fe\"\n ipv6-lla: \"fe80::1266:6aff:fe43:84fe\"\n networks: [\"10.10.40.64/24\"]\n nat 5fae479d-e83a-4345-9aff-819b51257038\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net38-lr-lrp-ext\n Port_Binding incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 71527675-42da-4982-894c-c52663cdd4c2\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 80ca99c2-2647-418e-83bc-912afdfa528d\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:43:84:fe\"\nname : incus-net38-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : 13e4bb8d-2e09-4bae-85d8-ded30bc8185f\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:43:84:fe\"\nname : incus-net38-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 62b79c31-2ea0-46f1-a016-51d740ca723e\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 69f2ce8e-ada9-4fff-864e-591908009cd1\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 8cf3d44d-d3cc-4e98-8ce8-345cfd643311\nlogical_port : cr-incus-net38-lr-lrp-ext\nmac : [\"10:66:6a:43:84:fe 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net38-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : 80ca99c2-2647-418e-83bc-912afdfa528d\nexternal_ids : {}\nha_chassis : [04daa0d0-7900-4bae-8267-6dafc1b6f9dd, 1f7024f7-1abf-4c67-a9b7-1e1065b829d5, 3695bc80-f75a-4ed9-9cf4-9b373c4274b1, ffee2173-5fe8-4a45-8659-20e9ec744920]\nname : incus-net38\n=== ovn-nbctl list HA_Chassis ===\n_uuid : 3695bc80-f75a-4ed9-9cf4-9b373c4274b1\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 17040\n\n_uuid : 04daa0d0-7900-4bae-8267-6dafc1b6f9dd\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 11633\n\n_uuid : 1f7024f7-1abf-4c67-a9b7-1e1065b829d5\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 32081\n\n_uuid : ffee2173-5fe8-4a45-8659-20e9ec744920\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 30804\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T16:02:31.714865+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.292, "exit_code": 0, "stdout": "10.10.40.64 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T16:02:32.007025+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.223, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899275202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00043|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899275575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00044|bridge|INFO|bridge incusovn16: using datapath ID 00002ee577a07046\"\n },\n {\n \"at\": \"1789228899275595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00045|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899277423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00046|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899277483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899277503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899277530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899277545\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899277564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899277581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899277650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899277695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899277708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899277732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899277773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899277813\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00047|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899277828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899277839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899277857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899277869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899277880\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899277892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899277938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899277978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899277990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278001\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899278011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899278047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899278081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor33)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899278094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00048|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899278108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899278119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899278129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899278140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899278150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899278161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278176\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899278211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278227\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899278255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899278266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899278289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278304\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899278327\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278342\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278353\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899290962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler1)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899291032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler1)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899291065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899291097\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899291120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x35a20d9 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899291148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899291212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899291249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291264\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899291370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899291390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899291425\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291443\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291463\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899291480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899291509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899291554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899291571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291610\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899291630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899291647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899291679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291694\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899291731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899291781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899291798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899291831\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291865\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899291882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899291899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899291937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler1)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899296184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler1)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899296212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899296238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899296260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x4f842aca your_disc:0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899296314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899296338\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899296363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296383\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899296405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214299ms\"\n },\n {\n \"at\": \"1789228899296479\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789228899296503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -18ms\"\n },\n {\n \"at\": \"1789228899296526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899296547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899296564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296580\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899296652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899296673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899296711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899296728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler1)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899296781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899296798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296816\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899296833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899296884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789228899296902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -18ms\"\n },\n {\n \"at\": \"1789228899296920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899296938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899296955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899297089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler1)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899297156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler1)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899297177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899297195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899297212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xd5bc00a8 your_disc:0x752e80e1\"\n },\n {\n \"at\": \"1789228899297232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899297250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899297267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899297285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899297323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214300ms\"\n },\n {\n \"at\": \"1789228899297381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +921ms\"\n },\n {\n \"at\": \"1789228899297401\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -19ms\"\n },\n {\n \"at\": \"1789228899297419\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899297434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899297451\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899297486\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297501\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297516\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899297585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899297602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297635\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler1)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899297655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899297670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899297702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297736\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899297753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +921ms\"\n },\n {\n \"at\": \"1789228899297771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -19ms\"\n },\n {\n \"at\": \"1789228899297828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899297844\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899297859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297877\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899297893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899297994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899298011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899298026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899373949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899374056\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899374277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899374330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899375364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899375439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899376218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899376241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899377021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899377055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899377866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00059|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228899377910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899377923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00061|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2\"\n },\n {\n \"at\": \"1789228899379010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899379810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899380595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228900202282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900202409\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900202420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900202428\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900202441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900202452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900202464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900202472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +116ms\"\n },\n {\n \"at\": \"1789228900202480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -824ms\"\n },\n {\n \"at\": \"1789228900202488\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900202498\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900202507\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900202515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228900202524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202531\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900202549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900202558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900202565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228900202577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900202589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900376948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00065|dpif|WARN|Dropped 1950 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228900377154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228900629527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00067|bridge|INFO|bridge br-int: added interface veth907501d5 on port 3\"\n },\n {\n \"at\": \"1789228901376650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00068|dpif|WARN|Dropped 1882 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228901376717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228902376343\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00070|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228902376664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228902381712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00072|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902382186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00073|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902382722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00074|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902383206\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00075|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902383720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00076|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902384129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00077|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902384744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00078|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902385146\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902385744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00080|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902386175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00081|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228903376673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00082|dpif|WARN|Dropped 1927 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228903376846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228904376908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00084|dpif|WARN|Dropped 1937 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228904377088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228905376863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00086|dpif|WARN|Dropped 1947 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228905376940\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228906376435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00088|dpif|WARN|Dropped 1917 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228906376535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228907376363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00090|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228907376589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228908376575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00092|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228908376751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00093|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228908381777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00094|poll_loop|INFO|Dropped 11601 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228908381849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00095|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228909279516\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00096|connmgr|INFO|br-int<->unix#3: 908 flow_mods in the 7 s starting 10 s ago (843 adds, 58 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228909376882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00097|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228909377216\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228910376619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00099|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228910376764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228911376730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00101|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228911376966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228912376652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00103|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228912376775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228913376892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00105|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228913377129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228914376463\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00107|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228914376559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228914381820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00109|poll_loop|INFO|Dropped 11629 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228914381969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00110|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228915376849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00111|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228915376982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228916376802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00113|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228916377038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228917376942\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00115|dpif|WARN|Dropped 1954 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228917377182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228918376883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00117|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228918377000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228919376978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00119|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228919377105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228920376539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00121|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228920376668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228920381731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00123|poll_loop|INFO|Dropped 11662 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228920381873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00124|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228921376811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00125|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228921376948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00126|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228922376774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00127|dpif|WARN|Dropped 1963 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228922377000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228923376697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00129|dpif|WARN|Dropped 1945 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228923376796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228924376806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00131|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228924377017\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228925376814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00133|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228925376995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228926377059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00135|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228926377392\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228926381908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00137|poll_loop|INFO|Dropped 11619 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228926381948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00138|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228927376594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00139|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228927376673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228928376675\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00141|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228928376857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228929376605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00143|dpif|WARN|Dropped 1922 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228929376761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228930376822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00145|dpif|WARN|Dropped 1900 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228930377119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228931376357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00147|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228931376458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228932376480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00149|dpif|WARN|Dropped 1913 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228932376688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228932381398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00151|poll_loop|INFO|Dropped 11514 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228932381487\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00152|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228933376822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00153|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228933377019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00154|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228934376824\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00155|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228934377036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228935376543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00157|dpif|WARN|Dropped 1920 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228935376664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228936376852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00159|dpif|WARN|Dropped 1912 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228936377081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228937376602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00161|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228937376710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228938376631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00163|dpif|WARN|Dropped 1955 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228938376857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228938381918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00165|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228938382013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228939376692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00167|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228939376900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228940376789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00169|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228940376992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228941376928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00171|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228941377177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228942376783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00173|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228942376884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228943376779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00175|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228943377003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228944376466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00177|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228944376610\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228944381734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00179|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228944381884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00180|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228945376657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00181|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228945376794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00182|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228946376641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00183|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228946376823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228947376818\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00185|dpif|WARN|Dropped 1946 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228947377021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00186|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228948376758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00187|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228948376849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00188|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228949376467\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00189|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228949376597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00190|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228950376804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00191|dpif|WARN|Dropped 1916 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228950377088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00192|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228950381874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00193|poll_loop|INFO|Dropped 11631 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228950381960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00194|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228951376871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00195|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228951377101\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00196|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:32.230732+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.199, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899183506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899183615\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge incusovn16: using datapath ID 00009208b9915e49\"\n },\n {\n \"at\": \"1789228899183626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00264|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899185431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00265|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185588\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185606\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185656\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185680\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185707\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899185786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185804\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185843\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185863\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185896\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185923\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00266|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899186002\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899186025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899186042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899186084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186118\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186136\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899186209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899186226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899186263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899186280\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler359)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899186650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler359)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899186677\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899186701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899186723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x17f0052 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899186742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899186760\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899186780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899186797\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899186815\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899186833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186850\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186871\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154186ms\"\n },\n {\n \"at\": \"1789228899186890\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +909ms\"\n },\n {\n \"at\": \"1789228899186911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789228899186929\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186946\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899186964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186982\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899186999\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187034\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899187050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899187071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187088\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899187109\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899187126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899187167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899187185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899187201\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899187218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899187235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899187252\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899187269\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899187290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +909ms\"\n },\n {\n \"at\": \"1789228899187307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789228899187324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899187339\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899187354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899187388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187434\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899187451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899187468\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899187501\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187521\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187540\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261253\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00267|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899261289\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899261312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899261352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899261373\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899261400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261454\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261485\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899261504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899261566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899261585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261606\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899261625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261675\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899261697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899268288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler358)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899268361\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler358)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899268387\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899268417\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899268436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x23ec2b8f your_disc:0x0\"\n },\n {\n \"at\": \"1789228899268457\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899268514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268552\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268623\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268685\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268704\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268724\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899268745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268764\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268785\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268804\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268823\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268842\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899268862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899268881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268920\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899268940\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899268959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268976\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268992\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899269005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899269015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899269030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899269038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899269046\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899269054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899269061\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899269086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899269094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899269102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899269110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269119\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899281411\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00268|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899281448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228899283745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899283775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00271|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228900088485\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900088626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900088640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900088651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900088662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900088672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900088682\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900088696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228900088705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -802ms\"\n },\n {\n \"at\": \"1789228900088715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900088730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900088746\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900088756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228900088765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088784\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900088794\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900088803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900088812\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228900088821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900088830\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088838\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900160502\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler359)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900160596\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler359)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900160626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900160652\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900160674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xfbce566e your_disc:0xc3aebc58\"\n },\n {\n \"at\": \"1789228900160698\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900160720\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900160747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900160769\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900160790\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900160810\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900160834\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900160856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592155159ms\"\n },\n {\n \"at\": \"1789228900160877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228900160901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228900160931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900160952\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900160973\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900160998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900161020\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161041\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900161082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900161104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900161144\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900161165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900161205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler359)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900161230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900161249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900161270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900161291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900161312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900161340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900161361\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228900161380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228900161421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900161451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900161478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161501\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900161523\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900161584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900161604\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900161644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161664\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900886981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900887298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900887327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900887348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900887370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900887416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900887437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900887459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +39ms\"\n },\n {\n \"at\": \"1789228900887482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -791ms\"\n },\n {\n \"at\": \"1789228900887514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900887534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900887553\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900887572\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900887591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887611\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887629\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900887650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900887672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900887693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900887713\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900887734\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228909189654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00272|connmgr|INFO|br-int<->unix#7: 877 flow_mods in the 7 s starting 10 s ago (813 adds, 57 deletes, 7 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:32.430632+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.198, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899183349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00290|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899183846\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00291|bridge|INFO|bridge incusovn16: using datapath ID 00002654629f1141\"\n },\n {\n \"at\": \"1789228899183886\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00292|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899185533\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00293|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185595\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185631\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185646\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185658\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185669\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185680\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899185723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185734\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185755\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185765\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185776\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185786\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185796\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185809\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185822\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00294|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185835\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185847\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185886\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185925\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899185956\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185987\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185997\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899261010\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00295|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899261076\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899261108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899261156\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899261178\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899261201\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261226\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261280\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899261302\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261323\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261345\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899261368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899261392\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261416\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899261439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899261516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261539\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261564\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899267924\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler354)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899267964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler354)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899267979\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899267996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899268011\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x752e80e1 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899268023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268035\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899268057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268077\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268099\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268166\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268192\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899268204\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268216\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268238\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268268\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899268281\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899268290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268340\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899268353\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899268363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899268419\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268453\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268466\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899268486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268522\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899268567\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268580\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899280146\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00296|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899280179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00297|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228899286270\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00298|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899286333\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00299|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228900001516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler362)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900001623\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler362)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900001660\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900001689\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900001715\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x1172530f your_disc:0xcfd32de8\"\n },\n {\n \"at\": \"1789228900001741\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900001818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900001846\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900001875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900001897\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900001921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900001942\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900001966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054999ms\"\n },\n {\n \"at\": \"1789228900001989\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +134ms\"\n },\n {\n \"at\": \"1789228900002021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -816ms\"\n },\n {\n \"at\": \"1789228900002047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900002082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900002108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900002160\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002183\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900002226\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900002252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002280\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900002306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900002389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900002445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler362)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900002474\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900002498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900002521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900002545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900002568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900002590\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900002616\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +134ms\"\n },\n {\n \"at\": \"1789228900002644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -816ms\"\n },\n {\n \"at\": \"1789228900002674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900002705\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900002736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900002804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002838\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900002894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900002926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002954\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900002986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900003021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900003045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900096225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler357)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900096322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler357)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900096362\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900096389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900096410\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x87bd04ca your_disc:0x17f0052\"\n },\n {\n \"at\": \"1789228900096438\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900096463\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900096486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900096510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900096531\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900096560\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900096587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900096609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51055094ms\"\n },\n {\n \"at\": \"1789228900096635\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +699ms\"\n },\n {\n \"at\": \"1789228900096664\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51ms\"\n },\n {\n \"at\": \"1789228900096692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900096716\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900096738\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900096767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900096794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900096816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900096843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900096870\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900096939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900096962\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900096986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900097021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900097080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler357)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900097108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900097133\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900097193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900097218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900097241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900097265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900097288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +699ms\"\n },\n {\n \"at\": \"1789228900097315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51ms\"\n },\n {\n \"at\": \"1789228900097341\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900097363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900097385\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900097408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900097431\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097484\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900097507\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900097536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900097563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900097584\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097605\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900208233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900208584\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900208617\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900208642\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900208667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900208688\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900208712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900208744\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +78ms\"\n },\n {\n \"at\": \"1789228900208769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -922ms\"\n },\n {\n \"at\": \"1789228900208795\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900208819\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900208852\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900208876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228900208899\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900208921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900208944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900208966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900208990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900209019\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228900209043\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900209085\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900209113\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228901384909\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00300|bridge|INFO|bridge br-int: added interface veth5c0c349e on port 38\"\n },\n {\n \"at\": \"1789228909189260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00301|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 7 s starting 10 s ago (849 adds, 81 deletes, 7 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:32.629355+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.194, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899062010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00266|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899062147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00267|bridge|INFO|bridge incusovn16: using datapath ID 0000c2a8a0e84b40\"\n },\n {\n \"at\": \"1789228899062160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00268|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899159484\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899159607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228899164947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00271|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899165007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00272|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789228899185637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00273|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185659\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185676\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185702\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185725\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185737\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185761\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185782\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899185806\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185818\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185827\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185839\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185849\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185860\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185870\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185885\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00274|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185931\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185956\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185966\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186006\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899186068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899186078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186087\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899186097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186107\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186117\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186157\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899191871\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler369)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899192013\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler369)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899192036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899192066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899192083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xcfd32de8 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899192144\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899192166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899192182\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899192197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899192228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192244\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281055ms\"\n },\n {\n \"at\": \"1789228899192278\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +815ms\"\n },\n {\n \"at\": \"1789228899192295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228899192316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899192330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899192348\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899192378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899192427\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899192447\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899192479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899192494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899192545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899192559\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899192589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192618\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899192640\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +814ms\"\n },\n {\n \"at\": \"1789228899192656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228899192674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899192689\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899192703\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192720\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899192734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899192780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899192794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899192823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192862\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899267280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00275|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899267322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899267341\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899267352\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899267362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899267378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899267389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267431\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267442\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899267454\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899267464\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899267475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899267490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899267500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899267525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899267535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899267545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899267554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267576\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899291694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler369)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899291856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler369)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899291879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899291894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899291910\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xc3aebc58 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899291935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291950\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291965\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899291980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899292010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292025\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281155ms\"\n },\n {\n \"at\": \"1789228899292054\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +874ms\"\n },\n {\n \"at\": \"1789228899292076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -106ms\"\n },\n {\n \"at\": \"1789228899292092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899292113\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899292134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292153\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899292169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292184\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899292213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899292228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292242\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899292265\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899292279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292297\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899292312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899292330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899292349\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899292364\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899292379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899292423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +874ms\"\n },\n {\n \"at\": \"1789228899292437\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -106ms\"\n },\n {\n \"at\": \"1789228899292457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899292471\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899292488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899292517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292546\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899292567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899292581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899292610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292646\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899373920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler369)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899374037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler369)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899374055\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899374078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899374093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x36cbd78 your_disc:0x35a20d9\"\n },\n {\n \"at\": \"1789228899374111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899374128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899374141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899374156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374172\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899374193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374215\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374230\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281237ms\"\n },\n {\n \"at\": \"1789228899374246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +823ms\"\n },\n {\n \"at\": \"1789228899374262\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -87ms\"\n },\n {\n \"at\": \"1789228899374282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899374298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899374313\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899374344\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374354\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899374374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899374390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899374412\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899374422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler369)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899374465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899374483\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374496\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899374510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899374554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +822ms\"\n },\n {\n \"at\": \"1789228899374571\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -88ms\"\n },\n {\n \"at\": \"1789228899374592\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899374607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899374617\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374626\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899374636\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374648\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374658\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899374667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899374677\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374687\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899374697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374707\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374716\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900141572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900142029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900142072\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900142110\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900142139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900142168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900142197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900142227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +815ms\"\n },\n {\n \"at\": \"1789228900142256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -135ms\"\n },\n {\n \"at\": \"1789228900142285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900142312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900142358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900142382\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900142406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900142488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900142510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900142528\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900142548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900142566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142586\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900242168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900242357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900242396\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900242426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900242453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900242484\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900242514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900242541\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +853ms\"\n },\n {\n \"at\": \"1789228900242578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789228900242609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900242638\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900242667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900242694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900242717\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242729\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242739\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900242754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900242768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900242784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900242799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900242814\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228909066722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00276|connmgr|INFO|br-int<->unix#7: 924 flow_mods in the 7 s starting 10 s ago (840 adds, 84 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:32.823918+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-probe.txt", "router_mac": "10:66:6a:43:84:fe", "at": "2026-09-12T16:02:32.824851+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 73828, "ready": true, "ready_signal": "time=\"2026-09-12T09:02:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T16:02:32.912727+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/topology.jsonl", "destroy"], "seconds": 3.474, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:36.386802+00:00"} +{"capture": "monitor-delete", "pid": 73828, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.log", "ready_signal": "time=\"2026-09-12T09:02:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T16:02:36.391870+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.089, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T16:02:36.481992+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.099, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T16:02:36.581439+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.148, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ovn-nbctl list HA_Chassis_Group ===\n=== ovn-nbctl list HA_Chassis ===\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T16:02:36.730374+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.343, "exit_code": 0, "stdout": "10.10.40.64 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T16:02:37.073244+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.216, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899275202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00043|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899275575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00044|bridge|INFO|bridge incusovn16: using datapath ID 00002ee577a07046\"\n },\n {\n \"at\": \"1789228899275595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00045|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899277423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00046|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899277483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899277503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899277530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899277545\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899277564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899277581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899277650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899277695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899277708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899277732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899277773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899277800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899277813\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00047|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899277828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899277839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899277857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899277869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899277880\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899277892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899277927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899277938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899277948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899277965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899277978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899277990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278001\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899278011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899278047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899278081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor33)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899278094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00048|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899278108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899278119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899278129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899278140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899278150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899278161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278176\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214281ms\"\n },\n {\n \"at\": \"1789228899278200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899278211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278227\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899278255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899278266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899278289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899278304\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899278316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899278327\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278342\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899278353\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899290962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler1)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899291032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler1)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899291065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899291097\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899291120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x35a20d9 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899291148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899291212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899291249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291264\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899291370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899291390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899291425\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291443\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291463\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899291480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899291509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899291554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899291571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291610\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899291630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899291647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899291679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291694\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899291711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899291731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -214294ms\"\n },\n {\n \"at\": \"1789228899291766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899291781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899291798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899291831\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291865\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899291882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899291899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899291915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899291937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899291978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler1)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899296184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler1)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899296212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899296238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899296260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x4f842aca your_disc:0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899296314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899296338\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899296363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296383\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899296405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214299ms\"\n },\n {\n \"at\": \"1789228899296479\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789228899296503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -18ms\"\n },\n {\n \"at\": \"1789228899296526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899296547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899296564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296580\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899296652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899296673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899296711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899296728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899296745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler1)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899296781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899296798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899296816\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899296833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899296866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899296884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +802ms\"\n },\n {\n \"at\": \"1789228899296902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -18ms\"\n },\n {\n \"at\": \"1789228899296920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899296938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899296955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899296975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899296993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899297089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler1)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899297156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler1)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899297177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899297195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899297212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xd5bc00a8 your_disc:0x752e80e1\"\n },\n {\n \"at\": \"1789228899297232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899297250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899297267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899297285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899297323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -214300ms\"\n },\n {\n \"at\": \"1789228899297381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +921ms\"\n },\n {\n \"at\": \"1789228899297401\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -19ms\"\n },\n {\n \"at\": \"1789228899297419\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899297434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899297451\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899297486\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297501\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297516\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899297585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899297602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297635\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler1)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899297655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899297670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899297685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899297702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899297736\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899297753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +921ms\"\n },\n {\n \"at\": \"1789228899297771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -19ms\"\n },\n {\n \"at\": \"1789228899297828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899297844\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899297859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297877\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899297893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899297928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899297945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899297960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899297977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899297994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899298011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899298026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899373949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899374056\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899374277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899374330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899375364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899375439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899376218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899376241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899377021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899377055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228899377866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00059|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228899377910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899377923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00061|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2\"\n },\n {\n \"at\": \"1789228899379010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899379810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228899380595\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228900202282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900202409\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900202420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900202428\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900202441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900202452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900202464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900202472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +116ms\"\n },\n {\n \"at\": \"1789228900202480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -824ms\"\n },\n {\n \"at\": \"1789228900202488\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900202498\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900202507\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900202515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228900202524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202531\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900202549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900202558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900202565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228900202577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900202589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900202597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900376948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00065|dpif|WARN|Dropped 1950 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228900377154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228900629527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00067|bridge|INFO|bridge br-int: added interface veth907501d5 on port 3\"\n },\n {\n \"at\": \"1789228901376650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00068|dpif|WARN|Dropped 1882 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228901376717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228902376343\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00070|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228902376664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228902381712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00072|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902382186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00073|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902382722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00074|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902383206\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00075|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902383720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00076|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902384129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00077|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902384744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00078|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902385146\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902385744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00080|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228902386175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00081|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228903376673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00082|dpif|WARN|Dropped 1927 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228903376846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228904376908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00084|dpif|WARN|Dropped 1937 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228904377088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228905376863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00086|dpif|WARN|Dropped 1947 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228905376940\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228906376435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00088|dpif|WARN|Dropped 1917 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228906376535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228907376363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00090|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228907376589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228908376575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00092|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228908376751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00093|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228908381777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00094|poll_loop|INFO|Dropped 11601 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228908381849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00095|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228909279516\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00096|connmgr|INFO|br-int<->unix#3: 908 flow_mods in the 7 s starting 10 s ago (843 adds, 58 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228909376882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00097|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228909377216\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228910376619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00099|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228910376764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228911376730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00101|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228911376966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228912376652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00103|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228912376775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228913376892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00105|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228913377129\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228914376463\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00107|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228914376559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228914381820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00109|poll_loop|INFO|Dropped 11629 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228914381969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00110|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228915376849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00111|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228915376982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228916376802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00113|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228916377038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228917376942\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00115|dpif|WARN|Dropped 1954 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228917377182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228918376883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00117|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228918377000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228919376978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00119|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228919377105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228920376539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00121|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228920376668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228920381731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00123|poll_loop|INFO|Dropped 11662 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228920381873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00124|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228921376811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00125|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228921376948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00126|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228922376774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00127|dpif|WARN|Dropped 1963 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228922377000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228923376697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00129|dpif|WARN|Dropped 1945 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228923376796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228924376806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00131|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228924377017\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228925376814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00133|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228925376995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228926377059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00135|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228926377392\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228926381908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00137|poll_loop|INFO|Dropped 11619 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228926381948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00138|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228927376594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00139|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228927376673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228928376675\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00141|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228928376857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228929376605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00143|dpif|WARN|Dropped 1922 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228929376761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228930376822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00145|dpif|WARN|Dropped 1900 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228930377119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228931376357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00147|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228931376458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228932376480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00149|dpif|WARN|Dropped 1913 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228932376688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228932381398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00151|poll_loop|INFO|Dropped 11514 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228932381487\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00152|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228933376822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00153|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228933377019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00154|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228934376824\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00155|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228934377036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228935376543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00157|dpif|WARN|Dropped 1920 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228935376664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228936376852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00159|dpif|WARN|Dropped 1912 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228936377081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228937376602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00161|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228937376710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228938376631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00163|dpif|WARN|Dropped 1955 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228938376857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228938381918\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00165|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228938382013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228939376692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00167|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228939376900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228940376789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00169|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228940376992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228941376928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00171|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228941377177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228942376783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00173|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228942376884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228943376779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00175|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228943377003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228944376466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00177|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228944376610\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228944381734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00179|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228944381884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00180|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228945376657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00181|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228945376794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00182|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228946376641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00183|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228946376823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228947376818\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00185|dpif|WARN|Dropped 1946 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228947377021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00186|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228948376758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00187|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228948376849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00188|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228949376467\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00189|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228949376597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00190|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228950376804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00191|dpif|WARN|Dropped 1916 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228950377088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00192|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228950381874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00193|poll_loop|INFO|Dropped 11631 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228950381960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00194|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228951376871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00195|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228951377101\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00196|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228952376991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00197|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228952377321\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00198|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228953376691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00199|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228953376777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00200|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228953611532\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00201|bridge|INFO|bridge br-int: deleted interface veth907501d5 on port 3\"\n },\n {\n \"at\": \"1789228954376360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00202|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228954376462\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00203|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228955376492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00204|dpif|WARN|Dropped 1987 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228955376710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228955822555\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228955822582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228955844935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2\"\n },\n {\n \"at\": \"1789228955845021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor33)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789228956848737\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00209|poll_loop|INFO|Dropped 10692 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228956848965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00210|poll_loop|INFO|wakeup due to [POLLIN] on fd 71 (FIFO pipe:[24058]) at ../vswitchd/bridge.c:425 (70% CPU usage)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:37.289558+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.216, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899183506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899183615\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge incusovn16: using datapath ID 00009208b9915e49\"\n },\n {\n \"at\": \"1789228899183626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00264|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899185431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00265|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185588\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185606\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185656\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185680\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899185707\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899185786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185804\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185843\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185863\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185896\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185923\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00266|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899186002\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899186025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899186042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899186084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186118\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154185ms\"\n },\n {\n \"at\": \"1789228899186136\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899186209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899186226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899186263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899186280\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler359)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899186650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler359)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899186677\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899186701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899186723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x17f0052 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899186742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899186760\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899186780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899186797\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899186815\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899186833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186850\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899186871\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154186ms\"\n },\n {\n \"at\": \"1789228899186890\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +909ms\"\n },\n {\n \"at\": \"1789228899186911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789228899186929\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186946\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899186964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186982\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899186999\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187034\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899187050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899187071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187088\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899187109\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899187126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899187167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899187185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899187201\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899187218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899187235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899187252\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899187269\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899187290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +909ms\"\n },\n {\n \"at\": \"1789228899187307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789228899187324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899187339\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899187354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228899187388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187434\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899187451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899187468\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899187484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899187501\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187521\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899187540\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261253\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00267|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899261289\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899261312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899261352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899261373\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899261400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261454\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154260ms\"\n },\n {\n \"at\": \"1789228899261485\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899261504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899261566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899261585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261606\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899261625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261675\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899261697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899268288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler358)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899268361\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler358)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899268387\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899268417\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899268436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x23ec2b8f your_disc:0x0\"\n },\n {\n \"at\": \"1789228899268457\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899268514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268552\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268623\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899268663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268685\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268704\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268724\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899268745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268764\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268785\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268804\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268823\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268842\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899268862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899268881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268920\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899268940\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899268959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268976\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268992\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899269005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899269015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1592154267ms\"\n },\n {\n \"at\": \"1789228899269030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899269038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899269046\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899269054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228899269061\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899269086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899269094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899269102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228899269110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269119\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899269127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899281411\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00268|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899281448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228899283745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899283775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00271|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228900088485\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900088626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900088640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900088651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900088662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900088672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900088682\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900088696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228900088705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -802ms\"\n },\n {\n \"at\": \"1789228900088715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900088730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900088746\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900088756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4f842aca\"\n },\n {\n \"at\": \"1789228900088765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088784\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900088794\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900088803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900088812\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x23ec2b8f\"\n },\n {\n \"at\": \"1789228900088821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900088830\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900088838\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900160502\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler359)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900160596\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler359)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900160626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900160652\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900160674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xfbce566e your_disc:0xc3aebc58\"\n },\n {\n \"at\": \"1789228900160698\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900160720\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900160747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900160769\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900160790\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900160810\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900160834\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900160856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1592155159ms\"\n },\n {\n \"at\": \"1789228900160877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228900160901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228900160931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900160952\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900160973\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900160998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900161020\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161041\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900161082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900161104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900161144\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900161165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900161205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler359)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900161230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900161249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900161270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900161291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900161312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900161340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900161361\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228900161380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228900161421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900161451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900161478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161501\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900161523\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900161584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900161604\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900161625\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900161644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161664\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900161683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900886981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900887298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900887327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900887348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900887370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900887416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900887437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900887459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +39ms\"\n },\n {\n \"at\": \"1789228900887482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -791ms\"\n },\n {\n \"at\": \"1789228900887514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900887534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900887553\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900887572\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900887591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887611\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887629\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900887650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900887672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900887693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900887713\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900887734\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900887753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228909189654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00272|connmgr|INFO|br-int<->unix#7: 877 flow_mods in the 7 s starting 10 s ago (813 adds, 57 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228955816482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00273|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228955816740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00274|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228955816773\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00275|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228955844469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00276|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228955844749\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor385)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:37.506842+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.186, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899183349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00290|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899183846\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00291|bridge|INFO|bridge incusovn16: using datapath ID 00002654629f1141\"\n },\n {\n \"at\": \"1789228899183886\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00292|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899185533\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00293|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185595\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185631\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185646\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185658\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185669\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185680\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228899185723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185734\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185755\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185765\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185776\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185786\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185796\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185809\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185822\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00294|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185835\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185847\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185886\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054183ms\"\n },\n {\n \"at\": \"1789228899185916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185925\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899185956\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185987\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185997\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899261010\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00295|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899261076\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899261108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899261132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899261156\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899261178\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899261201\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261226\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054258ms\"\n },\n {\n \"at\": \"1789228899261280\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899261302\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261323\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261345\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899261368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899261392\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261416\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899261439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899261462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899261493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899261516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261539\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899261564\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899267924\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler354)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899267964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler354)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899267979\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899267996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899268011\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x752e80e1 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899268023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268035\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899268046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899268057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268077\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268099\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268166\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268192\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899268204\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268216\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268238\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268268\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899268281\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899268290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268340\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899268353\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899268363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899268373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899268382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899268404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899268419\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51054265ms\"\n },\n {\n \"at\": \"1789228899268443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899268453\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899268466\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228899268486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899268522\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899268532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899268556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228899268567\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268580\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899268591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899280146\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00296|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899280179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00297|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228899286270\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00298|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899286333\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00299|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228900001516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler362)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900001623\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler362)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900001660\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900001689\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900001715\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x1172530f your_disc:0xcfd32de8\"\n },\n {\n \"at\": \"1789228900001741\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900001818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900001846\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900001875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900001897\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900001921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900001942\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900001966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51054999ms\"\n },\n {\n \"at\": \"1789228900001989\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +134ms\"\n },\n {\n \"at\": \"1789228900002021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -816ms\"\n },\n {\n \"at\": \"1789228900002047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900002082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900002108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900002160\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002183\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900002226\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900002252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002280\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900002306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900002389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900002445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler362)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900002474\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900002498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900002521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900002545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900002568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900002590\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900002616\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +134ms\"\n },\n {\n \"at\": \"1789228900002644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -816ms\"\n },\n {\n \"at\": \"1789228900002674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900002705\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900002736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900002804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002838\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900002864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900002894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900002926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900002954\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900002986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900003021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900003045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900096225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler357)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228900096322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler357)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228900096362\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228900096389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228900096410\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x87bd04ca your_disc:0x17f0052\"\n },\n {\n \"at\": \"1789228900096438\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900096463\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228900096486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228900096510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900096531\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900096560\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900096587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900096609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -51055094ms\"\n },\n {\n \"at\": \"1789228900096635\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +699ms\"\n },\n {\n \"at\": \"1789228900096664\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51ms\"\n },\n {\n \"at\": \"1789228900096692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900096716\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900096738\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900096767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900096794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900096816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900096843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900096870\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900096939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900096962\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900096986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228900097021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900097080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler357)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900097108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900097133\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900097193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900097218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900097241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900097265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900097288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +699ms\"\n },\n {\n \"at\": \"1789228900097315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -51ms\"\n },\n {\n \"at\": \"1789228900097341\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900097363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228900097385\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900097408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17f0052\"\n },\n {\n \"at\": \"1789228900097431\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097484\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900097507\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228900097536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900097563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x87bd04ca\"\n },\n {\n \"at\": \"1789228900097584\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097605\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900097628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900208233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900208584\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900208617\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900208642\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900208667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900208688\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900208712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900208744\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +78ms\"\n },\n {\n \"at\": \"1789228900208769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -922ms\"\n },\n {\n \"at\": \"1789228900208795\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900208819\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900208852\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900208876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xd5bc00a8\"\n },\n {\n \"at\": \"1789228900208899\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900208921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900208944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900208966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900208990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900209019\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x752e80e1\"\n },\n {\n \"at\": \"1789228900209043\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900209085\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900209113\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228901384909\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00300|bridge|INFO|bridge br-int: added interface veth5c0c349e on port 38\"\n },\n {\n \"at\": \"1789228909189260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00301|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 7 s starting 10 s ago (849 adds, 81 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228954580894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00302|bridge|INFO|bridge br-int: deleted interface veth5c0c349e on port 38\"\n },\n {\n \"at\": \"1789228955815464\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00303|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228955815736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00304|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228955815774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00305|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228955841854\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00306|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228955842056\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor385)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:37.694101+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T16%3A01%3A36.296292%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.172, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228899062010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00266|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228899062147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00267|bridge|INFO|bridge incusovn16: using datapath ID 0000c2a8a0e84b40\"\n },\n {\n \"at\": \"1789228899062160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00268|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228899159484\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228899159607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228899164947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00271|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228899165007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00272|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789228899185637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00273|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185659\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185676\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185702\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185725\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185737\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899185761\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899185771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185782\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899185806\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899185818\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185827\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899185839\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899185849\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899185860\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899185870\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185885\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899185894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899185911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00274|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899185931\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899185943\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899185956\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899185966\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899185980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899185994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186006\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281049ms\"\n },\n {\n \"at\": \"1789228899186026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899186036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899186068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899186078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186087\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899186097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899186107\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899186117\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899186128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899186146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899186157\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228899191871\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler369)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899192013\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler369)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899192036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899192066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899192083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xcfd32de8 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899192144\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899192166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899192182\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899192197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899192228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192244\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281055ms\"\n },\n {\n \"at\": \"1789228899192278\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +815ms\"\n },\n {\n \"at\": \"1789228899192295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228899192316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899192330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899192348\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899192378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899192427\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899192447\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899192479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899192494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899192545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899192559\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899192575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899192589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899192618\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899192640\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +814ms\"\n },\n {\n \"at\": \"1789228899192656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228899192674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899192689\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899192703\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192720\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228899192734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899192780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899192794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899192808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228899192823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899192862\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899267280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00275|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899267322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899267341\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899267352\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899267362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899267378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228899267389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267431\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1592281131ms\"\n },\n {\n \"at\": \"1789228899267442\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899267454\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228899267464\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899267475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899267490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899267500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899267525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228899267535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899267545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228899267554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899267576\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228899291694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler369)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899291856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler369)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899291879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228899291894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899291910\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xc3aebc58 your_disc:0x0\"\n },\n {\n \"at\": \"1789228899291935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291950\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899291965\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899291980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899291996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899292010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292025\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281155ms\"\n },\n {\n \"at\": \"1789228899292054\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +874ms\"\n },\n {\n \"at\": \"1789228899292076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -106ms\"\n },\n {\n \"at\": \"1789228899292092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899292113\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899292134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292153\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899292169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292184\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899292213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899292228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292242\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899292265\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899292279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292297\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899292312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899292330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899292349\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899292364\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899292379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899292409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899292423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +874ms\"\n },\n {\n \"at\": \"1789228899292437\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -106ms\"\n },\n {\n \"at\": \"1789228899292457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899292471\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899292488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228899292517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292546\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899292567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228899292581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899292596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228899292610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899292646\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899373920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler369)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228899374037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler369)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228899374055\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228899374078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228899374093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x36cbd78 your_disc:0x35a20d9\"\n },\n {\n \"at\": \"1789228899374111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899374128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228899374141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228899374156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374172\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899374193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374215\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374230\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1592281237ms\"\n },\n {\n \"at\": \"1789228899374246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +823ms\"\n },\n {\n \"at\": \"1789228899374262\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -87ms\"\n },\n {\n \"at\": \"1789228899374282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899374298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899374313\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899374344\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374354\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899374374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899374390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899374412\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228899374422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler369)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228899374465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228899374483\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228899374496\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228899374510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228899374539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228899374554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +822ms\"\n },\n {\n \"at\": \"1789228899374571\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -88ms\"\n },\n {\n \"at\": \"1789228899374592\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228899374607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228899374617\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374626\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x35a20d9\"\n },\n {\n \"at\": \"1789228899374636\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374648\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374658\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228899374667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228899374677\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228899374687\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x36cbd78\"\n },\n {\n \"at\": \"1789228899374697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374707\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228899374716\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900141572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900142029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900142072\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900142110\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900142139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900142168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900142197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900142227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +815ms\"\n },\n {\n \"at\": \"1789228900142256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -135ms\"\n },\n {\n \"at\": \"1789228900142285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900142312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900142358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900142382\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1172530f\"\n },\n {\n \"at\": \"1789228900142406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900142488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900142510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900142528\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfd32de8\"\n },\n {\n \"at\": \"1789228900142548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900142566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900142586\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900242168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228900242357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228900242396\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228900242426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228900242453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900242484\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228900242514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228900242541\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +853ms\"\n },\n {\n \"at\": \"1789228900242578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789228900242609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228900242638\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228900242667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900242694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xfbce566e\"\n },\n {\n \"at\": \"1789228900242717\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242729\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242739\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228900242754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228900242768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228900242784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc3aebc58\"\n },\n {\n \"at\": \"1789228900242799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228900242814\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228900242825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228909066722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00276|connmgr|INFO|br-int<->unix#7: 924 flow_mods in the 7 s starting 10 s ago (840 adds, 84 deletes)\"\n },\n {\n \"at\": \"1789228955825150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00277|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228955825290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228955825311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228955846250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00280|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789228955846333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor385)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T16:02:37.866744+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T16:02:37.867692+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/create.stdout.json new file mode 100644 index 0000000..6325794 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.569, + "first_cross_member_ping_seconds": 3.047, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/cycle.json new file mode 100644 index 0000000..44ebe76 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/cycle.json @@ -0,0 +1,121 @@ +{ + "ok": false, + "datapath_ok": false, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 1, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T16:01:36.296292+00:00", + "ended_at": "2026-09-12T16:02:37.867794+00:00", + "seconds": 61.572, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:43:84:fe", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.569, + "first_cross_member_ping_seconds": 3.047, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": false, + "exit_code": 1, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.097 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.096 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\"volatile.eth0.host_name\":\"veth907501d5\",\"volatile.eth0.hwaddr\":\"10:66:6a:d9:78:08\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90400719-d170-40f8-8690-7e17fde270db\",\"volatile.uuid.generation\":\"90400719-d170-40f8-8690-7e17fde270db\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T16:01:40.121693432Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\"volatile.eth0.host_name\":\"veth907501d5\",\"volatile.eth0.hwaddr\":\"10:66:6a:d9:78:08\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90400719-d170-40f8-8690-7e17fde270db\",\"volatile.uuid.generation\":\"90400719-d170-40f8-8690-7e17fde270db\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T16:01:40.752800494Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9334784,\"usage_peak\":0,\"total\":65256516000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fed9:7808\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:d9:78:08\",\"host_name\":\"veth907501d5\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":3719,\"processes\":4,\"cpu\":{\"usage\":492034000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T16:01:39.75999999Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"485b965e-64de-42a8-8c9a-938f4e93afce\",\"volatile.eth0.host_name\":\"veth5c0c349e\",\"volatile.eth0.hwaddr\":\"10:66:6a:8f:56:95\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\"volatile.uuid.generation\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T16:01:40.94318346Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"485b965e-64de-42a8-8c9a-938f4e93afce\",\"volatile.eth0.host_name\":\"veth5c0c349e\",\"volatile.eth0.hwaddr\":\"10:66:6a:8f:56:95\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\"volatile.uuid.generation\":\"7b930fd9-10fd-4078-b66e-699779aa9bbc\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T16:01:41.46956009Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11636736,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe8f:5695\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:8f:56:95\",\"host_name\":\"veth5c0c349e\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":37953,\"processes\":4,\"cpu\":{\"usage\":494971000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T16:01:41.480000019Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.147 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.262 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.271 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.294 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.828 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.502 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.502/0.874/1.294 ms\nelapsed_seconds=2.286 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.053 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.795 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.356 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.356/0.734/1.053 ms\nelapsed_seconds=2.273 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.229 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.268 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.269 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.267 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.306 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5003 milliseconds\nelapsed_seconds=5.273 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5011 ms: Timeout was reached\nelapsed_seconds=5.028 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.211140 bytes_per_second=473619399\nelapsed_seconds=0.668 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.497 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.142038 bytes_per_second=704036947\nelapsed_seconds=0.435 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.522 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", + "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 71187, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.log", + "bytes": 176202, + "ready_signal": "time=\"2026-09-12T09:01:36-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T16:01:36.858940+00:00", + "stopped_at": "2026-09-12T16:01:46.727169+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 71881, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/tcpdump-arp.log", + "bytes": 334, + "ready_signal": "listening on", + "started_at": "2026-09-12T16:01:48.239930+00:00", + "stopped_at": "2026-09-12T16:02:31.367320+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 73828, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.log", + "bytes": 40311, + "ready_signal": "time=\"2026-09-12T09:02:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T16:02:32.825038+00:00", + "stopped_at": "2026-09-12T16:02:36.391720+00:00" + } + ], + "failures": { + "checks": [ + "probe: probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed" + ], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-post-1" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-probe.txt new file mode 100644 index 0000000..588792e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-probe.txt @@ -0,0 +1,6068 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab01 + - lab02 + - lab03 + - nas01 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d9:78:08 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8f:56:95 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 2d55097d-204e-41d0-8eb5-9cc1c55adc9d (incus-net38-ls-int) + port incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0 + addresses: ["10:66:6a:8f:56:95 dynamic"] + port incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0 + addresses: ["10:66:6a:d9:78:08 dynamic"] + port incus-net38-ls-int-lsp-router + type: router + router-port: incus-net38-lr-lrp-int +switch 2611bfc6-bdb5-44f6-a09e-9eb8763a2cb2 (incus-net38-ls-ext) + port incus-net38-ls-ext-lsp-router + type: router + router-port: incus-net38-lr-lrp-ext + port incus-net38-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router 13cb6f52-142b-42be-9fc9-d07b5a432cc9 (incus-net38-lr) + port incus-net38-lr-lrp-int + mac: "10:66:6a:43:84:fe" + ipv6-lla: "fe80::1266:6aff:fe43:84fe" + networks: ["10.253.73.1/24"] + port incus-net38-lr-lrp-ext + mac: "10:66:6a:43:84:fe" + ipv6-lla: "fe80::1266:6aff:fe43:84fe" + networks: ["10.10.40.64/24"] + nat 5fae479d-e83a-4345-9aff-819b51257038 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net38-lr-lrp-ext + Port_Binding incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 71527675-42da-4982-894c-c52663cdd4c2 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 80ca99c2-2647-418e-83bc-912afdfa528d +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:43:84:fe" +name : incus-net38-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : 13e4bb8d-2e09-4bae-85d8-ded30bc8185f +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:43:84:fe" +name : incus-net38-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 62b79c31-2ea0-46f1-a016-51d740ca723e +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 69f2ce8e-ada9-4fff-864e-591908009cd1 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 8cf3d44d-d3cc-4e98-8ce8-345cfd643311 +logical_port : cr-incus-net38-lr-lrp-ext +mac : ["10:66:6a:43:84:fe 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net38-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : 80ca99c2-2647-418e-83bc-912afdfa528d +external_ids : {} +ha_chassis : [04daa0d0-7900-4bae-8267-6dafc1b6f9dd, 1f7024f7-1abf-4c67-a9b7-1e1065b829d5, 3695bc80-f75a-4ed9-9cf4-9b373c4274b1, ffee2173-5fe8-4a45-8659-20e9ec744920] +name : incus-net38 +=== ovn-nbctl list HA_Chassis === +_uuid : 3695bc80-f75a-4ed9-9cf4-9b373c4274b1 +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 17040 + +_uuid : 04daa0d0-7900-4bae-8267-6dafc1b6f9dd +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 11633 + +_uuid : 1f7024f7-1abf-4c67-a9b7-1e1065b829d5 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 32081 + +_uuid : ffee2173-5fe8-4a45-8659-20e9ec744920 +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 30804 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899275202", + "member": "lab01.glab.lol", + "message": "ovs|00043|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899275575", + "member": "lab01.glab.lol", + "message": "ovs|00044|bridge|INFO|bridge incusovn16: using datapath ID 00002ee577a07046" + }, + { + "at": "1789228899275595", + "member": "lab01.glab.lol", + "message": "ovs|00045|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899277423", + "member": "lab01.glab.lol", + "message": "ovs|00046|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899277483", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899277503", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899277530", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899277545", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899277564", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899277581", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899277595", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899277611", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899277630", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899277650", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899277665", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277679", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899277695", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899277708", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899277719", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899277732", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899277746", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277759", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899277773", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899277786", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899277800", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899277813", + "member": "lab01.glab.lol", + "message": "ovs|00047|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899277828", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899277839", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899277857", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899277869", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899277880", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899277892", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899277903", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899277914", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899277927", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899277938", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899277948", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277965", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899277978", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899277990", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278001", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899278011", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899278022", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278035", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899278047", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899278059", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278070", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899278081", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor33)|INFO|monitor thread created" + }, + { + "at": "1789228899278094", + "member": "lab01.glab.lol", + "message": "ovs|00048|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899278108", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899278119", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899278129", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899278140", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899278150", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899278161", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899278176", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899278188", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899278200", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899278211", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899278227", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278239", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899278255", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899278266", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278277", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899278289", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899278304", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278316", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899278327", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899278342", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278353", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899290962", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler1)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899291032", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler1)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228899291065", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899291097", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899291120", + "member": "lab01.glab.lol", + "message": " my_disc:0x35a20d9 your_disc:0x0" + }, + { + "at": "1789228899291148", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899291171", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899291193", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899291212", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291231", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899291249", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899291264", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899291285", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214294ms" + }, + { + "at": "1789228899291311", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214294ms" + }, + { + "at": "1789228899291333", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214294ms" + }, + { + "at": "1789228899291352", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899291370", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899291390", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291407", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899291425", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291443", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291463", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899291480", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899291509", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291536", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228899291554", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899291571", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291590", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899291610", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899291630", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899291647", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291662", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899291679", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899291694", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899291711", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899291731", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214294ms" + }, + { + "at": "1789228899291748", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214294ms" + }, + { + "at": "1789228899291766", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899291781", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899291798", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291814", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899291831", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291846", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291865", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899291882", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899291899", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291915", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228899291937", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291956", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291978", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899296105", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler1)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899296184", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler1)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228899296212", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899296238", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899296260", + "member": "lab01.glab.lol", + "message": " my_disc:0x4f842aca your_disc:0x23ec2b8f" + }, + { + "at": "1789228899296285", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899296314", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899296338", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899296363", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899296383", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899296405", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899296427", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899296450", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214299ms" + }, + { + "at": "1789228899296479", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789228899296503", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -18ms" + }, + { + "at": "1789228899296526", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899296547", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899296564", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296580", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899296597", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899296615", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899296633", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899296652", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899296673", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296691", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4f842aca" + }, + { + "at": "1789228899296711", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899296728", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899296745", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899296762", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler1)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899296781", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899296798", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899296816", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899296833", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899296851", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899296866", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899296884", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789228899296902", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -18ms" + }, + { + "at": "1789228899296920", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899296938", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899296955", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296975", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899296993", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297011", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297026", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297041", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297057", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297074", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4f842aca" + }, + { + "at": "1789228899297089", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297107", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297124", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899297139", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler1)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899297156", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler1)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899297177", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899297195", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899297212", + "member": "lab01.glab.lol", + "message": " my_disc:0xd5bc00a8 your_disc:0x752e80e1" + }, + { + "at": "1789228899297232", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899297250", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899297267", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899297285", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899297302", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899297323", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899297341", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899297357", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214300ms" + }, + { + "at": "1789228899297381", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +921ms" + }, + { + "at": "1789228899297401", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -19ms" + }, + { + "at": "1789228899297419", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899297434", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899297451", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297468", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899297486", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297501", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297516", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297533", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297550", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297565", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899297585", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899297602", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297619", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899297635", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler1)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899297655", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899297670", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899297685", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899297702", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899297719", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899297736", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899297753", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +921ms" + }, + { + "at": "1789228899297771", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -19ms" + }, + { + "at": "1789228899297828", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899297844", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899297859", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297877", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899297893", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297911", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297928", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297945", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297960", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297977", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899297994", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899298011", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899298026", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899373949", + "member": "lab01.glab.lol", + "message": "ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374056", + "member": "lab01.glab.lol", + "message": "ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899374277", + "member": "lab01.glab.lol", + "message": "ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374330", + "member": "lab01.glab.lol", + "message": "ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899375364", + "member": "lab01.glab.lol", + "message": "ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899375439", + "member": "lab01.glab.lol", + "message": "ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899376218", + "member": "lab01.glab.lol", + "message": "ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899376241", + "member": "lab01.glab.lol", + "message": "ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377021", + "member": "lab01.glab.lol", + "message": "ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377055", + "member": "lab01.glab.lol", + "message": "ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377866", + "member": "lab01.glab.lol", + "message": "ovs|00059|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228899377910", + "member": "lab01.glab.lol", + "message": "ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377923", + "member": "lab01.glab.lol", + "message": "ovs|00061|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2" + }, + { + "at": "1789228899379010", + "member": "lab01.glab.lol", + "message": "ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899379810", + "member": "lab01.glab.lol", + "message": "ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899380595", + "member": "lab01.glab.lol", + "message": "ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900202282", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900202409", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900202420", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900202428", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900202441", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900202452", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900202464", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900202472", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +116ms" + }, + { + "at": "1789228900202480", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -824ms" + }, + { + "at": "1789228900202488", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900202498", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900202507", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900202515", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228900202524", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900202531", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900202540", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900202549", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900202558", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900202565", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228900202577", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900202589", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900202597", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900376948", + "member": "lab01.glab.lol", + "message": "ovs|00065|dpif|WARN|Dropped 1950 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228900377154", + "member": "lab01.glab.lol", + "message": "ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900629527", + "member": "lab01.glab.lol", + "message": "ovs|00067|bridge|INFO|bridge br-int: added interface veth907501d5 on port 3" + }, + { + "at": "1789228901376650", + "member": "lab01.glab.lol", + "message": "ovs|00068|dpif|WARN|Dropped 1882 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228901376717", + "member": "lab01.glab.lol", + "message": "ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902376343", + "member": "lab01.glab.lol", + "message": "ovs|00070|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228902376664", + "member": "lab01.glab.lol", + "message": "ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902381712", + "member": "lab01.glab.lol", + "message": "ovs|00072|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902382186", + "member": "lab01.glab.lol", + "message": "ovs|00073|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902382722", + "member": "lab01.glab.lol", + "message": "ovs|00074|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902383206", + "member": "lab01.glab.lol", + "message": "ovs|00075|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902383720", + "member": "lab01.glab.lol", + "message": "ovs|00076|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902384129", + "member": "lab01.glab.lol", + "message": "ovs|00077|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902384744", + "member": "lab01.glab.lol", + "message": "ovs|00078|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902385146", + "member": "lab01.glab.lol", + "message": "ovs|00079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902385744", + "member": "lab01.glab.lol", + "message": "ovs|00080|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902386175", + "member": "lab01.glab.lol", + "message": "ovs|00081|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228903376673", + "member": "lab01.glab.lol", + "message": "ovs|00082|dpif|WARN|Dropped 1927 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228903376846", + "member": "lab01.glab.lol", + "message": "ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228904376908", + "member": "lab01.glab.lol", + "message": "ovs|00084|dpif|WARN|Dropped 1937 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228904377088", + "member": "lab01.glab.lol", + "message": "ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228905376863", + "member": "lab01.glab.lol", + "message": "ovs|00086|dpif|WARN|Dropped 1947 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228905376940", + "member": "lab01.glab.lol", + "message": "ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228906376435", + "member": "lab01.glab.lol", + "message": "ovs|00088|dpif|WARN|Dropped 1917 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228906376535", + "member": "lab01.glab.lol", + "message": "ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228907376363", + "member": "lab01.glab.lol", + "message": "ovs|00090|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228907376589", + "member": "lab01.glab.lol", + "message": "ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228908376575", + "member": "lab01.glab.lol", + "message": "ovs|00092|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228908376751", + "member": "lab01.glab.lol", + "message": "ovs|00093|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228908381777", + "member": "lab01.glab.lol", + "message": "ovs|00094|poll_loop|INFO|Dropped 11601 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228908381849", + "member": "lab01.glab.lol", + "message": "ovs|00095|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228909279516", + "member": "lab01.glab.lol", + "message": "ovs|00096|connmgr|INFO|br-int<->unix#3: 908 flow_mods in the 7 s starting 10 s ago (843 adds, 58 deletes, 7 modifications)" + }, + { + "at": "1789228909376882", + "member": "lab01.glab.lol", + "message": "ovs|00097|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228909377216", + "member": "lab01.glab.lol", + "message": "ovs|00098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228910376619", + "member": "lab01.glab.lol", + "message": "ovs|00099|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228910376764", + "member": "lab01.glab.lol", + "message": "ovs|00100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228911376730", + "member": "lab01.glab.lol", + "message": "ovs|00101|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228911376966", + "member": "lab01.glab.lol", + "message": "ovs|00102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228912376652", + "member": "lab01.glab.lol", + "message": "ovs|00103|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228912376775", + "member": "lab01.glab.lol", + "message": "ovs|00104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228913376892", + "member": "lab01.glab.lol", + "message": "ovs|00105|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228913377129", + "member": "lab01.glab.lol", + "message": "ovs|00106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228914376463", + "member": "lab01.glab.lol", + "message": "ovs|00107|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228914376559", + "member": "lab01.glab.lol", + "message": "ovs|00108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228914381820", + "member": "lab01.glab.lol", + "message": "ovs|00109|poll_loop|INFO|Dropped 11629 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228914381969", + "member": "lab01.glab.lol", + "message": "ovs|00110|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228915376849", + "member": "lab01.glab.lol", + "message": "ovs|00111|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228915376982", + "member": "lab01.glab.lol", + "message": "ovs|00112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228916376802", + "member": "lab01.glab.lol", + "message": "ovs|00113|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228916377038", + "member": "lab01.glab.lol", + "message": "ovs|00114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228917376942", + "member": "lab01.glab.lol", + "message": "ovs|00115|dpif|WARN|Dropped 1954 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228917377182", + "member": "lab01.glab.lol", + "message": "ovs|00116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228918376883", + "member": "lab01.glab.lol", + "message": "ovs|00117|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228918377000", + "member": "lab01.glab.lol", + "message": "ovs|00118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228919376978", + "member": "lab01.glab.lol", + "message": "ovs|00119|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228919377105", + "member": "lab01.glab.lol", + "message": "ovs|00120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228920376539", + "member": "lab01.glab.lol", + "message": "ovs|00121|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228920376668", + "member": "lab01.glab.lol", + "message": "ovs|00122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228920381731", + "member": "lab01.glab.lol", + "message": "ovs|00123|poll_loop|INFO|Dropped 11662 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228920381873", + "member": "lab01.glab.lol", + "message": "ovs|00124|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228921376811", + "member": "lab01.glab.lol", + "message": "ovs|00125|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228921376948", + "member": "lab01.glab.lol", + "message": "ovs|00126|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228922376774", + "member": "lab01.glab.lol", + "message": "ovs|00127|dpif|WARN|Dropped 1963 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228922377000", + "member": "lab01.glab.lol", + "message": "ovs|00128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228923376697", + "member": "lab01.glab.lol", + "message": "ovs|00129|dpif|WARN|Dropped 1945 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228923376796", + "member": "lab01.glab.lol", + "message": "ovs|00130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228924376806", + "member": "lab01.glab.lol", + "message": "ovs|00131|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228924377017", + "member": "lab01.glab.lol", + "message": "ovs|00132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228925376814", + "member": "lab01.glab.lol", + "message": "ovs|00133|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228925376995", + "member": "lab01.glab.lol", + "message": "ovs|00134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228926377059", + "member": "lab01.glab.lol", + "message": "ovs|00135|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228926377392", + "member": "lab01.glab.lol", + "message": "ovs|00136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228926381908", + "member": "lab01.glab.lol", + "message": "ovs|00137|poll_loop|INFO|Dropped 11619 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228926381948", + "member": "lab01.glab.lol", + "message": "ovs|00138|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228927376594", + "member": "lab01.glab.lol", + "message": "ovs|00139|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228927376673", + "member": "lab01.glab.lol", + "message": "ovs|00140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228928376675", + "member": "lab01.glab.lol", + "message": "ovs|00141|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228928376857", + "member": "lab01.glab.lol", + "message": "ovs|00142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228929376605", + "member": "lab01.glab.lol", + "message": "ovs|00143|dpif|WARN|Dropped 1922 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228929376761", + "member": "lab01.glab.lol", + "message": "ovs|00144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228930376822", + "member": "lab01.glab.lol", + "message": "ovs|00145|dpif|WARN|Dropped 1900 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228930377119", + "member": "lab01.glab.lol", + "message": "ovs|00146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228931376357", + "member": "lab01.glab.lol", + "message": "ovs|00147|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228931376458", + "member": "lab01.glab.lol", + "message": "ovs|00148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228932376480", + "member": "lab01.glab.lol", + "message": "ovs|00149|dpif|WARN|Dropped 1913 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228932376688", + "member": "lab01.glab.lol", + "message": "ovs|00150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228932381398", + "member": "lab01.glab.lol", + "message": "ovs|00151|poll_loop|INFO|Dropped 11514 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228932381487", + "member": "lab01.glab.lol", + "message": "ovs|00152|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228933376822", + "member": "lab01.glab.lol", + "message": "ovs|00153|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228933377019", + "member": "lab01.glab.lol", + "message": "ovs|00154|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228934376824", + "member": "lab01.glab.lol", + "message": "ovs|00155|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228934377036", + "member": "lab01.glab.lol", + "message": "ovs|00156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228935376543", + "member": "lab01.glab.lol", + "message": "ovs|00157|dpif|WARN|Dropped 1920 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228935376664", + "member": "lab01.glab.lol", + "message": "ovs|00158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228936376852", + "member": "lab01.glab.lol", + "message": "ovs|00159|dpif|WARN|Dropped 1912 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228936377081", + "member": "lab01.glab.lol", + "message": "ovs|00160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228937376602", + "member": "lab01.glab.lol", + "message": "ovs|00161|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228937376710", + "member": "lab01.glab.lol", + "message": "ovs|00162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228938376631", + "member": "lab01.glab.lol", + "message": "ovs|00163|dpif|WARN|Dropped 1955 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228938376857", + "member": "lab01.glab.lol", + "message": "ovs|00164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228938381918", + "member": "lab01.glab.lol", + "message": "ovs|00165|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228938382013", + "member": "lab01.glab.lol", + "message": "ovs|00166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228939376692", + "member": "lab01.glab.lol", + "message": "ovs|00167|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228939376900", + "member": "lab01.glab.lol", + "message": "ovs|00168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228940376789", + "member": "lab01.glab.lol", + "message": "ovs|00169|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228940376992", + "member": "lab01.glab.lol", + "message": "ovs|00170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228941376928", + "member": "lab01.glab.lol", + "message": "ovs|00171|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228941377177", + "member": "lab01.glab.lol", + "message": "ovs|00172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228942376783", + "member": "lab01.glab.lol", + "message": "ovs|00173|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228942376884", + "member": "lab01.glab.lol", + "message": "ovs|00174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228943376779", + "member": "lab01.glab.lol", + "message": "ovs|00175|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228943377003", + "member": "lab01.glab.lol", + "message": "ovs|00176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228944376466", + "member": "lab01.glab.lol", + "message": "ovs|00177|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228944376610", + "member": "lab01.glab.lol", + "message": "ovs|00178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228944381734", + "member": "lab01.glab.lol", + "message": "ovs|00179|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228944381884", + "member": "lab01.glab.lol", + "message": "ovs|00180|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228945376657", + "member": "lab01.glab.lol", + "message": "ovs|00181|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228945376794", + "member": "lab01.glab.lol", + "message": "ovs|00182|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228946376641", + "member": "lab01.glab.lol", + "message": "ovs|00183|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228946376823", + "member": "lab01.glab.lol", + "message": "ovs|00184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228947376818", + "member": "lab01.glab.lol", + "message": "ovs|00185|dpif|WARN|Dropped 1946 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228947377021", + "member": "lab01.glab.lol", + "message": "ovs|00186|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228948376758", + "member": "lab01.glab.lol", + "message": "ovs|00187|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228948376849", + "member": "lab01.glab.lol", + "message": "ovs|00188|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228949376467", + "member": "lab01.glab.lol", + "message": "ovs|00189|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228949376597", + "member": "lab01.glab.lol", + "message": "ovs|00190|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228950376804", + "member": "lab01.glab.lol", + "message": "ovs|00191|dpif|WARN|Dropped 1916 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228950377088", + "member": "lab01.glab.lol", + "message": "ovs|00192|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228950381874", + "member": "lab01.glab.lol", + "message": "ovs|00193|poll_loop|INFO|Dropped 11631 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228950381960", + "member": "lab01.glab.lol", + "message": "ovs|00194|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228951376871", + "member": "lab01.glab.lol", + "message": "ovs|00195|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228951377101", + "member": "lab01.glab.lol", + "message": "ovs|00196|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899183506", + "member": "lab02.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899183615", + "member": "lab02.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge incusovn16: using datapath ID 00009208b9915e49" + }, + { + "at": "1789228899183626", + "member": "lab02.glab.lol", + "message": "ovs|00264|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899185431", + "member": "lab02.glab.lol", + "message": "ovs|00265|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185515", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185545", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185566", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185588", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185606", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185625", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154185ms" + }, + { + "at": "1789228899185656", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154185ms" + }, + { + "at": "1789228899185680", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154185ms" + }, + { + "at": "1789228899185707", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185727", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185747", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185766", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899185786", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185804", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185821", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185843", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185863", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185879", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185896", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185923", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185943", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185961", + "member": "lab02.glab.lol", + "message": "ovs|00266|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185984", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899186002", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899186025", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899186042", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899186059", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899186084", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154185ms" + }, + { + "at": "1789228899186101", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154185ms" + }, + { + "at": "1789228899186118", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154185ms" + }, + { + "at": "1789228899186136", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186153", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899186171", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186189", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899186209", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899186226", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186243", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899186263", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899186280", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899186296", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186312", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186333", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186351", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186368", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186590", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler359)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899186650", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler359)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899186677", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899186701", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899186723", + "member": "lab02.glab.lol", + "message": " my_disc:0x17f0052 your_disc:0x0" + }, + { + "at": "1789228899186742", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899186760", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899186780", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899186797", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899186815", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899186833", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899186850", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899186871", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154186ms" + }, + { + "at": "1789228899186890", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +909ms" + }, + { + "at": "1789228899186911", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789228899186929", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186946", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899186964", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186982", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899186999", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187015", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187034", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899187050", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899187071", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187088", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228899187109", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899187126", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187150", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899187167", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899187185", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899187201", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899187218", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899187235", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899187252", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899187269", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899187290", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +909ms" + }, + { + "at": "1789228899187307", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789228899187324", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899187339", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899187354", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187370", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899187388", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187418", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187434", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899187451", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899187468", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187484", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228899187501", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187521", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187540", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899261253", + "member": "lab02.glab.lol", + "message": "ovs|00267|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899261289", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899261312", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899261333", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899261352", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899261373", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899261400", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154260ms" + }, + { + "at": "1789228899261430", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154260ms" + }, + { + "at": "1789228899261454", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154260ms" + }, + { + "at": "1789228899261485", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899261504", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899261524", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261544", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899261566", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899261585", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261606", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899261625", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899261654", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261675", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899261697", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899261727", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261748", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899268288", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler358)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899268361", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler358)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899268387", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899268417", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899268436", + "member": "lab02.glab.lol", + "message": " my_disc:0x23ec2b8f your_disc:0x0" + }, + { + "at": "1789228899268457", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899268475", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899268494", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899268514", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268533", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268552", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268579", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268602", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154267ms" + }, + { + "at": "1789228899268623", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154267ms" + }, + { + "at": "1789228899268643", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154267ms" + }, + { + "at": "1789228899268663", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268685", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268704", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268724", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899268745", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268764", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268785", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268804", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268823", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268842", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899268862", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899268881", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268898", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899268920", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899268940", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899268959", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268967", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268976", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268984", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268992", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899269005", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154267ms" + }, + { + "at": "1789228899269015", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154267ms" + }, + { + "at": "1789228899269030", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899269038", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899269046", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899269054", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899269061", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899269070", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899269078", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899269086", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899269094", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899269102", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899269110", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899269119", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899269127", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899281411", + "member": "lab02.glab.lol", + "message": "ovs|00268|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899281448", + "member": "lab02.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228899283745", + "member": "lab02.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899283775", + "member": "lab02.glab.lol", + "message": "ovs|00271|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228900088485", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900088626", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900088640", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900088651", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900088662", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900088672", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900088682", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900088696", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228900088705", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -802ms" + }, + { + "at": "1789228900088715", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900088730", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900088746", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900088756", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228900088765", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900088775", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900088784", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900088794", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900088803", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900088812", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228900088821", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900088830", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900088838", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900160502", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler359)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900160596", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler359)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228900160626", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900160652", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900160674", + "member": "lab02.glab.lol", + "message": " my_disc:0xfbce566e your_disc:0xc3aebc58" + }, + { + "at": "1789228900160698", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900160720", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900160747", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900160769", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900160790", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900160810", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900160834", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900160856", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592155159ms" + }, + { + "at": "1789228900160877", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228900160901", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228900160931", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900160952", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900160973", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900160998", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900161020", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161041", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161063", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900161082", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900161104", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161122", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfbce566e" + }, + { + "at": "1789228900161144", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900161165", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161186", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900161205", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler359)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900161230", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900161249", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900161270", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900161291", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900161312", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900161340", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900161361", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228900161380", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228900161421", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900161451", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900161478", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161501", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900161523", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161544", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161565", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900161584", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900161604", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161625", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfbce566e" + }, + { + "at": "1789228900161644", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161664", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161683", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900886981", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900887298", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900887327", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900887348", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900887370", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900887416", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900887437", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900887459", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +39ms" + }, + { + "at": "1789228900887482", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -791ms" + }, + { + "at": "1789228900887514", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900887534", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900887553", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900887572", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900887591", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900887611", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900887629", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900887650", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900887672", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900887693", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228900887713", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900887734", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900887753", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228909189654", + "member": "lab02.glab.lol", + "message": "ovs|00272|connmgr|INFO|br-int<->unix#7: 877 flow_mods in the 7 s starting 10 s ago (813 adds, 57 deletes, 7 modifications)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899183349", + "member": "lab03.glab.lol", + "message": "ovs|00290|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899183846", + "member": "lab03.glab.lol", + "message": "ovs|00291|bridge|INFO|bridge incusovn16: using datapath ID 00002654629f1141" + }, + { + "at": "1789228899183886", + "member": "lab03.glab.lol", + "message": "ovs|00292|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899185533", + "member": "lab03.glab.lol", + "message": "ovs|00293|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185579", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185595", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185609", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185621", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185631", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185646", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054183ms" + }, + { + "at": "1789228899185658", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054183ms" + }, + { + "at": "1789228899185669", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054183ms" + }, + { + "at": "1789228899185680", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185691", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185701", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185712", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228899185723", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185734", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185745", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185755", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185765", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185776", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185786", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185796", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185809", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185822", + "member": "lab03.glab.lol", + "message": "ovs|00294|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185835", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185847", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185855", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185866", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185876", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185886", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054183ms" + }, + { + "at": "1789228899185896", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054183ms" + }, + { + "at": "1789228899185907", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054183ms" + }, + { + "at": "1789228899185916", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185925", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185935", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185943", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899185956", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185968", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185977", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185987", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185997", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186005", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186014", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186022", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186030", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186041", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899261010", + "member": "lab03.glab.lol", + "message": "ovs|00295|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899261076", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899261108", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899261132", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899261156", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899261178", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899261201", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054258ms" + }, + { + "at": "1789228899261226", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054258ms" + }, + { + "at": "1789228899261255", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054258ms" + }, + { + "at": "1789228899261280", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899261302", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899261323", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261345", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899261368", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899261392", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261416", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899261439", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899261462", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261493", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899261516", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899261539", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261564", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899267924", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler354)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899267964", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler354)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899267979", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899267996", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899268011", + "member": "lab03.glab.lol", + "message": " my_disc:0x752e80e1 your_disc:0x0" + }, + { + "at": "1789228899268023", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899268035", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899268046", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899268057", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268077", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268088", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268099", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268112", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054265ms" + }, + { + "at": "1789228899268124", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054265ms" + }, + { + "at": "1789228899268138", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054265ms" + }, + { + "at": "1789228899268157", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268166", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268180", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268192", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899268204", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268216", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268228", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268238", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268252", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268268", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228899268281", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899268290", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268306", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899268340", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899268353", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899268363", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268373", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268382", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268394", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268404", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899268419", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054265ms" + }, + { + "at": "1789228899268428", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054265ms" + }, + { + "at": "1789228899268443", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268453", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268466", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268476", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899268486", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268499", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268510", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268522", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268532", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268556", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228899268567", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268580", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268591", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899280146", + "member": "lab03.glab.lol", + "message": "ovs|00296|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899280179", + "member": "lab03.glab.lol", + "message": "ovs|00297|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228899286270", + "member": "lab03.glab.lol", + "message": "ovs|00298|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899286333", + "member": "lab03.glab.lol", + "message": "ovs|00299|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228900001516", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler362)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900001623", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler362)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228900001660", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900001689", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900001715", + "member": "lab03.glab.lol", + "message": " my_disc:0x1172530f your_disc:0xcfd32de8" + }, + { + "at": "1789228900001741", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900001818", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900001846", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900001875", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900001897", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900001921", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900001942", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900001966", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054999ms" + }, + { + "at": "1789228900001989", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +134ms" + }, + { + "at": "1789228900002021", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -816ms" + }, + { + "at": "1789228900002047", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900002082", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900002108", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002132", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900002160", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900002183", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002205", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900002226", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900002252", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002280", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1172530f" + }, + { + "at": "1789228900002306", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900002389", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002421", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900002445", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler362)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900002474", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900002498", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900002521", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900002545", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900002568", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900002590", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900002616", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +134ms" + }, + { + "at": "1789228900002644", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -816ms" + }, + { + "at": "1789228900002674", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900002705", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900002736", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002768", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900002804", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900002838", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002864", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900002894", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900002926", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002954", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1172530f" + }, + { + "at": "1789228900002986", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900003021", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900003045", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900096225", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler357)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900096322", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler357)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228900096362", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900096389", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900096410", + "member": "lab03.glab.lol", + "message": " my_disc:0x87bd04ca your_disc:0x17f0052" + }, + { + "at": "1789228900096438", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900096463", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900096486", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900096510", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900096531", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900096560", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900096587", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900096609", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51055094ms" + }, + { + "at": "1789228900096635", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +699ms" + }, + { + "at": "1789228900096664", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51ms" + }, + { + "at": "1789228900096692", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900096716", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900096738", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900096767", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228900096794", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900096816", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900096843", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900096870", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900096939", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900096962", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900096986", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900097021", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097045", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900097080", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler357)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900097108", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900097133", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900097193", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900097218", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900097241", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900097265", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900097288", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +699ms" + }, + { + "at": "1789228900097315", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51ms" + }, + { + "at": "1789228900097341", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900097363", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900097385", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900097408", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228900097431", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900097460", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097484", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900097507", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900097536", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900097563", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900097584", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900097605", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097628", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900208233", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900208584", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900208617", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900208642", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900208667", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900208688", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900208712", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900208744", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +78ms" + }, + { + "at": "1789228900208769", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -922ms" + }, + { + "at": "1789228900208795", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900208819", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900208852", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900208876", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228900208899", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900208921", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900208944", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900208966", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900208990", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900209019", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228900209043", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900209085", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900209113", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228901384909", + "member": "lab03.glab.lol", + "message": "ovs|00300|bridge|INFO|bridge br-int: added interface veth5c0c349e on port 38" + }, + { + "at": "1789228909189260", + "member": "lab03.glab.lol", + "message": "ovs|00301|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 7 s starting 10 s ago (849 adds, 81 deletes, 7 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899062010", + "member": "nas01.glab.lol", + "message": "ovs|00266|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899062147", + "member": "nas01.glab.lol", + "message": "ovs|00267|bridge|INFO|bridge incusovn16: using datapath ID 0000c2a8a0e84b40" + }, + { + "at": "1789228899062160", + "member": "nas01.glab.lol", + "message": "ovs|00268|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899159484", + "member": "nas01.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899159607", + "member": "nas01.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228899164947", + "member": "nas01.glab.lol", + "message": "ovs|00271|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899165007", + "member": "nas01.glab.lol", + "message": "ovs|00272|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789228899185637", + "member": "nas01.glab.lol", + "message": "ovs|00273|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185659", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185676", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185692", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185702", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185713", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185725", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281049ms" + }, + { + "at": "1789228899185737", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281049ms" + }, + { + "at": "1789228899185750", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281049ms" + }, + { + "at": "1789228899185761", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185771", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185782", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185794", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899185806", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185818", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185827", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185839", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185849", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185860", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185870", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185885", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185894", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185911", + "member": "nas01.glab.lol", + "message": "ovs|00274|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185931", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185943", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185956", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185966", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185980", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185994", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281049ms" + }, + { + "at": "1789228899186006", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281049ms" + }, + { + "at": "1789228899186016", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281049ms" + }, + { + "at": "1789228899186026", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186036", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899186046", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186057", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899186068", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899186078", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186087", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899186097", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899186107", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186117", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186128", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186138", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186146", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186157", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899191871", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler369)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899192013", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler369)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899192036", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899192066", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899192083", + "member": "nas01.glab.lol", + "message": " my_disc:0xcfd32de8 your_disc:0x0" + }, + { + "at": "1789228899192144", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899192166", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899192182", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899192197", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899192213", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899192228", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899192244", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899192261", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281055ms" + }, + { + "at": "1789228899192278", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +815ms" + }, + { + "at": "1789228899192295", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228899192316", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899192330", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899192348", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192362", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899192378", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192393", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192410", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899192427", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899192447", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192463", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899192479", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899192494", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192509", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899192527", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899192545", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899192559", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899192575", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899192589", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899192604", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899192618", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899192640", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +814ms" + }, + { + "at": "1789228899192656", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228899192674", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899192689", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899192703", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192720", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899192734", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192749", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192766", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899192780", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899192794", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192808", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899192823", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192847", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192862", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899267280", + "member": "nas01.glab.lol", + "message": "ovs|00275|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899267322", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899267341", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899267352", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899267362", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899267378", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899267389", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281131ms" + }, + { + "at": "1789228899267399", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281131ms" + }, + { + "at": "1789228899267431", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281131ms" + }, + { + "at": "1789228899267442", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899267454", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899267464", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899267475", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899267490", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899267500", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899267510", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899267525", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899267535", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899267545", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899267554", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899267566", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899267576", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899291694", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler369)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899291856", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler369)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228899291879", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899291894", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899291910", + "member": "nas01.glab.lol", + "message": " my_disc:0xc3aebc58 your_disc:0x0" + }, + { + "at": "1789228899291935", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899291950", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899291965", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899291980", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291996", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899292010", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899292025", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899292038", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281155ms" + }, + { + "at": "1789228899292054", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +874ms" + }, + { + "at": "1789228899292076", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -106ms" + }, + { + "at": "1789228899292092", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899292113", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899292134", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292153", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899292169", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292184", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292199", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899292213", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899292228", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292242", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899292265", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899292279", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292297", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899292312", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899292330", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899292349", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899292364", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899292379", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899292394", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899292409", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899292423", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +874ms" + }, + { + "at": "1789228899292437", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -106ms" + }, + { + "at": "1789228899292457", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899292471", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899292488", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292502", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899292517", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292531", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292546", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899292567", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899292581", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292596", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899292610", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292631", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292646", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899373920", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler369)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899374037", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler369)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899374055", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899374078", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899374093", + "member": "nas01.glab.lol", + "message": " my_disc:0x36cbd78 your_disc:0x35a20d9" + }, + { + "at": "1789228899374111", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899374128", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899374141", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899374156", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899374172", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899374193", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899374215", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899374230", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281237ms" + }, + { + "at": "1789228899374246", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +823ms" + }, + { + "at": "1789228899374262", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -87ms" + }, + { + "at": "1789228899374282", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899374298", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899374313", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374329", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899374344", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374354", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374365", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899374374", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899374390", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374401", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x36cbd78" + }, + { + "at": "1789228899374412", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899374422", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374433", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899374448", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler369)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899374465", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899374483", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899374496", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899374510", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899374524", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899374539", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899374554", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +822ms" + }, + { + "at": "1789228899374571", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -88ms" + }, + { + "at": "1789228899374592", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899374607", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899374617", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374626", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899374636", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374648", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374658", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899374667", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899374677", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374687", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x36cbd78" + }, + { + "at": "1789228899374697", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374707", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374716", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900141572", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900142029", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900142072", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900142110", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900142139", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900142168", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900142197", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900142227", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +815ms" + }, + { + "at": "1789228900142256", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -135ms" + }, + { + "at": "1789228900142285", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900142312", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900142358", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900142382", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228900142406", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900142436", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900142466", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900142488", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900142510", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900142528", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900142548", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900142566", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900142586", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900242168", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900242357", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900242396", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900242426", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900242453", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900242484", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900242514", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900242541", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +853ms" + }, + { + "at": "1789228900242578", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789228900242609", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900242638", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900242667", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900242694", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228900242717", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900242729", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900242739", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900242754", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900242768", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900242784", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900242799", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900242814", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900242825", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228909066722", + "member": "nas01.glab.lol", + "message": "ovs|00276|connmgr|INFO|br-int<->unix#7: 924 flow_mods in the 7 s starting 10 s ago (840 adds, 84 deletes)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-teardown.txt new file mode 100644 index 0000000..b2c5c49 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-after-teardown.txt @@ -0,0 +1,6084 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ovn-nbctl list HA_Chassis_Group === +=== ovn-nbctl list HA_Chassis === +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899275202", + "member": "lab01.glab.lol", + "message": "ovs|00043|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899275575", + "member": "lab01.glab.lol", + "message": "ovs|00044|bridge|INFO|bridge incusovn16: using datapath ID 00002ee577a07046" + }, + { + "at": "1789228899275595", + "member": "lab01.glab.lol", + "message": "ovs|00045|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899277423", + "member": "lab01.glab.lol", + "message": "ovs|00046|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899277483", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899277503", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899277530", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899277545", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899277564", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899277581", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899277595", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899277611", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899277630", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899277650", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899277665", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277679", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899277695", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899277708", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899277719", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899277732", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899277746", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277759", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899277773", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899277786", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899277800", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899277813", + "member": "lab01.glab.lol", + "message": "ovs|00047|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899277828", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899277839", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899277857", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899277869", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899277880", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899277892", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899277903", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899277914", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899277927", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899277938", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899277948", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277965", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899277978", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899277990", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278001", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899278011", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899278022", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278035", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899278047", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899278059", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278070", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899278081", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor33)|INFO|monitor thread created" + }, + { + "at": "1789228899278094", + "member": "lab01.glab.lol", + "message": "ovs|00048|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899278108", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899278119", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899278129", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899278140", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899278150", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899278161", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899278176", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899278188", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899278200", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899278211", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899278227", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278239", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899278255", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899278266", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278277", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899278289", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899278304", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278316", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899278327", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899278342", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278353", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899290962", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler1)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899291032", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler1)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228899291065", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899291097", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899291120", + "member": "lab01.glab.lol", + "message": " my_disc:0x35a20d9 your_disc:0x0" + }, + { + "at": "1789228899291148", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899291171", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899291193", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899291212", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291231", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899291249", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899291264", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899291285", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214294ms" + }, + { + "at": "1789228899291311", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214294ms" + }, + { + "at": "1789228899291333", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214294ms" + }, + { + "at": "1789228899291352", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899291370", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899291390", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291407", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899291425", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291443", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291463", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899291480", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899291509", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291536", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228899291554", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899291571", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291590", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899291610", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899291630", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899291647", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291662", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899291679", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899291694", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899291711", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899291731", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214294ms" + }, + { + "at": "1789228899291748", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214294ms" + }, + { + "at": "1789228899291766", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899291781", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899291798", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291814", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899291831", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291846", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291865", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899291882", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899291899", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291915", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228899291937", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291956", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291978", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899296105", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler1)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899296184", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler1)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228899296212", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899296238", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899296260", + "member": "lab01.glab.lol", + "message": " my_disc:0x4f842aca your_disc:0x23ec2b8f" + }, + { + "at": "1789228899296285", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899296314", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899296338", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899296363", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899296383", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899296405", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899296427", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899296450", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214299ms" + }, + { + "at": "1789228899296479", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789228899296503", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -18ms" + }, + { + "at": "1789228899296526", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899296547", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899296564", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296580", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899296597", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899296615", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899296633", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899296652", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899296673", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296691", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4f842aca" + }, + { + "at": "1789228899296711", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899296728", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899296745", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899296762", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler1)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899296781", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899296798", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899296816", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899296833", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899296851", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899296866", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899296884", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789228899296902", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -18ms" + }, + { + "at": "1789228899296920", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899296938", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899296955", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296975", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899296993", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297011", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297026", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297041", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297057", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297074", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4f842aca" + }, + { + "at": "1789228899297089", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297107", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297124", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899297139", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler1)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899297156", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler1)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899297177", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899297195", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899297212", + "member": "lab01.glab.lol", + "message": " my_disc:0xd5bc00a8 your_disc:0x752e80e1" + }, + { + "at": "1789228899297232", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899297250", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899297267", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899297285", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899297302", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899297323", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899297341", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899297357", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214300ms" + }, + { + "at": "1789228899297381", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +921ms" + }, + { + "at": "1789228899297401", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -19ms" + }, + { + "at": "1789228899297419", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899297434", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899297451", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297468", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899297486", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297501", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297516", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297533", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297550", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297565", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899297585", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899297602", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297619", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899297635", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler1)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899297655", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899297670", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899297685", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899297702", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899297719", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899297736", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899297753", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +921ms" + }, + { + "at": "1789228899297771", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -19ms" + }, + { + "at": "1789228899297828", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899297844", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899297859", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297877", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899297893", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297911", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297928", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297945", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297960", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297977", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899297994", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899298011", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899298026", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899373949", + "member": "lab01.glab.lol", + "message": "ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374056", + "member": "lab01.glab.lol", + "message": "ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899374277", + "member": "lab01.glab.lol", + "message": "ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374330", + "member": "lab01.glab.lol", + "message": "ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899375364", + "member": "lab01.glab.lol", + "message": "ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899375439", + "member": "lab01.glab.lol", + "message": "ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899376218", + "member": "lab01.glab.lol", + "message": "ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899376241", + "member": "lab01.glab.lol", + "message": "ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377021", + "member": "lab01.glab.lol", + "message": "ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377055", + "member": "lab01.glab.lol", + "message": "ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377866", + "member": "lab01.glab.lol", + "message": "ovs|00059|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228899377910", + "member": "lab01.glab.lol", + "message": "ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377923", + "member": "lab01.glab.lol", + "message": "ovs|00061|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2" + }, + { + "at": "1789228899379010", + "member": "lab01.glab.lol", + "message": "ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899379810", + "member": "lab01.glab.lol", + "message": "ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899380595", + "member": "lab01.glab.lol", + "message": "ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900202282", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900202409", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900202420", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900202428", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900202441", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900202452", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900202464", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900202472", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +116ms" + }, + { + "at": "1789228900202480", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -824ms" + }, + { + "at": "1789228900202488", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900202498", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900202507", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900202515", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228900202524", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900202531", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900202540", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900202549", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900202558", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900202565", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228900202577", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900202589", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900202597", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900376948", + "member": "lab01.glab.lol", + "message": "ovs|00065|dpif|WARN|Dropped 1950 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228900377154", + "member": "lab01.glab.lol", + "message": "ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900629527", + "member": "lab01.glab.lol", + "message": "ovs|00067|bridge|INFO|bridge br-int: added interface veth907501d5 on port 3" + }, + { + "at": "1789228901376650", + "member": "lab01.glab.lol", + "message": "ovs|00068|dpif|WARN|Dropped 1882 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228901376717", + "member": "lab01.glab.lol", + "message": "ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902376343", + "member": "lab01.glab.lol", + "message": "ovs|00070|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228902376664", + "member": "lab01.glab.lol", + "message": "ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902381712", + "member": "lab01.glab.lol", + "message": "ovs|00072|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902382186", + "member": "lab01.glab.lol", + "message": "ovs|00073|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902382722", + "member": "lab01.glab.lol", + "message": "ovs|00074|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902383206", + "member": "lab01.glab.lol", + "message": "ovs|00075|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902383720", + "member": "lab01.glab.lol", + "message": "ovs|00076|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902384129", + "member": "lab01.glab.lol", + "message": "ovs|00077|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902384744", + "member": "lab01.glab.lol", + "message": "ovs|00078|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902385146", + "member": "lab01.glab.lol", + "message": "ovs|00079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902385744", + "member": "lab01.glab.lol", + "message": "ovs|00080|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902386175", + "member": "lab01.glab.lol", + "message": "ovs|00081|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228903376673", + "member": "lab01.glab.lol", + "message": "ovs|00082|dpif|WARN|Dropped 1927 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228903376846", + "member": "lab01.glab.lol", + "message": "ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228904376908", + "member": "lab01.glab.lol", + "message": "ovs|00084|dpif|WARN|Dropped 1937 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228904377088", + "member": "lab01.glab.lol", + "message": "ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228905376863", + "member": "lab01.glab.lol", + "message": "ovs|00086|dpif|WARN|Dropped 1947 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228905376940", + "member": "lab01.glab.lol", + "message": "ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228906376435", + "member": "lab01.glab.lol", + "message": "ovs|00088|dpif|WARN|Dropped 1917 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228906376535", + "member": "lab01.glab.lol", + "message": "ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228907376363", + "member": "lab01.glab.lol", + "message": "ovs|00090|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228907376589", + "member": "lab01.glab.lol", + "message": "ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228908376575", + "member": "lab01.glab.lol", + "message": "ovs|00092|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228908376751", + "member": "lab01.glab.lol", + "message": "ovs|00093|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228908381777", + "member": "lab01.glab.lol", + "message": "ovs|00094|poll_loop|INFO|Dropped 11601 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228908381849", + "member": "lab01.glab.lol", + "message": "ovs|00095|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228909279516", + "member": "lab01.glab.lol", + "message": "ovs|00096|connmgr|INFO|br-int<->unix#3: 908 flow_mods in the 7 s starting 10 s ago (843 adds, 58 deletes, 7 modifications)" + }, + { + "at": "1789228909376882", + "member": "lab01.glab.lol", + "message": "ovs|00097|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228909377216", + "member": "lab01.glab.lol", + "message": "ovs|00098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228910376619", + "member": "lab01.glab.lol", + "message": "ovs|00099|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228910376764", + "member": "lab01.glab.lol", + "message": "ovs|00100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228911376730", + "member": "lab01.glab.lol", + "message": "ovs|00101|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228911376966", + "member": "lab01.glab.lol", + "message": "ovs|00102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228912376652", + "member": "lab01.glab.lol", + "message": "ovs|00103|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228912376775", + "member": "lab01.glab.lol", + "message": "ovs|00104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228913376892", + "member": "lab01.glab.lol", + "message": "ovs|00105|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228913377129", + "member": "lab01.glab.lol", + "message": "ovs|00106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228914376463", + "member": "lab01.glab.lol", + "message": "ovs|00107|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228914376559", + "member": "lab01.glab.lol", + "message": "ovs|00108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228914381820", + "member": "lab01.glab.lol", + "message": "ovs|00109|poll_loop|INFO|Dropped 11629 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228914381969", + "member": "lab01.glab.lol", + "message": "ovs|00110|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228915376849", + "member": "lab01.glab.lol", + "message": "ovs|00111|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228915376982", + "member": "lab01.glab.lol", + "message": "ovs|00112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228916376802", + "member": "lab01.glab.lol", + "message": "ovs|00113|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228916377038", + "member": "lab01.glab.lol", + "message": "ovs|00114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228917376942", + "member": "lab01.glab.lol", + "message": "ovs|00115|dpif|WARN|Dropped 1954 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228917377182", + "member": "lab01.glab.lol", + "message": "ovs|00116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228918376883", + "member": "lab01.glab.lol", + "message": "ovs|00117|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228918377000", + "member": "lab01.glab.lol", + "message": "ovs|00118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228919376978", + "member": "lab01.glab.lol", + "message": "ovs|00119|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228919377105", + "member": "lab01.glab.lol", + "message": "ovs|00120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228920376539", + "member": "lab01.glab.lol", + "message": "ovs|00121|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228920376668", + "member": "lab01.glab.lol", + "message": "ovs|00122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228920381731", + "member": "lab01.glab.lol", + "message": "ovs|00123|poll_loop|INFO|Dropped 11662 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228920381873", + "member": "lab01.glab.lol", + "message": "ovs|00124|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228921376811", + "member": "lab01.glab.lol", + "message": "ovs|00125|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228921376948", + "member": "lab01.glab.lol", + "message": "ovs|00126|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228922376774", + "member": "lab01.glab.lol", + "message": "ovs|00127|dpif|WARN|Dropped 1963 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228922377000", + "member": "lab01.glab.lol", + "message": "ovs|00128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228923376697", + "member": "lab01.glab.lol", + "message": "ovs|00129|dpif|WARN|Dropped 1945 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228923376796", + "member": "lab01.glab.lol", + "message": "ovs|00130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228924376806", + "member": "lab01.glab.lol", + "message": "ovs|00131|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228924377017", + "member": "lab01.glab.lol", + "message": "ovs|00132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228925376814", + "member": "lab01.glab.lol", + "message": "ovs|00133|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228925376995", + "member": "lab01.glab.lol", + "message": "ovs|00134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228926377059", + "member": "lab01.glab.lol", + "message": "ovs|00135|dpif|WARN|Dropped 1914 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228926377392", + "member": "lab01.glab.lol", + "message": "ovs|00136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228926381908", + "member": "lab01.glab.lol", + "message": "ovs|00137|poll_loop|INFO|Dropped 11619 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228926381948", + "member": "lab01.glab.lol", + "message": "ovs|00138|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228927376594", + "member": "lab01.glab.lol", + "message": "ovs|00139|dpif|WARN|Dropped 1929 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228927376673", + "member": "lab01.glab.lol", + "message": "ovs|00140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228928376675", + "member": "lab01.glab.lol", + "message": "ovs|00141|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228928376857", + "member": "lab01.glab.lol", + "message": "ovs|00142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228929376605", + "member": "lab01.glab.lol", + "message": "ovs|00143|dpif|WARN|Dropped 1922 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228929376761", + "member": "lab01.glab.lol", + "message": "ovs|00144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228930376822", + "member": "lab01.glab.lol", + "message": "ovs|00145|dpif|WARN|Dropped 1900 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228930377119", + "member": "lab01.glab.lol", + "message": "ovs|00146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228931376357", + "member": "lab01.glab.lol", + "message": "ovs|00147|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228931376458", + "member": "lab01.glab.lol", + "message": "ovs|00148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228932376480", + "member": "lab01.glab.lol", + "message": "ovs|00149|dpif|WARN|Dropped 1913 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228932376688", + "member": "lab01.glab.lol", + "message": "ovs|00150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228932381398", + "member": "lab01.glab.lol", + "message": "ovs|00151|poll_loop|INFO|Dropped 11514 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228932381487", + "member": "lab01.glab.lol", + "message": "ovs|00152|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228933376822", + "member": "lab01.glab.lol", + "message": "ovs|00153|dpif|WARN|Dropped 1943 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228933377019", + "member": "lab01.glab.lol", + "message": "ovs|00154|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228934376824", + "member": "lab01.glab.lol", + "message": "ovs|00155|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228934377036", + "member": "lab01.glab.lol", + "message": "ovs|00156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228935376543", + "member": "lab01.glab.lol", + "message": "ovs|00157|dpif|WARN|Dropped 1920 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228935376664", + "member": "lab01.glab.lol", + "message": "ovs|00158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228936376852", + "member": "lab01.glab.lol", + "message": "ovs|00159|dpif|WARN|Dropped 1912 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228936377081", + "member": "lab01.glab.lol", + "message": "ovs|00160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228937376602", + "member": "lab01.glab.lol", + "message": "ovs|00161|dpif|WARN|Dropped 1923 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228937376710", + "member": "lab01.glab.lol", + "message": "ovs|00162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228938376631", + "member": "lab01.glab.lol", + "message": "ovs|00163|dpif|WARN|Dropped 1955 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228938376857", + "member": "lab01.glab.lol", + "message": "ovs|00164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228938381918", + "member": "lab01.glab.lol", + "message": "ovs|00165|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228938382013", + "member": "lab01.glab.lol", + "message": "ovs|00166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228939376692", + "member": "lab01.glab.lol", + "message": "ovs|00167|dpif|WARN|Dropped 1915 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228939376900", + "member": "lab01.glab.lol", + "message": "ovs|00168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228940376789", + "member": "lab01.glab.lol", + "message": "ovs|00169|dpif|WARN|Dropped 1918 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228940376992", + "member": "lab01.glab.lol", + "message": "ovs|00170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228941376928", + "member": "lab01.glab.lol", + "message": "ovs|00171|dpif|WARN|Dropped 1926 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228941377177", + "member": "lab01.glab.lol", + "message": "ovs|00172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228942376783", + "member": "lab01.glab.lol", + "message": "ovs|00173|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228942376884", + "member": "lab01.glab.lol", + "message": "ovs|00174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228943376779", + "member": "lab01.glab.lol", + "message": "ovs|00175|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228943377003", + "member": "lab01.glab.lol", + "message": "ovs|00176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228944376466", + "member": "lab01.glab.lol", + "message": "ovs|00177|dpif|WARN|Dropped 1932 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228944376610", + "member": "lab01.glab.lol", + "message": "ovs|00178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228944381734", + "member": "lab01.glab.lol", + "message": "ovs|00179|poll_loop|INFO|Dropped 11582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228944381884", + "member": "lab01.glab.lol", + "message": "ovs|00180|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228945376657", + "member": "lab01.glab.lol", + "message": "ovs|00181|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228945376794", + "member": "lab01.glab.lol", + "message": "ovs|00182|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228946376641", + "member": "lab01.glab.lol", + "message": "ovs|00183|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228946376823", + "member": "lab01.glab.lol", + "message": "ovs|00184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228947376818", + "member": "lab01.glab.lol", + "message": "ovs|00185|dpif|WARN|Dropped 1946 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228947377021", + "member": "lab01.glab.lol", + "message": "ovs|00186|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228948376758", + "member": "lab01.glab.lol", + "message": "ovs|00187|dpif|WARN|Dropped 1941 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228948376849", + "member": "lab01.glab.lol", + "message": "ovs|00188|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228949376467", + "member": "lab01.glab.lol", + "message": "ovs|00189|dpif|WARN|Dropped 1928 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228949376597", + "member": "lab01.glab.lol", + "message": "ovs|00190|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228950376804", + "member": "lab01.glab.lol", + "message": "ovs|00191|dpif|WARN|Dropped 1916 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228950377088", + "member": "lab01.glab.lol", + "message": "ovs|00192|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228950381874", + "member": "lab01.glab.lol", + "message": "ovs|00193|poll_loop|INFO|Dropped 11631 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228950381960", + "member": "lab01.glab.lol", + "message": "ovs|00194|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228951376871", + "member": "lab01.glab.lol", + "message": "ovs|00195|dpif|WARN|Dropped 1930 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228951377101", + "member": "lab01.glab.lol", + "message": "ovs|00196|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228952376991", + "member": "lab01.glab.lol", + "message": "ovs|00197|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228952377321", + "member": "lab01.glab.lol", + "message": "ovs|00198|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228953376691", + "member": "lab01.glab.lol", + "message": "ovs|00199|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228953376777", + "member": "lab01.glab.lol", + "message": "ovs|00200|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228953611532", + "member": "lab01.glab.lol", + "message": "ovs|00201|bridge|INFO|bridge br-int: deleted interface veth907501d5 on port 3" + }, + { + "at": "1789228954376360", + "member": "lab01.glab.lol", + "message": "ovs|00202|dpif|WARN|Dropped 1942 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228954376462", + "member": "lab01.glab.lol", + "message": "ovs|00203|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228955376492", + "member": "lab01.glab.lol", + "message": "ovs|00204|dpif|WARN|Dropped 1987 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228955376710", + "member": "lab01.glab.lol", + "message": "ovs|00205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228955822555", + "member": "lab01.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228955822582", + "member": "lab01.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228955844935", + "member": "lab01.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2" + }, + { + "at": "1789228955845021", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor33)|INFO|monitor thread terminated" + }, + { + "at": "1789228956848737", + "member": "lab01.glab.lol", + "message": "ovs|00209|poll_loop|INFO|Dropped 10692 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228956848965", + "member": "lab01.glab.lol", + "message": "ovs|00210|poll_loop|INFO|wakeup due to [POLLIN] on fd 71 (FIFO pipe:[24058]) at ../vswitchd/bridge.c:425 (70% CPU usage)" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899183506", + "member": "lab02.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899183615", + "member": "lab02.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge incusovn16: using datapath ID 00009208b9915e49" + }, + { + "at": "1789228899183626", + "member": "lab02.glab.lol", + "message": "ovs|00264|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899185431", + "member": "lab02.glab.lol", + "message": "ovs|00265|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185515", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185545", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185566", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185588", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185606", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185625", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154185ms" + }, + { + "at": "1789228899185656", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154185ms" + }, + { + "at": "1789228899185680", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154185ms" + }, + { + "at": "1789228899185707", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185727", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185747", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185766", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899185786", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185804", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185821", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185843", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185863", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185879", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185896", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185923", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185943", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185961", + "member": "lab02.glab.lol", + "message": "ovs|00266|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185984", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899186002", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899186025", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899186042", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899186059", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899186084", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154185ms" + }, + { + "at": "1789228899186101", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154185ms" + }, + { + "at": "1789228899186118", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154185ms" + }, + { + "at": "1789228899186136", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186153", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899186171", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186189", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899186209", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899186226", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186243", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899186263", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899186280", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899186296", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186312", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186333", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186351", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186368", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186590", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler359)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899186650", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler359)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899186677", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899186701", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899186723", + "member": "lab02.glab.lol", + "message": " my_disc:0x17f0052 your_disc:0x0" + }, + { + "at": "1789228899186742", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899186760", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899186780", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899186797", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899186815", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899186833", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899186850", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899186871", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154186ms" + }, + { + "at": "1789228899186890", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +909ms" + }, + { + "at": "1789228899186911", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789228899186929", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186946", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899186964", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186982", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899186999", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187015", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187034", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899187050", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899187071", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187088", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228899187109", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899187126", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187150", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899187167", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899187185", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899187201", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899187218", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899187235", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899187252", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899187269", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899187290", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +909ms" + }, + { + "at": "1789228899187307", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789228899187324", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899187339", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899187354", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187370", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899187388", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187418", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187434", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899187451", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899187468", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187484", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228899187501", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187521", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187540", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899261253", + "member": "lab02.glab.lol", + "message": "ovs|00267|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899261289", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899261312", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899261333", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899261352", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899261373", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899261400", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154260ms" + }, + { + "at": "1789228899261430", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154260ms" + }, + { + "at": "1789228899261454", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154260ms" + }, + { + "at": "1789228899261485", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899261504", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899261524", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261544", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899261566", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899261585", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261606", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899261625", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899261654", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261675", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899261697", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899261727", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261748", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899268288", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler358)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899268361", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler358)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899268387", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899268417", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899268436", + "member": "lab02.glab.lol", + "message": " my_disc:0x23ec2b8f your_disc:0x0" + }, + { + "at": "1789228899268457", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899268475", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899268494", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899268514", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268533", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268552", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268579", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268602", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154267ms" + }, + { + "at": "1789228899268623", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154267ms" + }, + { + "at": "1789228899268643", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154267ms" + }, + { + "at": "1789228899268663", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268685", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268704", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268724", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899268745", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268764", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268785", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268804", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268823", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268842", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899268862", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899268881", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268898", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899268920", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899268940", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899268959", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268967", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268976", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268984", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268992", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899269005", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154267ms" + }, + { + "at": "1789228899269015", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154267ms" + }, + { + "at": "1789228899269030", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899269038", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899269046", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899269054", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899269061", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899269070", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899269078", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899269086", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899269094", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899269102", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899269110", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899269119", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899269127", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899281411", + "member": "lab02.glab.lol", + "message": "ovs|00268|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899281448", + "member": "lab02.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228899283745", + "member": "lab02.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899283775", + "member": "lab02.glab.lol", + "message": "ovs|00271|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228900088485", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900088626", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900088640", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900088651", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900088662", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900088672", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900088682", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900088696", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228900088705", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -802ms" + }, + { + "at": "1789228900088715", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900088730", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900088746", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900088756", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228900088765", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900088775", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900088784", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900088794", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900088803", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900088812", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228900088821", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900088830", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900088838", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900160502", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler359)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900160596", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler359)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228900160626", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900160652", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900160674", + "member": "lab02.glab.lol", + "message": " my_disc:0xfbce566e your_disc:0xc3aebc58" + }, + { + "at": "1789228900160698", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900160720", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900160747", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900160769", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900160790", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900160810", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900160834", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900160856", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592155159ms" + }, + { + "at": "1789228900160877", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228900160901", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228900160931", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900160952", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900160973", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900160998", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900161020", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161041", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161063", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900161082", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900161104", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161122", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfbce566e" + }, + { + "at": "1789228900161144", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900161165", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161186", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900161205", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler359)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900161230", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900161249", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900161270", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900161291", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900161312", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900161340", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900161361", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228900161380", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228900161421", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900161451", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900161478", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161501", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900161523", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161544", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161565", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900161584", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900161604", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161625", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfbce566e" + }, + { + "at": "1789228900161644", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161664", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161683", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900886981", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900887298", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900887327", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900887348", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900887370", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900887416", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900887437", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900887459", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +39ms" + }, + { + "at": "1789228900887482", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -791ms" + }, + { + "at": "1789228900887514", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900887534", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900887553", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900887572", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900887591", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900887611", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900887629", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900887650", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900887672", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900887693", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228900887713", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900887734", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900887753", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228909189654", + "member": "lab02.glab.lol", + "message": "ovs|00272|connmgr|INFO|br-int<->unix#7: 877 flow_mods in the 7 s starting 10 s ago (813 adds, 57 deletes, 7 modifications)" + }, + { + "at": "1789228955816482", + "member": "lab02.glab.lol", + "message": "ovs|00273|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228955816740", + "member": "lab02.glab.lol", + "message": "ovs|00274|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228955816773", + "member": "lab02.glab.lol", + "message": "ovs|00275|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228955844469", + "member": "lab02.glab.lol", + "message": "ovs|00276|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228955844749", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor385)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899183349", + "member": "lab03.glab.lol", + "message": "ovs|00290|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899183846", + "member": "lab03.glab.lol", + "message": "ovs|00291|bridge|INFO|bridge incusovn16: using datapath ID 00002654629f1141" + }, + { + "at": "1789228899183886", + "member": "lab03.glab.lol", + "message": "ovs|00292|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899185533", + "member": "lab03.glab.lol", + "message": "ovs|00293|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185579", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185595", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185609", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185621", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185631", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185646", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054183ms" + }, + { + "at": "1789228899185658", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054183ms" + }, + { + "at": "1789228899185669", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054183ms" + }, + { + "at": "1789228899185680", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185691", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185701", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185712", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228899185723", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185734", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185745", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185755", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185765", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185776", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185786", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185796", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185809", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185822", + "member": "lab03.glab.lol", + "message": "ovs|00294|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185835", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185847", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185855", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185866", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185876", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185886", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054183ms" + }, + { + "at": "1789228899185896", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054183ms" + }, + { + "at": "1789228899185907", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054183ms" + }, + { + "at": "1789228899185916", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185925", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185935", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185943", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899185956", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185968", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185977", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185987", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185997", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186005", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186014", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186022", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186030", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186041", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899261010", + "member": "lab03.glab.lol", + "message": "ovs|00295|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899261076", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899261108", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899261132", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899261156", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899261178", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899261201", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054258ms" + }, + { + "at": "1789228899261226", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054258ms" + }, + { + "at": "1789228899261255", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054258ms" + }, + { + "at": "1789228899261280", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899261302", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899261323", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261345", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899261368", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899261392", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261416", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899261439", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899261462", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261493", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899261516", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899261539", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261564", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899267924", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler354)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899267964", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler354)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899267979", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899267996", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899268011", + "member": "lab03.glab.lol", + "message": " my_disc:0x752e80e1 your_disc:0x0" + }, + { + "at": "1789228899268023", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899268035", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899268046", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899268057", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268077", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268088", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268099", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268112", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054265ms" + }, + { + "at": "1789228899268124", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054265ms" + }, + { + "at": "1789228899268138", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054265ms" + }, + { + "at": "1789228899268157", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268166", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268180", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268192", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899268204", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268216", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268228", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268238", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268252", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268268", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228899268281", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899268290", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268306", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899268340", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899268353", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899268363", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268373", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268382", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268394", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268404", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899268419", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054265ms" + }, + { + "at": "1789228899268428", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054265ms" + }, + { + "at": "1789228899268443", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268453", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268466", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268476", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899268486", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268499", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268510", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268522", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268532", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268556", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228899268567", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268580", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268591", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899280146", + "member": "lab03.glab.lol", + "message": "ovs|00296|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899280179", + "member": "lab03.glab.lol", + "message": "ovs|00297|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228899286270", + "member": "lab03.glab.lol", + "message": "ovs|00298|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899286333", + "member": "lab03.glab.lol", + "message": "ovs|00299|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228900001516", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler362)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900001623", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler362)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228900001660", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900001689", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900001715", + "member": "lab03.glab.lol", + "message": " my_disc:0x1172530f your_disc:0xcfd32de8" + }, + { + "at": "1789228900001741", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900001818", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900001846", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900001875", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900001897", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900001921", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900001942", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900001966", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054999ms" + }, + { + "at": "1789228900001989", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +134ms" + }, + { + "at": "1789228900002021", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -816ms" + }, + { + "at": "1789228900002047", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900002082", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900002108", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002132", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900002160", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900002183", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002205", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900002226", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900002252", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002280", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1172530f" + }, + { + "at": "1789228900002306", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900002389", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002421", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900002445", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler362)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900002474", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900002498", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900002521", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900002545", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900002568", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900002590", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900002616", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +134ms" + }, + { + "at": "1789228900002644", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -816ms" + }, + { + "at": "1789228900002674", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900002705", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900002736", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002768", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900002804", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900002838", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002864", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900002894", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900002926", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002954", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1172530f" + }, + { + "at": "1789228900002986", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900003021", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900003045", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900096225", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler357)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900096322", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler357)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228900096362", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900096389", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900096410", + "member": "lab03.glab.lol", + "message": " my_disc:0x87bd04ca your_disc:0x17f0052" + }, + { + "at": "1789228900096438", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900096463", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900096486", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900096510", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900096531", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900096560", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900096587", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900096609", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51055094ms" + }, + { + "at": "1789228900096635", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +699ms" + }, + { + "at": "1789228900096664", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51ms" + }, + { + "at": "1789228900096692", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900096716", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900096738", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900096767", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228900096794", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900096816", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900096843", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900096870", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900096939", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900096962", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900096986", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900097021", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097045", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900097080", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler357)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900097108", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900097133", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900097193", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900097218", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900097241", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900097265", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900097288", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +699ms" + }, + { + "at": "1789228900097315", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51ms" + }, + { + "at": "1789228900097341", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900097363", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900097385", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900097408", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228900097431", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900097460", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097484", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900097507", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900097536", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900097563", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900097584", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900097605", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097628", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900208233", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900208584", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900208617", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900208642", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900208667", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900208688", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900208712", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900208744", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +78ms" + }, + { + "at": "1789228900208769", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -922ms" + }, + { + "at": "1789228900208795", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900208819", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900208852", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900208876", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228900208899", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900208921", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900208944", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900208966", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900208990", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900209019", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228900209043", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900209085", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900209113", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228901384909", + "member": "lab03.glab.lol", + "message": "ovs|00300|bridge|INFO|bridge br-int: added interface veth5c0c349e on port 38" + }, + { + "at": "1789228909189260", + "member": "lab03.glab.lol", + "message": "ovs|00301|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 7 s starting 10 s ago (849 adds, 81 deletes, 7 modifications)" + }, + { + "at": "1789228954580894", + "member": "lab03.glab.lol", + "message": "ovs|00302|bridge|INFO|bridge br-int: deleted interface veth5c0c349e on port 38" + }, + { + "at": "1789228955815464", + "member": "lab03.glab.lol", + "message": "ovs|00303|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228955815736", + "member": "lab03.glab.lol", + "message": "ovs|00304|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228955815774", + "member": "lab03.glab.lol", + "message": "ovs|00305|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228955841854", + "member": "lab03.glab.lol", + "message": "ovs|00306|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228955842056", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor385)|INFO|monitor thread terminated" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899062010", + "member": "nas01.glab.lol", + "message": "ovs|00266|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899062147", + "member": "nas01.glab.lol", + "message": "ovs|00267|bridge|INFO|bridge incusovn16: using datapath ID 0000c2a8a0e84b40" + }, + { + "at": "1789228899062160", + "member": "nas01.glab.lol", + "message": "ovs|00268|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899159484", + "member": "nas01.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899159607", + "member": "nas01.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228899164947", + "member": "nas01.glab.lol", + "message": "ovs|00271|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899165007", + "member": "nas01.glab.lol", + "message": "ovs|00272|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789228899185637", + "member": "nas01.glab.lol", + "message": "ovs|00273|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185659", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185676", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185692", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185702", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185713", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185725", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281049ms" + }, + { + "at": "1789228899185737", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281049ms" + }, + { + "at": "1789228899185750", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281049ms" + }, + { + "at": "1789228899185761", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185771", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185782", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185794", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899185806", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185818", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185827", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185839", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185849", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185860", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185870", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185885", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185894", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185911", + "member": "nas01.glab.lol", + "message": "ovs|00274|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185931", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185943", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185956", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185966", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185980", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185994", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281049ms" + }, + { + "at": "1789228899186006", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281049ms" + }, + { + "at": "1789228899186016", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281049ms" + }, + { + "at": "1789228899186026", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186036", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899186046", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186057", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899186068", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899186078", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186087", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899186097", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899186107", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186117", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186128", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186138", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186146", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186157", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899191871", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler369)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899192013", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler369)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899192036", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899192066", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899192083", + "member": "nas01.glab.lol", + "message": " my_disc:0xcfd32de8 your_disc:0x0" + }, + { + "at": "1789228899192144", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899192166", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899192182", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899192197", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899192213", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899192228", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899192244", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899192261", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281055ms" + }, + { + "at": "1789228899192278", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +815ms" + }, + { + "at": "1789228899192295", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228899192316", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899192330", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899192348", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192362", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899192378", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192393", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192410", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899192427", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899192447", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192463", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899192479", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899192494", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192509", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899192527", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899192545", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899192559", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899192575", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899192589", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899192604", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899192618", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899192640", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +814ms" + }, + { + "at": "1789228899192656", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228899192674", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899192689", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899192703", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192720", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899192734", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192749", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192766", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899192780", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899192794", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192808", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899192823", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192847", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192862", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899267280", + "member": "nas01.glab.lol", + "message": "ovs|00275|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899267322", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899267341", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899267352", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899267362", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899267378", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899267389", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281131ms" + }, + { + "at": "1789228899267399", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281131ms" + }, + { + "at": "1789228899267431", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281131ms" + }, + { + "at": "1789228899267442", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899267454", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899267464", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899267475", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899267490", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899267500", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899267510", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899267525", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899267535", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899267545", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899267554", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899267566", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899267576", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899291694", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler369)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899291856", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler369)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228899291879", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899291894", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899291910", + "member": "nas01.glab.lol", + "message": " my_disc:0xc3aebc58 your_disc:0x0" + }, + { + "at": "1789228899291935", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899291950", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899291965", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899291980", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291996", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899292010", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899292025", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899292038", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281155ms" + }, + { + "at": "1789228899292054", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +874ms" + }, + { + "at": "1789228899292076", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -106ms" + }, + { + "at": "1789228899292092", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899292113", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899292134", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292153", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899292169", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292184", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292199", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899292213", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899292228", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292242", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899292265", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899292279", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292297", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899292312", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899292330", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899292349", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899292364", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899292379", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899292394", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899292409", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899292423", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +874ms" + }, + { + "at": "1789228899292437", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -106ms" + }, + { + "at": "1789228899292457", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899292471", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899292488", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292502", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899292517", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292531", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292546", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899292567", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899292581", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292596", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899292610", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292631", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292646", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899373920", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler369)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899374037", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler369)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899374055", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899374078", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899374093", + "member": "nas01.glab.lol", + "message": " my_disc:0x36cbd78 your_disc:0x35a20d9" + }, + { + "at": "1789228899374111", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899374128", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899374141", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899374156", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899374172", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899374193", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899374215", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899374230", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281237ms" + }, + { + "at": "1789228899374246", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +823ms" + }, + { + "at": "1789228899374262", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -87ms" + }, + { + "at": "1789228899374282", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899374298", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899374313", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374329", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899374344", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374354", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374365", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899374374", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899374390", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374401", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x36cbd78" + }, + { + "at": "1789228899374412", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899374422", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374433", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899374448", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler369)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899374465", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899374483", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899374496", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899374510", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899374524", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899374539", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899374554", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +822ms" + }, + { + "at": "1789228899374571", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -88ms" + }, + { + "at": "1789228899374592", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899374607", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899374617", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374626", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899374636", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374648", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374658", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899374667", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899374677", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374687", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x36cbd78" + }, + { + "at": "1789228899374697", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374707", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374716", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900141572", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900142029", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900142072", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900142110", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900142139", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900142168", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900142197", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900142227", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +815ms" + }, + { + "at": "1789228900142256", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -135ms" + }, + { + "at": "1789228900142285", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900142312", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900142358", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900142382", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228900142406", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900142436", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900142466", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900142488", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900142510", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900142528", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900142548", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900142566", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900142586", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900242168", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900242357", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900242396", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900242426", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900242453", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900242484", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900242514", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900242541", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +853ms" + }, + { + "at": "1789228900242578", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789228900242609", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900242638", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900242667", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900242694", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228900242717", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900242729", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900242739", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900242754", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900242768", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900242784", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900242799", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900242814", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900242825", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228909066722", + "member": "nas01.glab.lol", + "message": "ovs|00276|connmgr|INFO|br-int<->unix#7: 924 flow_mods in the 7 s starting 10 s ago (840 adds, 84 deletes)" + }, + { + "at": "1789228955825150", + "member": "nas01.glab.lol", + "message": "ovs|00277|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228955825290", + "member": "nas01.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228955825311", + "member": "nas01.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228955846250", + "member": "nas01.glab.lol", + "message": "ovs|00280|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789228955846333", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor385)|INFO|monitor thread terminated" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-before-probe.txt new file mode 100644 index 0000000..04dc636 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/diagnostics-before-probe.txt @@ -0,0 +1,5528 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d9:78:08 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8f:56:95 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 2d55097d-204e-41d0-8eb5-9cc1c55adc9d (incus-net38-ls-int) + port incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0 + addresses: ["10:66:6a:8f:56:95 dynamic"] + port incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0 + addresses: ["10:66:6a:d9:78:08 dynamic"] + port incus-net38-ls-int-lsp-router + type: router + router-port: incus-net38-lr-lrp-int +switch 2611bfc6-bdb5-44f6-a09e-9eb8763a2cb2 (incus-net38-ls-ext) + port incus-net38-ls-ext-lsp-router + type: router + router-port: incus-net38-lr-lrp-ext + port incus-net38-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router 13cb6f52-142b-42be-9fc9-d07b5a432cc9 (incus-net38-lr) + port incus-net38-lr-lrp-int + mac: "10:66:6a:43:84:fe" + ipv6-lla: "fe80::1266:6aff:fe43:84fe" + networks: ["10.253.73.1/24"] + port incus-net38-lr-lrp-ext + mac: "10:66:6a:43:84:fe" + ipv6-lla: "fe80::1266:6aff:fe43:84fe" + networks: ["10.10.40.64/24"] + nat 5fae479d-e83a-4345-9aff-819b51257038 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net38-instance-7b930fd9-10fd-4078-b66e-699779aa9bbc-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net38-lr-lrp-ext + Port_Binding incus-net38-instance-90400719-d170-40f8-8690-7e17fde270db-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 71527675-42da-4982-894c-c52663cdd4c2 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 80ca99c2-2647-418e-83bc-912afdfa528d +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:43:84:fe" +name : incus-net38-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : 13e4bb8d-2e09-4bae-85d8-ded30bc8185f +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:43:84:fe" +name : incus-net38-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 62b79c31-2ea0-46f1-a016-51d740ca723e +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 69f2ce8e-ada9-4fff-864e-591908009cd1 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 8cf3d44d-d3cc-4e98-8ce8-345cfd643311 +logical_port : cr-incus-net38-lr-lrp-ext +mac : ["10:66:6a:43:84:fe 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net38-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : 80ca99c2-2647-418e-83bc-912afdfa528d +external_ids : {} +ha_chassis : [04daa0d0-7900-4bae-8267-6dafc1b6f9dd, 1f7024f7-1abf-4c67-a9b7-1e1065b829d5, 3695bc80-f75a-4ed9-9cf4-9b373c4274b1, ffee2173-5fe8-4a45-8659-20e9ec744920] +name : incus-net38 +=== ovn-nbctl list HA_Chassis === +_uuid : 3695bc80-f75a-4ed9-9cf4-9b373c4274b1 +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 17040 + +_uuid : 04daa0d0-7900-4bae-8267-6dafc1b6f9dd +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 11633 + +_uuid : 1f7024f7-1abf-4c67-a9b7-1e1065b829d5 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 32081 + +_uuid : ffee2173-5fe8-4a45-8659-20e9ec744920 +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 30804 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 INCOMPLETE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899275202", + "member": "lab01.glab.lol", + "message": "ovs|00043|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899275575", + "member": "lab01.glab.lol", + "message": "ovs|00044|bridge|INFO|bridge incusovn16: using datapath ID 00002ee577a07046" + }, + { + "at": "1789228899275595", + "member": "lab01.glab.lol", + "message": "ovs|00045|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899277423", + "member": "lab01.glab.lol", + "message": "ovs|00046|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899277483", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899277503", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899277530", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899277545", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899277564", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899277581", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899277595", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899277611", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899277630", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899277650", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899277665", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277679", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899277695", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899277708", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899277719", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899277732", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899277746", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277759", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899277773", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899277786", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899277800", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899277813", + "member": "lab01.glab.lol", + "message": "ovs|00047|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899277828", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899277839", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899277857", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899277869", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899277880", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899277892", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899277903", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899277914", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899277927", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899277938", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899277948", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899277965", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899277978", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899277990", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278001", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899278011", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899278022", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278035", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899278047", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899278059", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278070", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899278081", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor33)|INFO|monitor thread created" + }, + { + "at": "1789228899278094", + "member": "lab01.glab.lol", + "message": "ovs|00048|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899278108", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899278119", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899278129", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899278140", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899278150", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899278161", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214281ms" + }, + { + "at": "1789228899278176", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214281ms" + }, + { + "at": "1789228899278188", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214281ms" + }, + { + "at": "1789228899278200", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899278211", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899278227", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278239", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899278255", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899278266", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278277", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899278289", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899278304", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899278316", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899278327", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899278342", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899278353", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899290962", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler1)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899291032", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler1)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228899291065", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899291097", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899291120", + "member": "lab01.glab.lol", + "message": " my_disc:0x35a20d9 your_disc:0x0" + }, + { + "at": "1789228899291148", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899291171", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899291193", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899291212", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291231", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899291249", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899291264", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899291285", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214294ms" + }, + { + "at": "1789228899291311", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214294ms" + }, + { + "at": "1789228899291333", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214294ms" + }, + { + "at": "1789228899291352", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899291370", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899291390", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291407", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899291425", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291443", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291463", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899291480", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899291509", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291536", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228899291554", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899291571", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291590", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899291610", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899291630", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899291647", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291662", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899291679", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899291694", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899291711", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899291731", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -214294ms" + }, + { + "at": "1789228899291748", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -214294ms" + }, + { + "at": "1789228899291766", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899291781", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899291798", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291814", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228899291831", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291846", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291865", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899291882", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899291899", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899291915", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228899291937", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899291956", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899291978", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899296105", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler1)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899296184", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler1)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228899296212", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899296238", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899296260", + "member": "lab01.glab.lol", + "message": " my_disc:0x4f842aca your_disc:0x23ec2b8f" + }, + { + "at": "1789228899296285", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899296314", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899296338", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899296363", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899296383", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899296405", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899296427", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899296450", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214299ms" + }, + { + "at": "1789228899296479", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789228899296503", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -18ms" + }, + { + "at": "1789228899296526", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899296547", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899296564", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296580", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899296597", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899296615", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899296633", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899296652", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899296673", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296691", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4f842aca" + }, + { + "at": "1789228899296711", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899296728", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899296745", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899296762", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler1)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899296781", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899296798", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899296816", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899296833", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899296851", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899296866", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899296884", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +802ms" + }, + { + "at": "1789228899296902", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -18ms" + }, + { + "at": "1789228899296920", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899296938", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899296955", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899296975", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899296993", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297011", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297026", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297041", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297057", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297074", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4f842aca" + }, + { + "at": "1789228899297089", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297107", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297124", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899297139", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler1)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899297156", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler1)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899297177", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899297195", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899297212", + "member": "lab01.glab.lol", + "message": " my_disc:0xd5bc00a8 your_disc:0x752e80e1" + }, + { + "at": "1789228899297232", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899297250", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899297267", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899297285", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899297302", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899297323", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899297341", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899297357", + "member": "lab01.glab.lol", + "message": " Detect Time: now -214300ms" + }, + { + "at": "1789228899297381", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +921ms" + }, + { + "at": "1789228899297401", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -19ms" + }, + { + "at": "1789228899297419", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899297434", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899297451", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297468", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899297486", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297501", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297516", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297533", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297550", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297565", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899297585", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899297602", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297619", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899297635", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler1)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899297655", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899297670", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899297685", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899297702", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899297719", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899297736", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899297753", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +921ms" + }, + { + "at": "1789228899297771", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -19ms" + }, + { + "at": "1789228899297828", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899297844", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899297859", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297877", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x752e80e1" + }, + { + "at": "1789228899297893", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899297911", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899297928", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899297945", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899297960", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899297977", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899297994", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899298011", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899298026", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899373949", + "member": "lab01.glab.lol", + "message": "ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374056", + "member": "lab01.glab.lol", + "message": "ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899374277", + "member": "lab01.glab.lol", + "message": "ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374330", + "member": "lab01.glab.lol", + "message": "ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899375364", + "member": "lab01.glab.lol", + "message": "ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899375439", + "member": "lab01.glab.lol", + "message": "ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899376218", + "member": "lab01.glab.lol", + "message": "ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899376241", + "member": "lab01.glab.lol", + "message": "ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377021", + "member": "lab01.glab.lol", + "message": "ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377055", + "member": "lab01.glab.lol", + "message": "ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377866", + "member": "lab01.glab.lol", + "message": "ovs|00059|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228899377910", + "member": "lab01.glab.lol", + "message": "ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377923", + "member": "lab01.glab.lol", + "message": "ovs|00061|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 2" + }, + { + "at": "1789228899379010", + "member": "lab01.glab.lol", + "message": "ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899379810", + "member": "lab01.glab.lol", + "message": "ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899380595", + "member": "lab01.glab.lol", + "message": "ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900202282", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler1)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900202409", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900202420", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900202428", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900202441", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900202452", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900202464", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900202472", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +116ms" + }, + { + "at": "1789228900202480", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -824ms" + }, + { + "at": "1789228900202488", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900202498", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900202507", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900202515", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x36cbd78" + }, + { + "at": "1789228900202524", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900202531", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900202540", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900202549", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900202558", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900202565", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x35a20d9" + }, + { + "at": "1789228900202577", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900202589", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900202597", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900376948", + "member": "lab01.glab.lol", + "message": "ovs|00065|dpif|WARN|Dropped 1950 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228900377154", + "member": "lab01.glab.lol", + "message": "ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900629527", + "member": "lab01.glab.lol", + "message": "ovs|00067|bridge|INFO|bridge br-int: added interface veth907501d5 on port 3" + }, + { + "at": "1789228901376650", + "member": "lab01.glab.lol", + "message": "ovs|00068|dpif|WARN|Dropped 1882 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228901376717", + "member": "lab01.glab.lol", + "message": "ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902376343", + "member": "lab01.glab.lol", + "message": "ovs|00070|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228902376664", + "member": "lab01.glab.lol", + "message": "ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902381712", + "member": "lab01.glab.lol", + "message": "ovs|00072|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902382186", + "member": "lab01.glab.lol", + "message": "ovs|00073|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902382722", + "member": "lab01.glab.lol", + "message": "ovs|00074|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902383206", + "member": "lab01.glab.lol", + "message": "ovs|00075|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902383720", + "member": "lab01.glab.lol", + "message": "ovs|00076|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902384129", + "member": "lab01.glab.lol", + "message": "ovs|00077|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902384744", + "member": "lab01.glab.lol", + "message": "ovs|00078|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902385146", + "member": "lab01.glab.lol", + "message": "ovs|00079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902385744", + "member": "lab01.glab.lol", + "message": "ovs|00080|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228902386175", + "member": "lab01.glab.lol", + "message": "ovs|00081|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228903376673", + "member": "lab01.glab.lol", + "message": "ovs|00082|dpif|WARN|Dropped 1927 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228903376846", + "member": "lab01.glab.lol", + "message": "ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228904376908", + "member": "lab01.glab.lol", + "message": "ovs|00084|dpif|WARN|Dropped 1937 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228904377088", + "member": "lab01.glab.lol", + "message": "ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228905376863", + "member": "lab01.glab.lol", + "message": "ovs|00086|dpif|WARN|Dropped 1947 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228905376940", + "member": "lab01.glab.lol", + "message": "ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228906376435", + "member": "lab01.glab.lol", + "message": "ovs|00088|dpif|WARN|Dropped 1917 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228906376535", + "member": "lab01.glab.lol", + "message": "ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228907376363", + "member": "lab01.glab.lol", + "message": "ovs|00090|dpif|WARN|Dropped 1940 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228907376589", + "member": "lab01.glab.lol", + "message": "ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899183506", + "member": "lab02.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899183615", + "member": "lab02.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge incusovn16: using datapath ID 00009208b9915e49" + }, + { + "at": "1789228899183626", + "member": "lab02.glab.lol", + "message": "ovs|00264|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899185431", + "member": "lab02.glab.lol", + "message": "ovs|00265|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185515", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185545", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185566", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185588", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185606", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185625", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154185ms" + }, + { + "at": "1789228899185656", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154185ms" + }, + { + "at": "1789228899185680", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154185ms" + }, + { + "at": "1789228899185707", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185727", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185747", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185766", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899185786", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185804", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185821", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185843", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185863", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185879", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185896", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185923", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185943", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185961", + "member": "lab02.glab.lol", + "message": "ovs|00266|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185984", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899186002", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899186025", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899186042", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899186059", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899186084", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154185ms" + }, + { + "at": "1789228899186101", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154185ms" + }, + { + "at": "1789228899186118", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154185ms" + }, + { + "at": "1789228899186136", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186153", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899186171", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186189", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899186209", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899186226", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186243", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899186263", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899186280", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899186296", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186312", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186333", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186351", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186368", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186590", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler359)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899186650", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler359)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899186677", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899186701", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899186723", + "member": "lab02.glab.lol", + "message": " my_disc:0x17f0052 your_disc:0x0" + }, + { + "at": "1789228899186742", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899186760", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899186780", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899186797", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899186815", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899186833", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899186850", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899186871", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154186ms" + }, + { + "at": "1789228899186890", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +909ms" + }, + { + "at": "1789228899186911", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789228899186929", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186946", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899186964", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186982", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899186999", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187015", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187034", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899187050", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899187071", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187088", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228899187109", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899187126", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187150", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899187167", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899187185", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899187201", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899187218", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899187235", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899187252", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899187269", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899187290", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +909ms" + }, + { + "at": "1789228899187307", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789228899187324", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899187339", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899187354", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187370", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228899187388", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187418", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187434", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899187451", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899187468", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899187484", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228899187501", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899187521", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899187540", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899261253", + "member": "lab02.glab.lol", + "message": "ovs|00267|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899261289", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899261312", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899261333", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899261352", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899261373", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899261400", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154260ms" + }, + { + "at": "1789228899261430", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154260ms" + }, + { + "at": "1789228899261454", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154260ms" + }, + { + "at": "1789228899261485", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899261504", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899261524", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261544", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899261566", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899261585", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261606", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899261625", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899261654", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261675", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899261697", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899261727", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261748", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899268288", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler358)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899268361", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler358)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899268387", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899268417", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899268436", + "member": "lab02.glab.lol", + "message": " my_disc:0x23ec2b8f your_disc:0x0" + }, + { + "at": "1789228899268457", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899268475", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899268494", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899268514", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268533", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268552", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268579", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268602", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592154267ms" + }, + { + "at": "1789228899268623", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154267ms" + }, + { + "at": "1789228899268643", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154267ms" + }, + { + "at": "1789228899268663", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268685", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268704", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268724", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899268745", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268764", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268785", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268804", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268823", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268842", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899268862", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899268881", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268898", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899268920", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899268940", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899268959", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268967", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268976", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268984", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268992", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899269005", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1592154267ms" + }, + { + "at": "1789228899269015", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1592154267ms" + }, + { + "at": "1789228899269030", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899269038", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899269046", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899269054", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228899269061", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899269070", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899269078", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899269086", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899269094", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899269102", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228899269110", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899269119", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899269127", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899281411", + "member": "lab02.glab.lol", + "message": "ovs|00268|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899281448", + "member": "lab02.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228899283745", + "member": "lab02.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899283775", + "member": "lab02.glab.lol", + "message": "ovs|00271|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228900088485", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler358)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900088626", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900088640", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900088651", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900088662", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900088672", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900088682", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900088696", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228900088705", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -802ms" + }, + { + "at": "1789228900088715", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900088730", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900088746", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900088756", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4f842aca" + }, + { + "at": "1789228900088765", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900088775", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900088784", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900088794", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900088803", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900088812", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x23ec2b8f" + }, + { + "at": "1789228900088821", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900088830", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900088838", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900160502", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler359)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900160596", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler359)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228900160626", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900160652", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900160674", + "member": "lab02.glab.lol", + "message": " my_disc:0xfbce566e your_disc:0xc3aebc58" + }, + { + "at": "1789228900160698", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900160720", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900160747", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900160769", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900160790", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900160810", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900160834", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900160856", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1592155159ms" + }, + { + "at": "1789228900160877", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228900160901", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228900160931", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900160952", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900160973", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900160998", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900161020", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161041", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161063", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900161082", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900161104", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161122", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfbce566e" + }, + { + "at": "1789228900161144", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900161165", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161186", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900161205", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler359)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900161230", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900161249", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900161270", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900161291", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900161312", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900161340", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900161361", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228900161380", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228900161421", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900161451", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900161478", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161501", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900161523", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161544", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161565", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900161584", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900161604", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900161625", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfbce566e" + }, + { + "at": "1789228900161644", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900161664", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900161683", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900886981", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler359)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900887298", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900887327", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900887348", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900887370", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900887416", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900887437", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900887459", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +39ms" + }, + { + "at": "1789228900887482", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -791ms" + }, + { + "at": "1789228900887514", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900887534", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900887553", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900887572", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900887591", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900887611", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900887629", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900887650", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900887672", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900887693", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x17f0052" + }, + { + "at": "1789228900887713", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900887734", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900887753", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899183349", + "member": "lab03.glab.lol", + "message": "ovs|00290|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899183846", + "member": "lab03.glab.lol", + "message": "ovs|00291|bridge|INFO|bridge incusovn16: using datapath ID 00002654629f1141" + }, + { + "at": "1789228899183886", + "member": "lab03.glab.lol", + "message": "ovs|00292|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899185533", + "member": "lab03.glab.lol", + "message": "ovs|00293|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185579", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185595", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185609", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185621", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185631", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185646", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054183ms" + }, + { + "at": "1789228899185658", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054183ms" + }, + { + "at": "1789228899185669", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054183ms" + }, + { + "at": "1789228899185680", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185691", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185701", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185712", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228899185723", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185734", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185745", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185755", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185765", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185776", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185786", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185796", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185809", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185822", + "member": "lab03.glab.lol", + "message": "ovs|00294|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185835", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185847", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185855", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185866", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185876", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185886", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054183ms" + }, + { + "at": "1789228899185896", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054183ms" + }, + { + "at": "1789228899185907", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054183ms" + }, + { + "at": "1789228899185916", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185925", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185935", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185943", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899185956", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185968", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185977", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185987", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185997", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186005", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186014", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186022", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186030", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186041", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899261010", + "member": "lab03.glab.lol", + "message": "ovs|00295|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899261076", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899261108", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899261132", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899261156", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899261178", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899261201", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054258ms" + }, + { + "at": "1789228899261226", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054258ms" + }, + { + "at": "1789228899261255", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054258ms" + }, + { + "at": "1789228899261280", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899261302", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899261323", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261345", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899261368", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899261392", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261416", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899261439", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899261462", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899261493", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899261516", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899261539", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899261564", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899267924", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler354)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899267964", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler354)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899267979", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899267996", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899268011", + "member": "lab03.glab.lol", + "message": " my_disc:0x752e80e1 your_disc:0x0" + }, + { + "at": "1789228899268023", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899268035", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899268046", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899268057", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268077", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268088", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268099", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268112", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054265ms" + }, + { + "at": "1789228899268124", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054265ms" + }, + { + "at": "1789228899268138", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054265ms" + }, + { + "at": "1789228899268157", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268166", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268180", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268192", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899268204", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268216", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268228", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268238", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268252", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268268", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228899268281", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899268290", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268306", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899268340", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899268353", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899268363", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899268373", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899268382", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899268394", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899268404", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899268419", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -51054265ms" + }, + { + "at": "1789228899268428", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51054265ms" + }, + { + "at": "1789228899268443", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899268453", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899268466", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268476", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228899268486", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268499", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268510", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899268522", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899268532", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899268556", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228899268567", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899268580", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899268591", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899280146", + "member": "lab03.glab.lol", + "message": "ovs|00296|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899280179", + "member": "lab03.glab.lol", + "message": "ovs|00297|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228899286270", + "member": "lab03.glab.lol", + "message": "ovs|00298|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899286333", + "member": "lab03.glab.lol", + "message": "ovs|00299|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228900001516", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler362)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900001623", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler362)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228900001660", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900001689", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900001715", + "member": "lab03.glab.lol", + "message": " my_disc:0x1172530f your_disc:0xcfd32de8" + }, + { + "at": "1789228900001741", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900001818", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900001846", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900001875", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900001897", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900001921", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900001942", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900001966", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51054999ms" + }, + { + "at": "1789228900001989", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +134ms" + }, + { + "at": "1789228900002021", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -816ms" + }, + { + "at": "1789228900002047", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900002082", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900002108", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002132", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900002160", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900002183", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002205", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900002226", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900002252", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002280", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1172530f" + }, + { + "at": "1789228900002306", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900002389", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002421", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900002445", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler362)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900002474", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900002498", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900002521", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900002545", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900002568", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900002590", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900002616", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +134ms" + }, + { + "at": "1789228900002644", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -816ms" + }, + { + "at": "1789228900002674", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900002705", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900002736", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002768", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900002804", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900002838", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900002864", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900002894", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900002926", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900002954", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1172530f" + }, + { + "at": "1789228900002986", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900003021", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900003045", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900096225", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler357)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228900096322", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler357)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228900096362", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228900096389", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228900096410", + "member": "lab03.glab.lol", + "message": " my_disc:0x87bd04ca your_disc:0x17f0052" + }, + { + "at": "1789228900096438", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228900096463", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228900096486", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228900096510", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900096531", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900096560", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900096587", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900096609", + "member": "lab03.glab.lol", + "message": " Detect Time: now -51055094ms" + }, + { + "at": "1789228900096635", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +699ms" + }, + { + "at": "1789228900096664", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51ms" + }, + { + "at": "1789228900096692", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900096716", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900096738", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900096767", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228900096794", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900096816", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900096843", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900096870", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900096939", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900096962", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900096986", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228900097021", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097045", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900097080", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler357)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900097108", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900097133", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900097193", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900097218", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900097241", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900097265", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900097288", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +699ms" + }, + { + "at": "1789228900097315", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -51ms" + }, + { + "at": "1789228900097341", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900097363", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228900097385", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900097408", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17f0052" + }, + { + "at": "1789228900097431", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900097460", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097484", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900097507", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228900097536", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900097563", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x87bd04ca" + }, + { + "at": "1789228900097584", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900097605", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900097628", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900208233", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler354)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900208584", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900208617", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900208642", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900208667", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900208688", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900208712", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900208744", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +78ms" + }, + { + "at": "1789228900208769", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -922ms" + }, + { + "at": "1789228900208795", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900208819", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900208852", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900208876", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xd5bc00a8" + }, + { + "at": "1789228900208899", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900208921", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900208944", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900208966", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900208990", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900209019", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x752e80e1" + }, + { + "at": "1789228900209043", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900209085", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900209113", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228901384909", + "member": "lab03.glab.lol", + "message": "ovs|00300|bridge|INFO|bridge br-int: added interface veth5c0c349e on port 38" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228899062010", + "member": "nas01.glab.lol", + "message": "ovs|00266|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228899062147", + "member": "nas01.glab.lol", + "message": "ovs|00267|bridge|INFO|bridge incusovn16: using datapath ID 0000c2a8a0e84b40" + }, + { + "at": "1789228899062160", + "member": "nas01.glab.lol", + "message": "ovs|00268|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228899159484", + "member": "nas01.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228899159607", + "member": "nas01.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228899164947", + "member": "nas01.glab.lol", + "message": "ovs|00271|bridge|INFO|bridge incusovn16: added interface patch-incus-net38-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228899165007", + "member": "nas01.glab.lol", + "message": "ovs|00272|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net38-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789228899185637", + "member": "nas01.glab.lol", + "message": "ovs|00273|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185659", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185676", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185692", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185702", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185713", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185725", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281049ms" + }, + { + "at": "1789228899185737", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281049ms" + }, + { + "at": "1789228899185750", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281049ms" + }, + { + "at": "1789228899185761", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899185771", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899185782", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185794", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899185806", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899185818", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185827", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899185839", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899185849", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899185860", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899185870", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899185885", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899185894", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899185911", + "member": "nas01.glab.lol", + "message": "ovs|00274|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899185931", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899185943", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899185956", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899185966", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899185980", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899185994", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281049ms" + }, + { + "at": "1789228899186006", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281049ms" + }, + { + "at": "1789228899186016", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281049ms" + }, + { + "at": "1789228899186026", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899186036", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899186046", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186057", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899186068", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899186078", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186087", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899186097", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899186107", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899186117", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899186128", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899186138", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899186146", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899186157", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor385)|INFO|monitor thread created" + }, + { + "at": "1789228899191871", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler369)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899192013", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler369)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228899192036", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899192066", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899192083", + "member": "nas01.glab.lol", + "message": " my_disc:0xcfd32de8 your_disc:0x0" + }, + { + "at": "1789228899192144", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899192166", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899192182", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899192197", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899192213", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899192228", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899192244", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899192261", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281055ms" + }, + { + "at": "1789228899192278", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +815ms" + }, + { + "at": "1789228899192295", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228899192316", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899192330", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899192348", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192362", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899192378", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192393", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192410", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899192427", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899192447", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192463", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899192479", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899192494", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192509", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899192527", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899192545", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899192559", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899192575", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899192589", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899192604", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899192618", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899192640", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +814ms" + }, + { + "at": "1789228899192656", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228899192674", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899192689", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899192703", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192720", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228899192734", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192749", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192766", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899192780", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899192794", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899192808", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228899192823", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899192847", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899192862", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899267280", + "member": "nas01.glab.lol", + "message": "ovs|00275|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899267322", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899267341", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899267352", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899267362", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899267378", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228899267389", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281131ms" + }, + { + "at": "1789228899267399", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1592281131ms" + }, + { + "at": "1789228899267431", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1592281131ms" + }, + { + "at": "1789228899267442", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899267454", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228899267464", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899267475", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899267490", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899267500", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228899267510", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899267525", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228899267535", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899267545", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228899267554", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899267566", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228899267576", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228899291694", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler369)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899291856", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler369)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228899291879", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228899291894", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899291910", + "member": "nas01.glab.lol", + "message": " my_disc:0xc3aebc58 your_disc:0x0" + }, + { + "at": "1789228899291935", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899291950", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899291965", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899291980", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899291996", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899292010", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899292025", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899292038", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281155ms" + }, + { + "at": "1789228899292054", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +874ms" + }, + { + "at": "1789228899292076", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -106ms" + }, + { + "at": "1789228899292092", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899292113", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899292134", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292153", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899292169", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292184", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292199", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899292213", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899292228", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292242", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899292265", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899292279", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292297", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899292312", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899292330", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899292349", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899292364", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899292379", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899292394", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899292409", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899292423", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +874ms" + }, + { + "at": "1789228899292437", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -106ms" + }, + { + "at": "1789228899292457", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899292471", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899292488", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292502", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228899292517", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292531", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292546", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899292567", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228899292581", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899292596", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228899292610", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899292631", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899292646", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899373920", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler369)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228899374037", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler369)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228899374055", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228899374078", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228899374093", + "member": "nas01.glab.lol", + "message": " my_disc:0x36cbd78 your_disc:0x35a20d9" + }, + { + "at": "1789228899374111", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228899374128", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228899374141", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228899374156", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899374172", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899374193", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899374215", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899374230", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1592281237ms" + }, + { + "at": "1789228899374246", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +823ms" + }, + { + "at": "1789228899374262", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -87ms" + }, + { + "at": "1789228899374282", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899374298", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899374313", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374329", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899374344", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374354", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374365", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899374374", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899374390", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374401", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x36cbd78" + }, + { + "at": "1789228899374412", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228899374422", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374433", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228899374448", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler369)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228899374465", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228899374483", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228899374496", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228899374510", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228899374524", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228899374539", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228899374554", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +822ms" + }, + { + "at": "1789228899374571", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -88ms" + }, + { + "at": "1789228899374592", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228899374607", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228899374617", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374626", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x35a20d9" + }, + { + "at": "1789228899374636", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374648", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374658", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228899374667", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228899374677", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228899374687", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x36cbd78" + }, + { + "at": "1789228899374697", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228899374707", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228899374716", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900141572", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler369)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900142029", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900142072", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900142110", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900142139", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900142168", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900142197", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900142227", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +815ms" + }, + { + "at": "1789228900142256", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -135ms" + }, + { + "at": "1789228900142285", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900142312", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900142358", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900142382", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x1172530f" + }, + { + "at": "1789228900142406", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900142436", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900142466", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900142488", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900142510", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900142528", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xcfd32de8" + }, + { + "at": "1789228900142548", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900142566", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900142586", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228900242168", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler369)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228900242357", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228900242396", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228900242426", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228900242453", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228900242484", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228900242514", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228900242541", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +853ms" + }, + { + "at": "1789228900242578", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789228900242609", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228900242638", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228900242667", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228900242694", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xfbce566e" + }, + { + "at": "1789228900242717", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228900242729", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900242739", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228900242754", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228900242768", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228900242784", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xc3aebc58" + }, + { + "at": "1789228900242799", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228900242814", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228900242825", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.debug.log new file mode 100644 index 0000000..17cb082 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T09:01:36-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.log new file mode 100644 index 0000000..8deb8c1 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-create.log @@ -0,0 +1,546 @@ +time="2026-09-12T16:01:37Z" level=debug msg="[nas01] Event listener server handler started" id=98c4cc16-f79e-476e-b9bd-a9a50be208a0 local="10.10.10.14:8443" remote="100.122.142.76:58717" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58735" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58736" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58737" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58738" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58739" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58740" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58741" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58742" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 stand-by} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 voter} lab03}]" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58743" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58744" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:43:84:fe" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.38 +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net38 driver=ovn memberID=1 network=default priority=11633 project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.57.139.1:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 2048,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58745" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58746" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58747" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58748" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58749" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58750" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58751" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58752" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58753" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Event listener server handler started" id=e5b4f7a5-85c1-490d-8ebd-540621176b7a local="10.10.10.14:8443" remote="100.122.142.76:58753" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58754" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=e3c7c1fe-ef10-4d3e-9786-b10cdab7c368 project=image-build +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=e3c7c1fe-ef10-4d3e-9786-b10cdab7c368 project=image-build +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Event listener server handler started" id=2cea3cbf-b038-4b15-b205-b29c4255d736 local="10.10.10.14:8443" remote="100.122.142.76:58755" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58755" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58756" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=2651cebd-0458-4cbc-9a02-98753570e5d6 project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=2651cebd-0458-4cbc-9a02-98753570e5d6 project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=2651cebd-0458-4cbc-9a02-98753570e5d6 project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T16:01:39Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=2651cebd-0458-4cbc-9a02-98753570e5d6 project=ac-ovn-spike +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58757" method=GET protocol=tls url="/1.0/operations/2651cebd-0458-4cbc-9a02-98753570e5d6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e5b4f7a5-85c1-490d-8ebd-540621176b7a local="10.10.10.14:8443" remote="100.122.142.76:58753" +time="2026-09-12T16:01:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2cea3cbf-b038-4b15-b205-b29c4255d736 local="10.10.10.14:8443" remote="100.122.142.76:58755" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58759" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58760" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"f9067d8c-9c27-4e66-a814-32c4de5f616d\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T16:01:40.046657282Z\",\n\t\t\"updated_at\": \"2026-09-12T16:01:40.046657282Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58762" method=GET protocol=tls url="/1.0/operations/f9067d8c-9c27-4e66-a814-32c4de5f616d/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:40Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T16:01:40Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58763" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58764" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58765" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Event listener server handler started" id=46b35433-7449-4ba1-99de-32a85b93e017 local="10.10.10.14:8443" remote="100.122.142.76:58765" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58766" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:40Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 16:01:40.121693432 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58767" method=GET protocol=tls url="/1.0/operations/d892d6d4-93a0-4564-a500-34c36861110a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:40Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 16:01:40.121693432 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=46b35433-7449-4ba1-99de-32a85b93e017 local="10.10.10.14:8443" remote="100.122.142.76:58765" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58770" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58771" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"a2df0152-ab47-423a-b6f9-96428e30c623\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T16:01:40.93333097Z\",\n\t\t\"updated_at\": \"2026-09-12T16:01:40.93333097Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T16:01:40Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58772" method=GET protocol=tls url="/1.0/operations/a2df0152-ab47-423a-b6f9-96428e30c623/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:40Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58773" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58774" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Event listener server handler started" id=d4120245-2188-42f1-854a-289c671b36e9 local="10.10.10.14:8443" remote="100.122.142.76:58775" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58775" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58776" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T16:01:41Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 16:01:40.94318346 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58777" method=GET protocol=tls url="/1.0/operations/b5f90439-00f9-4d74-8595-bd442d1c11f0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:41Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 16:01:40.94318346 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d4120245-2188-42f1-854a-289c671b36e9 local="10.10.10.14:8443" remote="100.122.142.76:58775" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58778" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58779" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58780" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58781" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58782" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58783" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58784" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58785" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58786" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58787" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Event listener server handler started" id=c92ecaf4-b2a5-4a02-b235-015d4d0c8f8e local="10.10.10.14:8443" remote="100.122.142.76:58787" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58788" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58789" method=GET protocol=tls url="/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=8ba2866dbaaea39d69557300f5190b05b3e519b6d5a3791da9fd17f59714ba24" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58789" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=8ba2866dbaaea39d69557300f5190b05b3e519b6d5a3791da9fd17f59714ba24" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58790" method=GET protocol=tls url="/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=f4de61dd506decad91fe4f79ceac40cf66ef4c8f4644323dce1fc80b019e3d5d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58790" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=f4de61dd506decad91fe4f79ceac40cf66ef4c8f4644323dce1fc80b019e3d5d" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58791" method=GET protocol=tls url="/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=8cb7ed8838b35ec19d44713c0e5eebbb968c08c7de764157d8c3d73ed6bdeb3a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58791" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=8cb7ed8838b35ec19d44713c0e5eebbb968c08c7de764157d8c3d73ed6bdeb3a" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58792" method=GET protocol=tls url="/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=6b0ae95dfbbac8562f9b1de8fa989b223706dac716a8547e947f1bfc00019f96" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e/websocket?secret=6b0ae95dfbbac8562f9b1de8fa989b223706dac716a8547e947f1bfc00019f96" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58792" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58790" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58793" method=GET protocol=tls url="/1.0/operations/7b1fdd48-f899-48d6-8ea9-e0810691e35e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58789" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58791" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58792" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Event listener server handler stopped" listener=c92ecaf4-b2a5-4a02-b235-015d4d0c8f8e local="10.10.10.14:8443" remote="100.122.142.76:58787" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58794" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58795" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58798" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58799" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Event listener server handler started" id=e4b4163e-d816-438b-8b4c-d18493b0089d local="10.10.10.14:8443" remote="100.122.142.76:58799" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58800" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed updating heartbeat time for member \"10.10.10.14:8443\": database is locked" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Database error, retrying" attempt=1 err="Failed updating heartbeat time for member \"10.10.10.14:8443\": database is locked" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Database error, retrying" attempt=2 err="Failed updating heartbeat time for member \"10.10.10.14:8443\": database is locked" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58801" method=GET protocol=tls url="/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=9c751f21be1f971f6e74d081af79a75b548d9a095580b36171722832b67a2616" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58801" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=9c751f21be1f971f6e74d081af79a75b548d9a095580b36171722832b67a2616" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58802" method=GET protocol=tls url="/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=48acfbef40af07cab4a3b80c3d938414de189135ffcb2c56680fa42a2a3b038c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58802" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Completed heartbeat round" duration=4.542588571s +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=48acfbef40af07cab4a3b80c3d938414de189135ffcb2c56680fa42a2a3b038c" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58803" method=GET protocol=tls url="/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=b3579b97ab4ad426799db89821743a18a70648710bcc442191130fb42c66ff70" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58803" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=b3579b97ab4ad426799db89821743a18a70648710bcc442191130fb42c66ff70" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58804" method=GET protocol=tls url="/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=cbec745307d38055286a342f2c4c26c01aadfc93ecd1a05318b08e7bf9e2a046" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58804" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1/websocket?secret=cbec745307d38055286a342f2c4c26c01aadfc93ecd1a05318b08e7bf9e2a046" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58802" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58801" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58803" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58804" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58805" method=GET protocol=tls url="/1.0/operations/e4af2f30-0d01-40f7-92fa-5eb3716e22f1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e4b4163e-d816-438b-8b4c-d18493b0089d local="10.10.10.14:8443" remote="100.122.142.76:58799" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58806" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58807" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Event listener server handler started" id=8c5f838e-5019-4809-98e0-4edc52b0f0eb local="10.10.10.14:8443" remote="100.122.142.76:58807" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58808" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58809" method=GET protocol=tls url="/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=08a72637a6fc69dcffffb99708e483fcfcb85ba60ca0ed3216d1fea09220f0fe" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58809" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=08a72637a6fc69dcffffb99708e483fcfcb85ba60ca0ed3216d1fea09220f0fe" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58810" method=GET protocol=tls url="/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=2b7a2a6d4c40c806e65f20a208d7d73a983951aa6de7d9ce794355b46b57e336" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=2b7a2a6d4c40c806e65f20a208d7d73a983951aa6de7d9ce794355b46b57e336" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58810" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58811" method=GET protocol=tls url="/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=1333720c722be441e6ecdb212dd0d39e0f22fa0a306433bbaa973709d4661326" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=1333720c722be441e6ecdb212dd0d39e0f22fa0a306433bbaa973709d4661326" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58811" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58812" method=GET protocol=tls url="/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=ef89eb12303e5be1a17a943631368e04fb66d592feb9ad96834944fa12e98d61" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58812" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9/websocket?secret=ef89eb12303e5be1a17a943631368e04fb66d592feb9ad96834944fa12e98d61" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58810" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58813" method=GET protocol=tls url="/1.0/operations/339a902d-090c-40bb-a168-663e47ba75c9?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58809" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58811" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58812" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8c5f838e-5019-4809-98e0-4edc52b0f0eb local="10.10.10.14:8443" remote="100.122.142.76:58807" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58814" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58815" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58816" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58817" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Event listener server handler started" id=e2e83f69-da35-40ba-ac7d-20839b15b64f local="10.10.10.14:8443" remote="100.122.142.76:58817" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58818" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58820" method=GET protocol=tls url="/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=09217f7c5908677e11e8ca03d538f1bdcf144c3726ecfeb513eb3b2e11b74d9e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=09217f7c5908677e11e8ca03d538f1bdcf144c3726ecfeb513eb3b2e11b74d9e" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58820" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58821" method=GET protocol=tls url="/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=17c0dcef181c533789840103d81c87e2f8327817fcdcec805e454d8451317ab7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=17c0dcef181c533789840103d81c87e2f8327817fcdcec805e454d8451317ab7" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58821" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58822" method=GET protocol=tls url="/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=3c771f094238db001b3f92a86907b7cae158c7374bb70034407b861e2ecc0ae1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58822" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=3c771f094238db001b3f92a86907b7cae158c7374bb70034407b861e2ecc0ae1" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58823" method=GET protocol=tls url="/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=cae6657e1175f4068b27347a3fc5b3c6581eff51ad111f97f6695c2cc80b3d5d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6/websocket?secret=cae6657e1175f4068b27347a3fc5b3c6581eff51ad111f97f6695c2cc80b3d5d" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58823" +time="2026-09-12T16:01:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58821" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58824" method=GET protocol=tls url="/1.0/operations/d77688e2-3004-4088-b83d-7f8da90830e6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58820" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58823" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58822" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e2e83f69-da35-40ba-ac7d-20839b15b64f local="10.10.10.14:8443" remote="100.122.142.76:58817" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58825" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58826" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Event listener server handler started" id=dfb57adc-4448-4cb5-a591-627db186ff2c local="10.10.10.14:8443" remote="100.122.142.76:58826" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58827" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58828" method=GET protocol=tls url="/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=faea5e9dedae29f57c9c8d1058a9d4e7477fc15d7a60a9ffe9e1027e0bc2e8e9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=faea5e9dedae29f57c9c8d1058a9d4e7477fc15d7a60a9ffe9e1027e0bc2e8e9" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58828" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58829" method=GET protocol=tls url="/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=00e3f64e89b1461b35d8c8c2155083734f60722563ff1a73f5f03abedafb561f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=00e3f64e89b1461b35d8c8c2155083734f60722563ff1a73f5f03abedafb561f" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58829" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58831" method=GET protocol=tls url="/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=ea08d979db571ad86f970fa63fffa76f6016f99a16aa2a64b62f0654355fdca8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=ea08d979db571ad86f970fa63fffa76f6016f99a16aa2a64b62f0654355fdca8" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58831" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58832" method=GET protocol=tls url="/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=f9cf366c8ed8c16889a983b6b079fa2ff405d39b1af227af2eb56c1551ed1e11" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/001056f0-44cc-4139-827a-b7234a095719/websocket?secret=f9cf366c8ed8c16889a983b6b079fa2ff405d39b1af227af2eb56c1551ed1e11" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58832" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58829" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58833" method=GET protocol=tls url="/1.0/operations/001056f0-44cc-4139-827a-b7234a095719?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58828" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58832" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58831" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Event listener server handler stopped" listener=dfb57adc-4448-4cb5-a591-627db186ff2c local="10.10.10.14:8443" remote="100.122.142.76:58826" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58835" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58836" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Event listener server handler started" id=413e2ddb-c3ab-4953-8697-59fd872c31a9 local="10.10.10.14:8443" remote="100.122.142.76:58836" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58837" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58838" method=GET protocol=tls url="/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=791aa21e656b57516aa6bf3558f631fa16bfa696ede1bdb9326194d6ffc58f40" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58838" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=791aa21e656b57516aa6bf3558f631fa16bfa696ede1bdb9326194d6ffc58f40" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58839" method=GET protocol=tls url="/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=062c64c0e29a74ba99eed6f5919026b3d6f636acd06dfa79124faa3c7e580e3e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58839" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=062c64c0e29a74ba99eed6f5919026b3d6f636acd06dfa79124faa3c7e580e3e" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58840" method=GET protocol=tls url="/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=327fcb2a2a53e9713238004ca144586bd7fdf6175f0c500af0556dbc3aaa2cf9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=327fcb2a2a53e9713238004ca144586bd7fdf6175f0c500af0556dbc3aaa2cf9" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58840" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58841" method=GET protocol=tls url="/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=5047e99e7b438bffdcc438771f4f8db29b7ea20f46645c4780ccf744ce3f47b4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:58841" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d/websocket?secret=5047e99e7b438bffdcc438771f4f8db29b7ea20f46645c4780ccf744ce3f47b4" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58839" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58842" method=GET protocol=tls url="/1.0/operations/71573447-cf73-46bc-af2b-37a6f410c16d?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58838" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58840" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:58841" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Event listener server handler stopped" listener=413e2ddb-c3ab-4953-8697-59fd872c31a9 local="10.10.10.14:8443" remote="100.122.142.76:58836" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58844" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58845" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Event listener server handler started" id=c4b80611-760b-4dff-a509-087aa8d78183 local="10.10.10.14:8443" remote="100.122.142.76:58845" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58846" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58847" method=GET protocol=tls url="/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=f4ab5a40a8f5f8d12254e9e1d088cc9eb1b8036b2bd55821febb2ca93e7e5225" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=f4ab5a40a8f5f8d12254e9e1d088cc9eb1b8036b2bd55821febb2ca93e7e5225" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58847" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58848" method=GET protocol=tls url="/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=8768be25e3d2067f4bbb914a73afc4a6933be02e279de2837233c94d30328bdd" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58848" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=8768be25e3d2067f4bbb914a73afc4a6933be02e279de2837233c94d30328bdd" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58849" method=GET protocol=tls url="/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=c52da9ca0393e93b93976d8127cfb6be2a6b5c6dd0ac34f1bf72289639b9294a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=c52da9ca0393e93b93976d8127cfb6be2a6b5c6dd0ac34f1bf72289639b9294a" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58849" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58850" method=GET protocol=tls url="/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=9e557dd3b578e7ca1d59772009d93a5cab9423e8f5c7b41316496620729eebee" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:58850" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a/websocket?secret=9e557dd3b578e7ca1d59772009d93a5cab9423e8f5c7b41316496620729eebee" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58848" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58851" method=GET protocol=tls url="/1.0/operations/556933f4-8518-46af-ad18-39715f16dd9a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58847" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58850" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:58849" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Event listener server handler stopped" listener=c4b80611-760b-4dff-a509-087aa8d78183 local="10.10.10.14:8443" remote="100.122.142.76:58845" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58852" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:58853" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to create \"networks_forwards\" entry: database is locked" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T16:01:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.debug.log new file mode 100644 index 0000000..c4f92ca --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T09:02:32-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.log new file mode 100644 index 0000000..5f34446 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/monitor-delete.log @@ -0,0 +1,166 @@ +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Event listener server handler started" id=46d8dc9a-f1d9-40ca-8429-dc15a698c43a local="10.10.10.14:8443" remote="100.122.142.76:59057" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59060" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59061" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59062" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59063" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T16:01:40.121693432Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T16:01:40.752800494Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T16:01:40.94318346Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T16:01:41.46956009Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59064" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59065" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Completed heartbeat round" duration=4.746196243s +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59066" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Event listener server handler started" id=9d9f321e-1074-483d-8f22-16763140578a local="10.10.10.14:8443" remote="100.122.142.76:59066" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59067" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 16:01:40.121693432 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 16:01:40.752800494 +0000 UTC" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59068" method=GET protocol=tls url="/1.0/operations/0e447e26-ad0f-47d4-9e27-f05ba73529f1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59069" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:34Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 16:01:40.121693432 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 16:01:40.752800494 +0000 UTC" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59070" method=GET protocol=tls url="/1.0/operations/ebf624a2-a882-4d93-afbc-80778aea8248?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 16:01:40.121693432 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 16:01:40.752800494 +0000 UTC" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Event listener server handler stopped" listener=9d9f321e-1074-483d-8f22-16763140578a local="10.10.10.14:8443" remote="100.122.142.76:59066" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59071" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59072" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59073" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Event listener server handler started" id=b9eff280-5a97-492f-b829-782320a686ad local="10.10.10.14:8443" remote="100.122.142.76:59073" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59074" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:34Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 16:01:40.94318346 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 16:01:41.46956009 +0000 UTC" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59075" method=GET protocol=tls url="/1.0/operations/f4666e37-c85e-4c12-86d8-4fb10f10a0fc?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59077" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 16:01:40.94318346 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 16:01:41.46956009 +0000 UTC" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59078" method=GET protocol=tls url="/1.0/operations/11cf6b99-1471-4e85-97ec-9a8ce112b7a1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:35Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 16:01:40.94318346 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 16:01:41.46956009 +0000 UTC" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b9eff280-5a97-492f-b829-782320a686ad local="10.10.10.14:8443" remote="100.122.142.76:59073" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59079" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59080" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59081" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59082" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59083" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59084" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59087" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59088" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59089" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59090" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59091" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59092" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59093" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59094" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59095" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59096" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59097" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Event listener server handler started" id=2123ba17-1447-4dea-ad94-43353576a3a1 local="10.10.10.14:8443" remote="100.122.142.76:59097" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59098" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=4fac6040-6023-42d7-b7ca-85ef1c02279b project=ac-ovn-spike +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=4fac6040-6023-42d7-b7ca-85ef1c02279b project=ac-ovn-spike +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=4fac6040-6023-42d7-b7ca-85ef1c02279b project=ac-ovn-spike +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59099" method=GET protocol=tls url="/1.0/operations/4fac6040-6023-42d7-b7ca-85ef1c02279b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2123ba17-1447-4dea-ad94-43353576a3a1 local="10.10.10.14:8443" remote="100.122.142.76:59097" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59100" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:59101" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T16:02:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/probe.stderr.txt new file mode 100644 index 0000000..2041e75 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/probe.stderr.txt @@ -0,0 +1,8 @@ +probe: gateway ping one -> 10.10.40.1 failed +probe: gateway ping two -> 10.10.40.1 failed +probe: dns lookup example.com from one via 10.10.40.1 failed +probe: dns lookup example.com from two via 10.10.40.1 failed +probe: internet egress curl from one failed +probe: internet egress curl from two failed +probe: workstation curl of forward-url failed +probe: 7 datapath checks failed diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/probe.stdout.txt new file mode 100644 index 0000000..ec59307 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/probe.stdout.txt @@ -0,0 +1,107 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.097 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.096 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"2655ec92-2dff-41cc-ad06-10c35b1fe7ec","volatile.eth0.host_name":"veth907501d5","volatile.eth0.hwaddr":"10:66:6a:d9:78:08","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"90400719-d170-40f8-8690-7e17fde270db","volatile.uuid.generation":"90400719-d170-40f8-8690-7e17fde270db"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T16:01:40.121693432Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"2655ec92-2dff-41cc-ad06-10c35b1fe7ec","volatile.eth0.host_name":"veth907501d5","volatile.eth0.hwaddr":"10:66:6a:d9:78:08","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"90400719-d170-40f8-8690-7e17fde270db","volatile.uuid.generation":"90400719-d170-40f8-8690-7e17fde270db"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T16:01:40.752800494Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9334784,"usage_peak":0,"total":65256516000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fed9:7808","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:d9:78:08","host_name":"veth907501d5","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":3719,"processes":4,"cpu":{"usage":492034000,"allocated_time":24000000000},"started_at":"2026-09-12T16:01:39.75999999Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"485b965e-64de-42a8-8c9a-938f4e93afce","volatile.eth0.host_name":"veth5c0c349e","volatile.eth0.hwaddr":"10:66:6a:8f:56:95","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"7b930fd9-10fd-4078-b66e-699779aa9bbc","volatile.uuid.generation":"7b930fd9-10fd-4078-b66e-699779aa9bbc"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T16:01:40.94318346Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"485b965e-64de-42a8-8c9a-938f4e93afce","volatile.eth0.host_name":"veth5c0c349e","volatile.eth0.hwaddr":"10:66:6a:8f:56:95","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"7b930fd9-10fd-4078-b66e-699779aa9bbc","volatile.uuid.generation":"7b930fd9-10fd-4078-b66e-699779aa9bbc"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T16:01:41.46956009Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11636736,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe8f:5695","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:8f:56:95","host_name":"veth5c0c349e","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":37953,"processes":4,"cpu":{"usage":494971000,"allocated_time":24000000000},"started_at":"2026-09-12T16:01:41.480000019Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.147 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.262 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.271 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.294 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.828 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.502 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.502/0.874/1.294 ms +elapsed_seconds=2.286 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.053 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.795 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.356 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.356/0.734/1.053 ms +elapsed_seconds=2.273 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.229 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.268 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.269 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.267 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5002 milliseconds +elapsed_seconds=5.306 exit=28 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5003 milliseconds +elapsed_seconds=5.273 exit=28 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +curl: (28) Failed to connect to 10.10.40.79 port 8080 after 5011 ms: Timeout was reached +elapsed_seconds=5.028 exit=28 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.211140 bytes_per_second=473619399 +elapsed_seconds=0.668 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.497 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.142038 bytes_per_second=704036947 +elapsed_seconds=0.435 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.522 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/tcpdump-arp.log new file mode 100644 index 0000000..df4febb --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/tcpdump-arp.log @@ -0,0 +1,4 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +16:01:49.240328 12:b7:ee:17:05:f4 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.1, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/topology.jsonl new file mode 100644 index 0000000..3c7c30c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-post-1/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.104, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.506, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.568, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.101, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.26, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.446, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T16:01:40.046657282Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"f9067d8c-9c27-4e66-a814-32c4de5f616d\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T16:01:40.046657282Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.455, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.361, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T16:01:40.93333097Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"a2df0152-ab47-423a-b6f9-96428e30c623\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T16:01:40.93333097Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.347, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.213, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 143416000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256516000,\n\t\t\"usage\": 6651904,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fed9:7808\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 860,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"veth907501d5\",\n\t\t\t\"hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 3719,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T16:01:39.75999999Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.206, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 131920000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6483968,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe8f:5695\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 864,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"veth5c0c349e\",\n\t\t\t\"hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 37953,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T16:01:41.480000019Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.116, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t},\n\t\"created_at\": \"2026-09-12T16:01:40.121693432Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T16:01:40.752800494Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t},\n\t\"created_at\": \"2026-09-12T16:01:40.94318346Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T16:01:41.46956009Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.347, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.479 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.479/1.479/1.479 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.399, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.663, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.33, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.388, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-tktbzvvm/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.72, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.361, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.527, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.027208 seconds, 3.4GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.562, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.025218 seconds, 3.7GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.332, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.103, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T16:01:40.121693432Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2655ec92-2dff-41cc-ad06-10c35b1fe7ec\",\n\t\t\t\"volatile.eth0.host_name\": \"veth907501d5\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d9:78:08\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90400719-d170-40f8-8690-7e17fde270db\",\n\t\t\t\"volatile.uuid.generation\": \"90400719-d170-40f8-8690-7e17fde270db\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T16:01:40.752800494Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T16:01:40.94318346Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"485b965e-64de-42a8-8c9a-938f4e93afce\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5c0c349e\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8f:56:95\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\",\n\t\t\t\"volatile.uuid.generation\": \"7b930fd9-10fd-4078-b66e-699779aa9bbc\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T16:01:41.46956009Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.099, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.966, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.103, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.152, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.182, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.106, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.094, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T16:01:40.972193748Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T16:01:39.91008008Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.191, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.097, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/commands.jsonl new file mode 100644 index 0000000..f7a72bb --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.186, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:35:34.939188+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.526, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:35:35.465874+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.16, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T15:35:35.627062+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 73028, "ready": true, "ready_signal": "time=\"2026-09-12T08:35:35-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:35:35.733591+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/topology.jsonl", "create"], "seconds": 9.16, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.576,\n \"first_cross_member_ping_seconds\": 3.515,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:44.895872+00:00"} +{"capture": "monitor-create", "pid": 73028, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.log", "ready_signal": "time=\"2026-09-12T08:35:35-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:35:44.898428+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.085, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:44.983870+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.082, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:e8:83:f2 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:5c:44:71 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:45.066301+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.122, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 610cb309-8282-4d8d-a2b7-e085bfbf4cad (incus-net32-ls-ext)\n port incus-net32-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net32-ls-ext-lsp-router\n type: router\n router-port: incus-net32-lr-lrp-ext\nswitch aca93faa-aea8-4729-b88c-82ed44ef3937 (incus-net32-ls-int)\n port incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0\n addresses: [\"10:66:6a:e8:83:f2 dynamic\"]\n port incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0\n addresses: [\"10:66:6a:5c:44:71 dynamic\"]\n port incus-net32-ls-int-lsp-router\n type: router\n router-port: incus-net32-lr-lrp-int\nrouter bac0e241-5743-49b5-84b1-a9cedca557e4 (incus-net32-lr)\n port incus-net32-lr-lrp-ext\n mac: \"10:66:6a:33:3f:c7\"\n ipv6-lla: \"fe80::1266:6aff:fe33:3fc7\"\n networks: [\"10.10.40.64/24\"]\n port incus-net32-lr-lrp-int\n mac: \"10:66:6a:33:3f:c7\"\n ipv6-lla: \"fe80::1266:6aff:fe33:3fc7\"\n networks: [\"10.253.73.1/24\"]\n nat 86281e38-e6d1-49b0-9312-550270ea278b\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net32-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 8e4ad01e-8d0e-459d-8227-88bd4cdfb753\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 7f660565-1f66-46ba-98cd-0050dba7ddb3\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:33:3f:c7\"\nname : incus-net32-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n\n_uuid : e3c18ecb-9ce8-4744-979d-f5e9515a371c\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:33:3f:c7\"\nname : incus-net32-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 531558c5-4afd-433c-bd5d-2ac485276100\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : 63db9462-5bdb-4b90-8046-0259671d83f1\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 0b893e82-7020-4a69-a5ba-c106fd207e69\nlogical_port : cr-incus-net32-lr-lrp-ext\nmac : [\"10:66:6a:33:3f:c7 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net32-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:33:3f:c7 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:35:45.188998+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.307, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:33:3f:c7 DELAY \n", "stderr": "", "error": null, "at": "2026-09-12T15:35:45.496311+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.184, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338272799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84031|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338273036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84032|bridge|INFO|bridge incusovn16: using datapath ID 00007a092e54774b\"\n },\n {\n \"at\": \"1789227338273071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84033|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338276027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84034|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338276110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338276145\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338276171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338276193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338276223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338276250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276288\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338276376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338276460\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338276493\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338276546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338276641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338276721\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84035|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338276747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338276773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338276791\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338276811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338276827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338276846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338276909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338276946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338277010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338277031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338277081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277097\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338277139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338277209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84036|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338277233\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338277251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338277273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338277289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338277306\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338277332\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277351\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338277417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277459\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338277492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338277509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338277561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338277619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338368846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler187)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338368952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler187)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338369004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338369041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338369093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x21aad08 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338369124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338369164\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338369202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338369253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338369290\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338369328\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338369357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338369391\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338369555\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338369593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338369630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338369668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338369767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338369804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338369828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338369862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338369889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338369961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338369991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338370021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338370054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338370080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338370106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338370131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338370178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338370465\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338370678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338370707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338370745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338370774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338370807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338370837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338370873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338370904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338370932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338370956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338370987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84037|dpif|WARN|Dropped 386 log messages in last 239 seconds (most recently, 239 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227338371118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84038|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371163\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84039|bridge|WARN|Dropped 11150 log messages in last 244 seconds (most recently, 239 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227338371214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84040|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84042|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84043|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371389\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84044|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371968\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338372086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84046|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338372633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler187)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338372742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler187)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338372781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338372819\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338372849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x9ccef038 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338372889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338372916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338372953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338372977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338373043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338373131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +863ms\"\n },\n {\n \"at\": \"1789227338373179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789227338373203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338373281\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338373310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338373369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373396\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338373448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338373474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338373549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338373581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373607\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373634\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338373672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338373695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338373770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338373852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +863ms\"\n },\n {\n \"at\": \"1789227338373878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789227338373909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338373932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338373961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338374020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338374102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338374127\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338374156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338374191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338374286\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338374318\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler187)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338374350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler187)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338374381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338374410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338374437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xf807dd2c your_disc:0x0\"\n },\n {\n \"at\": \"1789227338374470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338374509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338374540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338374568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338374600\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338374630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338374662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338374688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338374811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338374837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338374864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338374896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338374984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338375008\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338375068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338375094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338375142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338375174\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338375209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338375247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338375269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338375292\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338375323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338375359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338375390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338375416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338375442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338375470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338375535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338375615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338375648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338375701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375752\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338376402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84048|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227338376500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84049|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227339198829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339198979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339199014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339199032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339199044\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339199058\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339199071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339199079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +68ms\"\n },\n {\n \"at\": \"1789227339199087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -822ms\"\n },\n {\n \"at\": \"1789227339199107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339199126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339199138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339199153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227339199170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339199209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339199218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339199225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227339199247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339199258\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199276\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339368900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84050|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227339369086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227339372637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339372734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339372773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339372803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339372836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339372868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339372887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339372916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +654ms\"\n },\n {\n \"at\": \"1789227339372945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -136ms\"\n },\n {\n \"at\": \"1789227339372976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339372998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339373023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339373072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339373138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339373159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339373214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339373238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339373865\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339373881\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339373894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339373901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339373912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339373920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339373934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339373944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +733ms\"\n },\n {\n \"at\": \"1789227339373952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -37ms\"\n },\n {\n \"at\": \"1789227339373962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339373975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339373984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227339374004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339374036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339374047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339374057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227339374065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339374074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339688142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84052|bridge|INFO|bridge br-int: added interface veth011e07a6 on port 28\"\n },\n {\n \"at\": \"1789227340368741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84053|dpif|WARN|Dropped 1982 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227340368832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227340732722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84055|poll_loop|INFO|Dropped 4609 log messages in last 243 seconds (most recently, 238 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227340732925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84056|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340733054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84057|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340733549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84058|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340734039\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84059|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340734543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84060|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340735033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84061|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340735538\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84062|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340736041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84063|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340736549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84064|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340737054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84065|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227341368665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84066|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227341368762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84067|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227342368897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84068|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227342369123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227343368955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84070|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227343369140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227344368688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84072|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227344368794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227345368707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84074|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227345368936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84075|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:45.680744+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.155, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338260096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00167|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338260250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00168|bridge|INFO|bridge incusovn16: using datapath ID 000042b3b8d8b845\"\n },\n {\n \"at\": \"1789227338260271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00169|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338260288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00170|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338260305\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338260322\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338260337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338260351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338260366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338260381\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260415\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338260448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338260463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338260478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338260496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338260510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338260540\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338260555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338260568\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338260581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260597\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260612\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338260626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338269943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00171|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338269984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338269996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338270007\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338270020\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338270030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338270045\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270057\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338270091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270113\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338270125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338270134\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270144\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338270154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270163\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338270184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270194\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338270214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00172|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338270225\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338270235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338270247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338270256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338270266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338270277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338270318\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270338\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338270348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338270358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338270378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338270414\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270424\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270435\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338355186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00173|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338355590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00174|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227338358605\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338358647\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00176|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789227339056207\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler169)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339056350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler169)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339056384\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339056428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339056452\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x7639c892 your_disc:0x6b88a426\"\n },\n {\n \"at\": \"1789227339056481\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339056507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339056530\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339056551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339056573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339056596\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339056617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339056648\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594055ms\"\n },\n {\n \"at\": \"1789227339056670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -16ms\"\n },\n {\n \"at\": \"1789227339056699\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -796ms\"\n },\n {\n \"at\": \"1789227339056723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339056744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339056768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339056791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339056813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339056836\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339056861\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339056883\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339056916\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339056944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339056967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339056989\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057012\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339057032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler169)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339057054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339057076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339057152\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339057174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339057194\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339057215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339057240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -16ms\"\n },\n {\n \"at\": \"1789227339057261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -796ms\"\n },\n {\n \"at\": \"1789227339057288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339057309\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339057328\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339057348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339057370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057419\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339057440\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339057461\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339057484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339057510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339224346\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler169)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339224434\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler169)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339224470\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339224495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339224515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x349dc1e2 your_disc:0x9ccef038\"\n },\n {\n \"at\": \"1789227339224541\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339224564\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339224595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339224619\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339224640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339224663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339224688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339224715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594223ms\"\n },\n {\n \"at\": \"1789227339224750\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +47ms\"\n },\n {\n \"at\": \"1789227339224773\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -863ms\"\n },\n {\n \"at\": \"1789227339224796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339224818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339224837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339224857\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339224879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339224900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339224921\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339224942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339224963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339224983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339225008\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339225029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339225071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler169)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339225095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339225117\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339225138\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339225156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339225175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339225195\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339225216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +47ms\"\n },\n {\n \"at\": \"1789227339225237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -863ms\"\n },\n {\n \"at\": \"1789227339225259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339225278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339225299\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339225319\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339225343\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225382\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339225408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339225429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339225450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339225471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225491\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225509\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339251697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler169)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339251752\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler169)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339251771\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339251786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339251800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xdd2303b9 your_disc:0xccffcd9e\"\n },\n {\n \"at\": \"1789227339251814\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339251829\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339251844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339251859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339251872\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339251887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339251903\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339251918\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594251ms\"\n },\n {\n \"at\": \"1789227339251935\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +839ms\"\n },\n {\n \"at\": \"1789227339251953\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -71ms\"\n },\n {\n \"at\": \"1789227339251968\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339251982\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339251995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252009\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227339252024\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339252064\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339252078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227339252106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339252121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252135\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339252154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler169)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339252170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339252184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339252197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339252211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339252226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339252240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339252254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +839ms\"\n },\n {\n \"at\": \"1789227339252267\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -71ms\"\n },\n {\n \"at\": \"1789227339252279\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339252291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339252303\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227339252329\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339252368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339252381\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227339252416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252444\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:45.836732+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.17, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338260510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338260920\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00008a575f87ca4a\"\n },\n {\n \"at\": \"1789227338260946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00185|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338263324\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00186|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338263393\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338263420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338263444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338263465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338263482\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338263503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338263576\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263593\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263611\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338263636\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338263652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338263686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263700\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263715\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338263732\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338263788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00187|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338263804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338263821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338263837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338263855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338263872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338263888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263908\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263924\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338263960\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263976\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338264014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338264030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338264065\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338264082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338264098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338264116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264147\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338264165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338271321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338271361\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338271377\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338271389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338271402\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338271413\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338271423\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271435\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338271480\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338271491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338271501\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338271513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338271524\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271535\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338271546\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338271557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338271567\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338271578\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271600\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338358711\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338358762\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227338359240\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler163)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338359333\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler163)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338359371\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338359687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338359754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x51248bf2 your_disc:0x17dbdf73\"\n },\n {\n \"at\": \"1789227338359785\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338359813\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338359837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338359861\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338359884\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338359910\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338359936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338359963\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493357ms\"\n },\n {\n \"at\": \"1789227338359988\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +854ms\"\n },\n {\n \"at\": \"1789227338360015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227338360040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338360072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338360111\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338360161\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338360233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338360259\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360284\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338360315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338360338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338360389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler163)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338360417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338360441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338360462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338360485\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338360509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338360532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338360558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +854ms\"\n },\n {\n \"at\": \"1789227338360582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227338360605\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338360628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338360652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360673\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338360696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360722\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360746\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338360771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338360794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338360841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360869\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338362911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler163)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338362994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler163)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338363029\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338363067\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338363091\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xccffcd9e your_disc:0x0\"\n },\n {\n \"at\": \"1789227338363119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338363143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338363165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338363189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338363233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363287\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493360ms\"\n },\n {\n \"at\": \"1789227338363312\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227338363338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227338363368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338363391\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338363415\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338363470\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338363540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338363569\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338363618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338363642\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363664\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338363717\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338363743\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338363789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363815\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338363865\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227338363887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227338363913\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338363936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338363961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338364014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364066\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338364090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338364114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338364138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338364162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364186\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364209\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338366697\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338366781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789227338367563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler163)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338367637\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler163)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338367670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338367699\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338367718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x189931f2 your_disc:0xf807dd2c\"\n },\n {\n \"at\": \"1789227338367742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338367768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338367787\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338367805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338367820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338367843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338367860\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338367875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493365ms\"\n },\n {\n \"at\": \"1789227338367896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +996ms\"\n },\n {\n \"at\": \"1789227338367914\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227338367934\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338367952\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338367969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338367987\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338368005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338368053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338368072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338368122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338368139\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338368174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler163)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338368193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338368208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338368224\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338368241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338368258\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338368274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338368289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +996ms\"\n },\n {\n \"at\": \"1789227338368306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227338368321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338368342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338368359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338368394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368411\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338368444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338368461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338368494\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368526\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340094406\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227340094719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227340094747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340094764\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227340094782\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227340094808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227340094827\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227340094853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +870ms\"\n },\n {\n \"at\": \"1789227340094872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -60ms\"\n },\n {\n \"at\": \"1789227340094894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227340094911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227340094932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227340094951\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227340094969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340094988\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340095006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227340095022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227340095040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227340095058\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227340095086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227340095106\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340095127\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340702548\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge br-int: added interface vethe019766a on port 26\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:46.007557+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.173, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338072228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00171|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338072375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00172|bridge|INFO|bridge incusovn16: using datapath ID 000006169a233441\"\n },\n {\n \"at\": \"1789227338072390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00173|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338170866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00174|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338171095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227338176363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00176|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338176419\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00177|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227338261355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00178|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338261407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338261432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338261452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338261466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338261481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338261499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338261564\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338261580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338261595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338261612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338261628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338261660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338261678\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338261694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338261709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261727\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261741\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338261756\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338265444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00179|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338265481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338265498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338265513\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338265529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338265545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338265560\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265594\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338265625\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338265640\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338265654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338265671\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338265686\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338265723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338265738\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338265753\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338265769\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265807\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338266407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler177)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338266556\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler177)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338266579\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338266607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338266624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x6b88a426 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338266642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338266663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338266681\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338266697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338266713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338266728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338266743\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338266760\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720130ms\"\n },\n {\n \"at\": \"1789227338266775\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +795ms\"\n },\n {\n \"at\": \"1789227338266803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227338266820\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338266836\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338266851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338266866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338266880\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338266895\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338266920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338266938\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338266959\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338266975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338266994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338267015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267032\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267048\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338267065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338267082\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267143\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338267162\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +795ms\"\n },\n {\n \"at\": \"1789227338267176\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227338267190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267205\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338267220\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267235\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338267249\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267267\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338267297\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338267310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267325\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338267340\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267418\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler177)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338267434\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler177)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338267449\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338267463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338267477\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x17dbdf73 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338267494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338267508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338267529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338267544\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267587\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267616\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267652\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267669\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338267682\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338267710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267739\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338267752\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338267766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267779\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338267796\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338267809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267839\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338267854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338267868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267881\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267910\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267930\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338267951\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267964\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267993\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338268009\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338268024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338268039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268055\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338268083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338268097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338268111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338268126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268153\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338272791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00180|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338272808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338272825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338272835\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338272845\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338272856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338272865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272902\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338272917\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338272927\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338272937\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338272948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338272957\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338272966\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338272977\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338272987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338272997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338273006\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338273016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338273026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338370906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler177)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338371008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler177)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338371024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338371042\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338371054\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xea4aba81 your_disc:0x21aad08\"\n },\n {\n \"at\": \"1789227338371065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338371075\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338371086\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338371095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338371117\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720234ms\"\n },\n {\n \"at\": \"1789227338371156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227338371169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227338371181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338371192\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338371211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338371241\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338371272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338371285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338371312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338371322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler177)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338371353\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338371366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338371393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338371438\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227338371453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227338371466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338371478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338371492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338371519\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338371549\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338371559\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371569\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338371579\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339068251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339068452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339068480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339068498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339068516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339068535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339068554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339068572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +923ms\"\n },\n {\n \"at\": \"1789227339068590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227339068609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339068627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339068656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339068680\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339068700\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339068775\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339068799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339068821\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339068840\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339068857\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068874\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339217357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339217635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339217651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339217662\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339217672\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339217683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339217693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339217704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +706ms\"\n },\n {\n \"at\": \"1789227339217723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227339217735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339217746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339217761\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339217771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227339217781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217792\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339217822\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339217837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339217850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227339217864\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339217878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217892\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:46.180699+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-before-probe.txt", "router_mac": "10:66:6a:33:3f:c7", "at": "2026-09-12T15:35:46.181524+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.098, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:35:39.136713458Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:35:39.926951525Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:35:40.219671782Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:35:40.788133121Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:35:46.279701+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 74192, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T15:35:46.401168+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.217, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.097 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.099 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"0fd6b534-eba0-4a59-9391-31704e260f77\",\"volatile.eth0.host_name\":\"veth011e07a6\",\"volatile.eth0.hwaddr\":\"10:66:6a:e8:83:f2\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\"volatile.uuid.generation\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:35:39.136713458Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"0fd6b534-eba0-4a59-9391-31704e260f77\",\"volatile.eth0.host_name\":\"veth011e07a6\",\"volatile.eth0.hwaddr\":\"10:66:6a:e8:83:f2\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\"volatile.uuid.generation\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:35:39.926951525Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":10297344,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fee8:83f2\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:e8:83:f2\",\"host_name\":\"veth011e07a6\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4174468,\"processes\":4,\"cpu\":{\"usage\":483192000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:35:38.950000047Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"65f87cd9-1fae-47b2-9688-7c3105f43066\",\"volatile.eth0.host_name\":\"vethe019766a\",\"volatile.eth0.hwaddr\":\"10:66:6a:5c:44:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\"volatile.uuid.generation\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:35:40.219671782Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"65f87cd9-1fae-47b2-9688-7c3105f43066\",\"volatile.eth0.host_name\":\"vethe019766a\",\"volatile.eth0.hwaddr\":\"10:66:6a:5c:44:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\"volatile.uuid.generation\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:35:40.788133121Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11206656,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe5c:4471\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:5c:44:71\",\"host_name\":\"vethe019766a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":33163,\"processes\":4,\"cpu\":{\"usage\":499911000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:35:40.809999942Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.113 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.193 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.274 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.259 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.722 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.290 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.290/0.757/1.259 ms\nelapsed_seconds=2.221 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.217 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.666 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.383 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.383/0.755/1.217 ms\nelapsed_seconds=2.234 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.135 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.756 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.907 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.907/1.599/2.135 ms\nelapsed_seconds=2.455 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.161 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.598 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.953 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.953/1.570/2.161 ms\nelapsed_seconds=2.255 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nelapsed_seconds=0.709 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.221 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.316 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.315 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.028 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.115007 bytes_per_second=869512290\nelapsed_seconds=0.496 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.522 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.135790 bytes_per_second=736431254\nelapsed_seconds=0.384 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.521 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:00.619038+00:00"} +{"capture": "tcpdump-arp", "pid": 74192, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T15:36:00.621599+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.091, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:00.713426+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.082, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:e8:83:f2 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:5c:44:71 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:00.795717+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.12, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 610cb309-8282-4d8d-a2b7-e085bfbf4cad (incus-net32-ls-ext)\n port incus-net32-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net32-ls-ext-lsp-router\n type: router\n router-port: incus-net32-lr-lrp-ext\nswitch aca93faa-aea8-4729-b88c-82ed44ef3937 (incus-net32-ls-int)\n port incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0\n addresses: [\"10:66:6a:e8:83:f2 dynamic\"]\n port incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0\n addresses: [\"10:66:6a:5c:44:71 dynamic\"]\n port incus-net32-ls-int-lsp-router\n type: router\n router-port: incus-net32-lr-lrp-int\nrouter bac0e241-5743-49b5-84b1-a9cedca557e4 (incus-net32-lr)\n port incus-net32-lr-lrp-ext\n mac: \"10:66:6a:33:3f:c7\"\n ipv6-lla: \"fe80::1266:6aff:fe33:3fc7\"\n networks: [\"10.10.40.64/24\"]\n port incus-net32-lr-lrp-int\n mac: \"10:66:6a:33:3f:c7\"\n ipv6-lla: \"fe80::1266:6aff:fe33:3fc7\"\n networks: [\"10.253.73.1/24\"]\n nat 86281e38-e6d1-49b0-9312-550270ea278b\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net32-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 8e4ad01e-8d0e-459d-8227-88bd4cdfb753\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 7f660565-1f66-46ba-98cd-0050dba7ddb3\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:33:3f:c7\"\nname : incus-net32-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n\n_uuid : e3c18ecb-9ce8-4744-979d-f5e9515a371c\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:33:3f:c7\"\nname : incus-net32-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 531558c5-4afd-433c-bd5d-2ac485276100\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : 63db9462-5bdb-4b90-8046-0259671d83f1\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 0b893e82-7020-4a69-a5ba-c106fd207e69\nlogical_port : cr-incus-net32-lr-lrp-ext\nmac : [\"10:66:6a:33:3f:c7 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net32-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:33:3f:c7 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:36:00.915535+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.31, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:33:3f:c7 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:36:01.225751+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.214, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338272799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84031|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338273036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84032|bridge|INFO|bridge incusovn16: using datapath ID 00007a092e54774b\"\n },\n {\n \"at\": \"1789227338273071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84033|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338276027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84034|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338276110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338276145\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338276171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338276193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338276223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338276250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276288\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338276376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338276460\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338276493\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338276546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338276641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338276721\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84035|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338276747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338276773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338276791\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338276811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338276827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338276846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338276909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338276946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338277010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338277031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338277081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277097\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338277139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338277209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84036|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338277233\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338277251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338277273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338277289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338277306\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338277332\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277351\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338277417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277459\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338277492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338277509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338277561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338277619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338368846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler187)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338368952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler187)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338369004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338369041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338369093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x21aad08 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338369124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338369164\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338369202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338369253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338369290\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338369328\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338369357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338369391\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338369555\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338369593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338369630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338369668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338369767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338369804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338369828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338369862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338369889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338369961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338369991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338370021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338370054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338370080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338370106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338370131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338370178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338370465\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338370678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338370707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338370745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338370774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338370807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338370837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338370873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338370904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338370932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338370956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338370987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84037|dpif|WARN|Dropped 386 log messages in last 239 seconds (most recently, 239 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227338371118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84038|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371163\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84039|bridge|WARN|Dropped 11150 log messages in last 244 seconds (most recently, 239 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227338371214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84040|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84042|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84043|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371389\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84044|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371968\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338372086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84046|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338372633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler187)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338372742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler187)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338372781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338372819\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338372849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x9ccef038 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338372889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338372916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338372953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338372977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338373043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338373131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +863ms\"\n },\n {\n \"at\": \"1789227338373179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789227338373203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338373281\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338373310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338373369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373396\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338373448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338373474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338373549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338373581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373607\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373634\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338373672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338373695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338373770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338373852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +863ms\"\n },\n {\n \"at\": \"1789227338373878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789227338373909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338373932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338373961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338374020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338374102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338374127\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338374156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338374191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338374286\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338374318\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler187)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338374350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler187)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338374381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338374410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338374437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xf807dd2c your_disc:0x0\"\n },\n {\n \"at\": \"1789227338374470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338374509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338374540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338374568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338374600\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338374630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338374662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338374688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338374811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338374837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338374864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338374896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338374984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338375008\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338375068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338375094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338375142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338375174\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338375209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338375247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338375269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338375292\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338375323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338375359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338375390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338375416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338375442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338375470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338375535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338375615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338375648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338375701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375752\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338376402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84048|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227338376500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84049|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227339198829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339198979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339199014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339199032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339199044\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339199058\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339199071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339199079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +68ms\"\n },\n {\n \"at\": \"1789227339199087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -822ms\"\n },\n {\n \"at\": \"1789227339199107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339199126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339199138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339199153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227339199170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339199209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339199218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339199225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227339199247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339199258\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199276\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339368900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84050|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227339369086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227339372637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339372734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339372773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339372803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339372836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339372868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339372887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339372916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +654ms\"\n },\n {\n \"at\": \"1789227339372945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -136ms\"\n },\n {\n \"at\": \"1789227339372976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339372998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339373023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339373072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339373138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339373159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339373214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339373238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339373865\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339373881\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339373894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339373901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339373912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339373920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339373934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339373944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +733ms\"\n },\n {\n \"at\": \"1789227339373952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -37ms\"\n },\n {\n \"at\": \"1789227339373962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339373975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339373984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227339374004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339374036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339374047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339374057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227339374065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339374074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339688142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84052|bridge|INFO|bridge br-int: added interface veth011e07a6 on port 28\"\n },\n {\n \"at\": \"1789227340368741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84053|dpif|WARN|Dropped 1982 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227340368832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227340732722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84055|poll_loop|INFO|Dropped 4609 log messages in last 243 seconds (most recently, 238 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227340732925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84056|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340733054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84057|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340733549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84058|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340734039\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84059|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340734543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84060|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340735033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84061|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340735538\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84062|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340736041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84063|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340736549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84064|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340737054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84065|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227341368665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84066|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227341368762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84067|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227342368897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84068|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227342369123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227343368955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84070|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227343369140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227344368688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84072|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227344368794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227345368707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84074|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227345368936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84075|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227346368688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84076|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227346368788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84077|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227346733034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84078|poll_loop|INFO|Dropped 12304 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227346733150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227347368658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84080|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227347368761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84081|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227348278776\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84082|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 6 s starting 10 s ago (852 adds, 78 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789227348368863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84083|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227348368920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84084|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227349368823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84085|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227349369055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84086|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227350369001\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84087|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227350369235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84088|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227351368916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84089|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227351369028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84090|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227352368871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84091|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227352368986\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84092|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227352732881\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84093|poll_loop|INFO|Dropped 12343 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227352733055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84094|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227353368970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84095|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227353369062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84096|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227354368720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84097|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227354368908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227355368756\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84099|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227355368964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227356368976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84101|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227356369203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227357368759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84103|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227357368864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227358368618\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84105|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227358368907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227358732639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84107|poll_loop|INFO|Dropped 12377 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227358732758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84108|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227359368747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84109|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227359368936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84110|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227360368665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84111|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227360368777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227361368663\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84113|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227361368747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:01.439885+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.514, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338260096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00167|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338260250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00168|bridge|INFO|bridge incusovn16: using datapath ID 000042b3b8d8b845\"\n },\n {\n \"at\": \"1789227338260271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00169|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338260288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00170|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338260305\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338260322\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338260337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338260351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338260366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338260381\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260415\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338260448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338260463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338260478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338260496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338260510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338260540\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338260555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338260568\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338260581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260597\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260612\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338260626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338269943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00171|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338269984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338269996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338270007\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338270020\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338270030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338270045\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270057\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338270091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270113\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338270125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338270134\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270144\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338270154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270163\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338270184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270194\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338270214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00172|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338270225\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338270235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338270247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338270256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338270266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338270277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338270318\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270338\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338270348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338270358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338270378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338270414\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270424\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270435\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338355186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00173|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338355590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00174|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227338358605\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338358647\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00176|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789227339056207\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler169)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339056350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler169)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339056384\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339056428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339056452\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x7639c892 your_disc:0x6b88a426\"\n },\n {\n \"at\": \"1789227339056481\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339056507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339056530\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339056551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339056573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339056596\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339056617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339056648\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594055ms\"\n },\n {\n \"at\": \"1789227339056670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -16ms\"\n },\n {\n \"at\": \"1789227339056699\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -796ms\"\n },\n {\n \"at\": \"1789227339056723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339056744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339056768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339056791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339056813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339056836\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339056861\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339056883\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339056916\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339056944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339056967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339056989\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057012\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339057032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler169)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339057054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339057076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339057152\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339057174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339057194\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339057215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339057240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -16ms\"\n },\n {\n \"at\": \"1789227339057261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -796ms\"\n },\n {\n \"at\": \"1789227339057288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339057309\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339057328\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339057348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339057370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057419\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339057440\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339057461\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339057484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339057510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339224346\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler169)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339224434\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler169)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339224470\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339224495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339224515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x349dc1e2 your_disc:0x9ccef038\"\n },\n {\n \"at\": \"1789227339224541\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339224564\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339224595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339224619\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339224640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339224663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339224688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339224715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594223ms\"\n },\n {\n \"at\": \"1789227339224750\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +47ms\"\n },\n {\n \"at\": \"1789227339224773\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -863ms\"\n },\n {\n \"at\": \"1789227339224796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339224818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339224837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339224857\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339224879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339224900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339224921\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339224942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339224963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339224983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339225008\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339225029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339225071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler169)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339225095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339225117\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339225138\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339225156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339225175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339225195\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339225216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +47ms\"\n },\n {\n \"at\": \"1789227339225237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -863ms\"\n },\n {\n \"at\": \"1789227339225259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339225278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339225299\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339225319\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339225343\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225382\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339225408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339225429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339225450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339225471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225491\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225509\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339251697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler169)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339251752\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler169)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339251771\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339251786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339251800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xdd2303b9 your_disc:0xccffcd9e\"\n },\n {\n \"at\": \"1789227339251814\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339251829\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339251844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339251859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339251872\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339251887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339251903\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339251918\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594251ms\"\n },\n {\n \"at\": \"1789227339251935\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +839ms\"\n },\n {\n \"at\": \"1789227339251953\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -71ms\"\n },\n {\n \"at\": \"1789227339251968\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339251982\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339251995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252009\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227339252024\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339252064\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339252078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227339252106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339252121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252135\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339252154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler169)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339252170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339252184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339252197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339252211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339252226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339252240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339252254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +839ms\"\n },\n {\n \"at\": \"1789227339252267\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -71ms\"\n },\n {\n \"at\": \"1789227339252279\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339252291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339252303\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227339252329\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339252368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339252381\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227339252416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252444\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227348263315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00177|connmgr|INFO|br-int<->unix#7: 905 flow_mods in the 6 s starting 10 s ago (838 adds, 59 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:01.955284+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.207, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338260510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338260920\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00008a575f87ca4a\"\n },\n {\n \"at\": \"1789227338260946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00185|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338263324\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00186|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338263393\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338263420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338263444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338263465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338263482\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338263503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338263576\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263593\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263611\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338263636\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338263652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338263686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263700\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263715\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338263732\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338263788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00187|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338263804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338263821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338263837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338263855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338263872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338263888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263908\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263924\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338263960\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263976\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338264014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338264030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338264065\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338264082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338264098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338264116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264147\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338264165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338271321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338271361\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338271377\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338271389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338271402\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338271413\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338271423\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271435\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338271480\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338271491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338271501\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338271513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338271524\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271535\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338271546\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338271557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338271567\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338271578\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271600\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338358711\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338358762\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227338359240\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler163)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338359333\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler163)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338359371\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338359687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338359754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x51248bf2 your_disc:0x17dbdf73\"\n },\n {\n \"at\": \"1789227338359785\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338359813\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338359837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338359861\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338359884\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338359910\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338359936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338359963\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493357ms\"\n },\n {\n \"at\": \"1789227338359988\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +854ms\"\n },\n {\n \"at\": \"1789227338360015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227338360040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338360072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338360111\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338360161\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338360233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338360259\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360284\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338360315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338360338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338360389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler163)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338360417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338360441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338360462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338360485\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338360509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338360532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338360558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +854ms\"\n },\n {\n \"at\": \"1789227338360582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227338360605\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338360628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338360652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360673\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338360696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360722\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360746\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338360771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338360794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338360841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360869\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338362911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler163)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338362994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler163)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338363029\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338363067\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338363091\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xccffcd9e your_disc:0x0\"\n },\n {\n \"at\": \"1789227338363119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338363143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338363165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338363189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338363233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363287\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493360ms\"\n },\n {\n \"at\": \"1789227338363312\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227338363338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227338363368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338363391\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338363415\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338363470\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338363540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338363569\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338363618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338363642\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363664\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338363717\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338363743\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338363789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363815\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338363865\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227338363887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227338363913\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338363936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338363961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338364014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364066\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338364090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338364114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338364138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338364162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364186\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364209\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338366697\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338366781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789227338367563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler163)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338367637\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler163)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338367670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338367699\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338367718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x189931f2 your_disc:0xf807dd2c\"\n },\n {\n \"at\": \"1789227338367742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338367768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338367787\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338367805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338367820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338367843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338367860\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338367875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493365ms\"\n },\n {\n \"at\": \"1789227338367896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +996ms\"\n },\n {\n \"at\": \"1789227338367914\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227338367934\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338367952\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338367969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338367987\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338368005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338368053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338368072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338368122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338368139\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338368174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler163)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338368193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338368208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338368224\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338368241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338368258\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338368274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338368289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +996ms\"\n },\n {\n \"at\": \"1789227338368306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227338368321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338368342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338368359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338368394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368411\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338368444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338368461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338368494\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368526\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340094406\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227340094719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227340094747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340094764\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227340094782\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227340094808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227340094827\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227340094853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +870ms\"\n },\n {\n \"at\": \"1789227340094872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -60ms\"\n },\n {\n \"at\": \"1789227340094894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227340094911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227340094932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227340094951\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227340094969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340094988\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340095006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227340095022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227340095040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227340095058\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227340095086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227340095106\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340095127\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340702548\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge br-int: added interface vethe019766a on port 26\"\n },\n {\n \"at\": \"1789227348265904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00194|connmgr|INFO|br-int<->unix#7: 936 flow_mods in the 6 s starting 10 s ago (850 adds, 78 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:02.163139+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.295, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338072228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00171|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338072375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00172|bridge|INFO|bridge incusovn16: using datapath ID 000006169a233441\"\n },\n {\n \"at\": \"1789227338072390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00173|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338170866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00174|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338171095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227338176363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00176|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338176419\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00177|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227338261355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00178|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338261407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338261432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338261452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338261466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338261481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338261499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338261564\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338261580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338261595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338261612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338261628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338261660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338261678\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338261694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338261709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261727\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261741\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338261756\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338265444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00179|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338265481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338265498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338265513\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338265529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338265545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338265560\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265594\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338265625\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338265640\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338265654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338265671\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338265686\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338265723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338265738\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338265753\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338265769\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265807\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338266407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler177)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338266556\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler177)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338266579\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338266607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338266624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x6b88a426 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338266642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338266663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338266681\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338266697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338266713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338266728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338266743\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338266760\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720130ms\"\n },\n {\n \"at\": \"1789227338266775\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +795ms\"\n },\n {\n \"at\": \"1789227338266803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227338266820\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338266836\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338266851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338266866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338266880\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338266895\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338266920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338266938\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338266959\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338266975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338266994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338267015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267032\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267048\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338267065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338267082\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267143\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338267162\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +795ms\"\n },\n {\n \"at\": \"1789227338267176\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227338267190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267205\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338267220\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267235\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338267249\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267267\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338267297\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338267310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267325\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338267340\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267418\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler177)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338267434\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler177)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338267449\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338267463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338267477\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x17dbdf73 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338267494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338267508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338267529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338267544\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267587\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267616\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267652\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267669\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338267682\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338267710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267739\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338267752\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338267766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267779\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338267796\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338267809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267839\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338267854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338267868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267881\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267910\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267930\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338267951\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267964\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267993\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338268009\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338268024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338268039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268055\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338268083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338268097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338268111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338268126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268153\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338272791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00180|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338272808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338272825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338272835\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338272845\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338272856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338272865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272902\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338272917\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338272927\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338272937\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338272948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338272957\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338272966\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338272977\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338272987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338272997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338273006\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338273016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338273026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338370906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler177)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338371008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler177)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338371024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338371042\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338371054\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xea4aba81 your_disc:0x21aad08\"\n },\n {\n \"at\": \"1789227338371065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338371075\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338371086\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338371095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338371117\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720234ms\"\n },\n {\n \"at\": \"1789227338371156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227338371169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227338371181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338371192\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338371211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338371241\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338371272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338371285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338371312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338371322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler177)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338371353\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338371366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338371393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338371438\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227338371453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227338371466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338371478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338371492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338371519\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338371549\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338371559\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371569\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338371579\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339068251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339068452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339068480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339068498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339068516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339068535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339068554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339068572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +923ms\"\n },\n {\n \"at\": \"1789227339068590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227339068609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339068627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339068656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339068680\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339068700\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339068775\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339068799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339068821\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339068840\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339068857\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068874\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339217357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339217635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339217651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339217662\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339217672\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339217683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339217693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339217704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +706ms\"\n },\n {\n \"at\": \"1789227339217723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227339217735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339217746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339217761\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339217771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227339217781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217792\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339217822\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339217837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339217850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227339217864\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339217878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217892\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227348077289\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00181|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (843 adds, 83 deletes, 2 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:02.458538+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-probe.txt", "router_mac": "10:66:6a:33:3f:c7", "at": "2026-09-12T15:36:02.459649+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 75262, "ready": true, "ready_signal": "time=\"2026-09-12T08:36:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:36:02.565914+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/topology.jsonl", "destroy"], "seconds": 3.92, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:06.486907+00:00"} +{"capture": "monitor-delete", "pid": 75262, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.log", "ready_signal": "time=\"2026-09-12T08:36:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:36:06.488897+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.092, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:36:06.581334+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.088, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:36:06.669148+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.127, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:33:3f:c7 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:36:06.796694+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.308, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:33:3f:c7 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:36:07.104762+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.201, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338272799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84031|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338273036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84032|bridge|INFO|bridge incusovn16: using datapath ID 00007a092e54774b\"\n },\n {\n \"at\": \"1789227338273071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84033|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338276027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84034|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338276110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338276145\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338276171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338276193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338276223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338276250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276288\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338276376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338276460\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338276493\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338276546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338276641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338276693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338276721\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84035|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338276747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338276773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338276791\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338276811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338276827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338276846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276885\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338276909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338276927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338276946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338276970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338276988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338277010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338277031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338277081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277097\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338277139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338277209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84036|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338277233\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338277251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338277273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338277289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338277306\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338277332\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277351\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616276ms\"\n },\n {\n \"at\": \"1789227338277394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338277417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277459\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338277492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338277509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338277561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338277579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338277594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338277619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338277664\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338368846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler187)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338368952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler187)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338369004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338369041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338369093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x21aad08 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338369124\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338369164\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338369202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338369253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338369290\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338369328\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338369357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338369391\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338369528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338369555\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338369593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338369630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338369668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338369767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338369804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338369828\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338369862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338369889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338369932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338369961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338369991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338370021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338370054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338370080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338370106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338370131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338370178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338370465\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616369ms\"\n },\n {\n \"at\": \"1789227338370678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338370707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338370745\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338370774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338370807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338370837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338370873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338370904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338370932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338370956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338370987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84037|dpif|WARN|Dropped 386 log messages in last 239 seconds (most recently, 239 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227338371118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84038|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371163\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84039|bridge|WARN|Dropped 11150 log messages in last 244 seconds (most recently, 239 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227338371214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84040|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84042|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84043|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338371389\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84044|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338371968\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338372086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84046|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227338372633\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler187)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338372742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler187)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338372781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338372819\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338372849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x9ccef038 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338372889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338372916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338372953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338372977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338373043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338373131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +863ms\"\n },\n {\n \"at\": \"1789227338373179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789227338373203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338373281\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338373310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338373369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373396\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338373448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338373474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338373549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338373581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338373607\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373634\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338373672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338373695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338373735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338373770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373800\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338373826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338373852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +863ms\"\n },\n {\n \"at\": \"1789227338373878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789227338373909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338373932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338373961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338373995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227338374020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338374102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338374127\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338374156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338374191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338374286\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227338374318\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler187)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338374350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler187)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338374381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338374410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338374437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xf807dd2c your_disc:0x0\"\n },\n {\n \"at\": \"1789227338374470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338374509\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338374540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338374568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338374600\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338374630\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338374662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338374688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338374785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338374811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338374837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338374864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338374896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338374951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338374984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338375008\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338375068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338375094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338375142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338375174\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338375209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338375247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338375269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338375292\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338375323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338375359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338375390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541616373ms\"\n },\n {\n \"at\": \"1789227338375416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338375442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338375470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338375535\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338375615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338375648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338375671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338375701\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338375752\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338376402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84048|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227338376500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84049|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227339198829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339198979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339199014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339199032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339199044\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339199058\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339199071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339199079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +68ms\"\n },\n {\n \"at\": \"1789227339199087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -822ms\"\n },\n {\n \"at\": \"1789227339199107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339199126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339199138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339199153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227339199170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339199209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339199218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339199225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227339199247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339199258\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339199276\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339368900\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84050|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227339369086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227339372637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339372734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339372773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339372803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339372836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339372868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339372887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339372916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +654ms\"\n },\n {\n \"at\": \"1789227339372945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -136ms\"\n },\n {\n \"at\": \"1789227339372976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339372998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339373023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339373072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339373138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339373159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339373214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339373238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339373452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339373865\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339373881\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339373894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339373901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339373912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339373920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339373934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339373944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +733ms\"\n },\n {\n \"at\": \"1789227339373952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -37ms\"\n },\n {\n \"at\": \"1789227339373962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339373975\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339373984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339373995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227339374004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339374036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339374047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339374057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227339374065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339374074\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339374081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339688142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84052|bridge|INFO|bridge br-int: added interface veth011e07a6 on port 28\"\n },\n {\n \"at\": \"1789227340368741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84053|dpif|WARN|Dropped 1982 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227340368832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227340732722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84055|poll_loop|INFO|Dropped 4609 log messages in last 243 seconds (most recently, 238 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227340732925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84056|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340733054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84057|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340733549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84058|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340734039\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84059|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340734543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84060|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340735033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84061|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340735538\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84062|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340736041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84063|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340736549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84064|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227340737054\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84065|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)\"\n },\n {\n \"at\": \"1789227341368665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84066|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227341368762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84067|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227342368897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84068|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227342369123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227343368955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84070|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227343369140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227344368688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84072|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227344368794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227345368707\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84074|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227345368936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84075|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227346368688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84076|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227346368788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84077|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227346733034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84078|poll_loop|INFO|Dropped 12304 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227346733150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227347368658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84080|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227347368761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84081|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227348278776\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84082|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 6 s starting 10 s ago (852 adds, 78 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789227348368863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84083|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227348368920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84084|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227349368823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84085|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227349369055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84086|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227350369001\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84087|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227350369235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84088|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227351368916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84089|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227351369028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84090|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227352368871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84091|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227352368986\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84092|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227352732881\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84093|poll_loop|INFO|Dropped 12343 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227352733055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84094|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227353368970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84095|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227353369062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84096|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227354368720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84097|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227354368908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227355368756\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84099|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227355368964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227356368976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84101|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227356369203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227357368759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84103|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227357368864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227358368618\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84105|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227358368907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227358732639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84107|poll_loop|INFO|Dropped 12377 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227358732758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84108|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227359368747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84109|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227359368936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84110|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227360368665\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84111|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227360368777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227361368663\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84113|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227361368747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227362368765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84115|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227362368990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227363219807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84117|bridge|INFO|bridge br-int: deleted interface veth011e07a6 on port 28\"\n },\n {\n \"at\": \"1789227363368593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84118|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227363368712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84119|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227364368516\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84120|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227364368724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84121|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227364732899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84122|poll_loop|INFO|Dropped 12273 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227364732973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84123|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227365368700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84124|dpif|WARN|Dropped 2122 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227365368934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84125|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227365527462\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84126|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227365527553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84127|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227365556648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84128|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227365556693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:07.305862+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.177, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338260096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00167|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338260250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00168|bridge|INFO|bridge incusovn16: using datapath ID 000042b3b8d8b845\"\n },\n {\n \"at\": \"1789227338260271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00169|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338260288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00170|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338260305\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338260322\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338260337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338260351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338260366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338260381\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260415\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593259ms\"\n },\n {\n \"at\": \"1789227338260431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338260448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338260463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338260478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338260496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338260510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338260540\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338260555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338260568\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338260581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260597\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338260612\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338260626\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338269943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00171|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338269984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338269996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338270007\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338270020\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338270030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338270045\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270057\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338270091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270113\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338270125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338270134\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270144\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338270154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270163\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338270184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270194\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338270214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00172|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338270225\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338270235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338270247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338270256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338270266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338270277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590593269ms\"\n },\n {\n \"at\": \"1789227338270307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338270318\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270338\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227338270348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338270358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338270378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338270388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338270403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338270414\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270424\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338270435\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338355186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00173|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338355590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00174|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227338358605\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338358647\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00176|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789227339056207\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler169)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339056350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler169)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339056384\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339056428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339056452\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x7639c892 your_disc:0x6b88a426\"\n },\n {\n \"at\": \"1789227339056481\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339056507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339056530\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339056551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339056573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339056596\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339056617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339056648\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594055ms\"\n },\n {\n \"at\": \"1789227339056670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -16ms\"\n },\n {\n \"at\": \"1789227339056699\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -796ms\"\n },\n {\n \"at\": \"1789227339056723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339056744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339056768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339056791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339056813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339056836\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339056861\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339056883\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339056916\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339056944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339056967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339056989\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057012\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339057032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler169)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339057054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339057076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339057152\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339057174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339057194\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339057215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339057240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -16ms\"\n },\n {\n \"at\": \"1789227339057261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -796ms\"\n },\n {\n \"at\": \"1789227339057288\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339057309\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339057328\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339057348\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339057370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057419\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339057440\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339057461\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339057484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339057510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339057555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339224346\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler169)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339224434\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler169)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339224470\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339224495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339224515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x349dc1e2 your_disc:0x9ccef038\"\n },\n {\n \"at\": \"1789227339224541\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339224564\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339224595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339224619\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339224640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339224663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339224688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339224715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594223ms\"\n },\n {\n \"at\": \"1789227339224750\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +47ms\"\n },\n {\n \"at\": \"1789227339224773\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -863ms\"\n },\n {\n \"at\": \"1789227339224796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339224818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339224837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339224857\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339224879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339224900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339224921\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339224942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339224963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339224983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339225008\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339225029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339225071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler169)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339225095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339225117\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339225138\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339225156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339225175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339225195\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339225216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +47ms\"\n },\n {\n \"at\": \"1789227339225237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -863ms\"\n },\n {\n \"at\": \"1789227339225259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339225278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339225299\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339225319\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x9ccef038\"\n },\n {\n \"at\": \"1789227339225343\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225382\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339225408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339225429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339225450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x349dc1e2\"\n },\n {\n \"at\": \"1789227339225471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225491\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339225509\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339251697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler169)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227339251752\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler169)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227339251771\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227339251786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227339251800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xdd2303b9 your_disc:0xccffcd9e\"\n },\n {\n \"at\": \"1789227339251814\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339251829\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227339251844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227339251859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339251872\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339251887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339251903\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339251918\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590594251ms\"\n },\n {\n \"at\": \"1789227339251935\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +839ms\"\n },\n {\n \"at\": \"1789227339251953\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -71ms\"\n },\n {\n \"at\": \"1789227339251968\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339251982\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339251995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252009\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227339252024\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339252064\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339252078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227339252106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227339252121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252135\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339252154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler169)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339252170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339252184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339252197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339252211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339252226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339252240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339252254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +839ms\"\n },\n {\n \"at\": \"1789227339252267\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -71ms\"\n },\n {\n \"at\": \"1789227339252279\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339252291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227339252303\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227339252329\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339252368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227339252381\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339252400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227339252416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339252444\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227348263315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00177|connmgr|INFO|br-int<->unix#7: 905 flow_mods in the 6 s starting 10 s ago (838 adds, 59 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789227365519446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00178|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227365520027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00179|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227365520053\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00180|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227365537376\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00181|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789227365537428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:07.483279+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.165, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338260510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338260920\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00008a575f87ca4a\"\n },\n {\n \"at\": \"1789227338260946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00185|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338263324\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00186|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338263393\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338263420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338263444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338263465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338263482\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338263503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338263576\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263593\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263611\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338263636\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338263652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338263686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263700\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263715\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338263732\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338263771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338263788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00187|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338263804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338263821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338263837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338263855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338263872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338263888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263908\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263924\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493261ms\"\n },\n {\n \"at\": \"1789227338263944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338263960\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338263976\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338263996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338264014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338264030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338264065\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338264082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338264098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338264116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338264147\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338264165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338271321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338271361\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338271377\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338271389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338271402\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338271413\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338271423\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271435\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49493269ms\"\n },\n {\n \"at\": \"1789227338271469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338271480\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338271491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338271501\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338271513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338271524\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271535\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338271546\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338271557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338271567\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338271578\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338271600\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338358711\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338358762\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227338359240\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler163)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338359333\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler163)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338359371\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338359687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338359754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x51248bf2 your_disc:0x17dbdf73\"\n },\n {\n \"at\": \"1789227338359785\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338359813\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338359837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338359861\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338359884\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338359910\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338359936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338359963\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493357ms\"\n },\n {\n \"at\": \"1789227338359988\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +854ms\"\n },\n {\n \"at\": \"1789227338360015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227338360040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338360072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338360111\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338360161\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338360233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338360259\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360284\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338360315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338360338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338360389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler163)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338360417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338360441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338360462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338360485\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338360509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338360532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338360558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +854ms\"\n },\n {\n \"at\": \"1789227338360582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227338360605\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338360628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338360652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360673\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338360696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360722\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360746\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338360771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338360794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338360818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338360841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360869\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338360895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338362911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler163)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338362994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler163)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338363029\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338363067\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338363091\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xccffcd9e your_disc:0x0\"\n },\n {\n \"at\": \"1789227338363119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338363143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338363165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338363189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338363233\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363287\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493360ms\"\n },\n {\n \"at\": \"1789227338363312\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227338363338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227338363368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338363391\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338363415\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338363470\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338363540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338363569\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338363618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338363642\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338363664\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338363717\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338363743\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338363766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338363789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363815\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338363839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338363865\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227338363887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227338363913\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338363936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338363961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338363986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227338364014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364066\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338364090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338364114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338364138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227338364162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364186\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338364209\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338366697\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338366781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789227338367563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler163)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338367637\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler163)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338367670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338367699\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338367718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x189931f2 your_disc:0xf807dd2c\"\n },\n {\n \"at\": \"1789227338367742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338367768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338367787\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338367805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338367820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338367843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338367860\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338367875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49493365ms\"\n },\n {\n \"at\": \"1789227338367896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +996ms\"\n },\n {\n \"at\": \"1789227338367914\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227338367934\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338367952\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338367969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338367987\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338368005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338368053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338368072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338368122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338368139\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338368174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler163)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338368193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338368208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338368224\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338368241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338368258\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338368274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338368289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +996ms\"\n },\n {\n \"at\": \"1789227338368306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227338368321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338368342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338368359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf807dd2c\"\n },\n {\n \"at\": \"1789227338368394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368411\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338368444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338368461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338368477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x189931f2\"\n },\n {\n \"at\": \"1789227338368494\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338368526\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340094406\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227340094719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227340094747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340094764\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227340094782\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227340094808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227340094827\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227340094853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +870ms\"\n },\n {\n \"at\": \"1789227340094872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -60ms\"\n },\n {\n \"at\": \"1789227340094894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227340094911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227340094932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227340094951\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdd2303b9\"\n },\n {\n \"at\": \"1789227340094969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340094988\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340095006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227340095022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227340095040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227340095058\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xccffcd9e\"\n },\n {\n \"at\": \"1789227340095086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227340095106\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227340095127\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227340702548\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge br-int: added interface vethe019766a on port 26\"\n },\n {\n \"at\": \"1789227348265904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00194|connmgr|INFO|br-int<->unix#7: 936 flow_mods in the 6 s starting 10 s ago (850 adds, 78 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789227364293427\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00195|bridge|INFO|bridge br-int: deleted interface vethe019766a on port 26\"\n },\n {\n \"at\": \"1789227365521742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00196|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227365522003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00197|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227365522039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00198|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227365551079\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00199|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789227365551408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:07.649162+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A35%3A34.752899%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.194, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227338072228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00171|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227338072375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00172|bridge|INFO|bridge incusovn16: using datapath ID 000006169a233441\"\n },\n {\n \"at\": \"1789227338072390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00173|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227338170866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00174|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227338171095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227338176363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00176|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227338176419\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00177|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227338261355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00178|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338261407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338261432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338261452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338261466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338261481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338261499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720125ms\"\n },\n {\n \"at\": \"1789227338261547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338261564\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338261580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338261595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338261612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338261628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338261660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338261678\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338261694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338261709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261727\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338261741\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338261756\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227338265444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00179|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338265481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338265498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338265513\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338265529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338265545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338265560\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265594\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720129ms\"\n },\n {\n \"at\": \"1789227338265610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338265625\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338265640\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338265654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338265671\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338265686\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338265723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338265738\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338265753\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338265769\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338265807\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338266407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler177)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338266556\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler177)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338266579\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338266607\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338266624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x6b88a426 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338266642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338266663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338266681\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338266697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338266713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338266728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338266743\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338266760\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720130ms\"\n },\n {\n \"at\": \"1789227338266775\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +795ms\"\n },\n {\n \"at\": \"1789227338266803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227338266820\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338266836\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338266851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338266866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338266880\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338266895\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338266920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338266938\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338266959\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338266975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338266994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338267015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267032\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267048\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338267065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338267082\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267143\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338267162\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +795ms\"\n },\n {\n \"at\": \"1789227338267176\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227338267190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267205\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338267220\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267235\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227338267249\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267267\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338267297\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338267310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267325\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227338267340\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267418\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler177)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338267434\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler177)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338267449\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227338267463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338267477\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x17dbdf73 your_disc:0x0\"\n },\n {\n \"at\": \"1789227338267494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338267508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338267529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338267544\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267587\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267616\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267652\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267669\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338267682\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338267710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267739\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338267752\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338267766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338267779\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338267796\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338267809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338267824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267839\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338267854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338267868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338267881\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338267896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267910\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338267930\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338267951\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267964\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720131ms\"\n },\n {\n \"at\": \"1789227338267979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338267993\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338268009\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338268024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227338268039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268055\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338268083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227338268097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338268111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227338268126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338268153\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338272791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00180|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338272808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338272825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338272835\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338272845\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338272856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227338272865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590720136ms\"\n },\n {\n \"at\": \"1789227338272902\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338272917\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227338272927\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338272937\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338272948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338272957\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338272966\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338272977\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227338272987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338272997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227338273006\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338273016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338273026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227338370906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler177)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227338371008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler177)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227338371024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227338371042\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227338371054\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xea4aba81 your_disc:0x21aad08\"\n },\n {\n \"at\": \"1789227338371065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338371075\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227338371086\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227338371095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338371117\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590720234ms\"\n },\n {\n \"at\": \"1789227338371156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227338371169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227338371181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338371192\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338371211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338371241\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338371272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338371285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338371312\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227338371322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler177)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227338371353\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227338371366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227338371379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227338371393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227338371426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227338371438\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227338371453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227338371466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227338371478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227338371492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x21aad08\"\n },\n {\n \"at\": \"1789227338371519\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371529\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227338371549\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227338371559\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227338371569\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xea4aba81\"\n },\n {\n \"at\": \"1789227338371579\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227338371598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339068251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339068452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339068480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339068498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339068516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339068535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339068554\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339068572\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +923ms\"\n },\n {\n \"at\": \"1789227339068590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227339068609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339068627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339068656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339068680\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7639c892\"\n },\n {\n \"at\": \"1789227339068700\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339068775\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339068799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339068821\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6b88a426\"\n },\n {\n \"at\": \"1789227339068840\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339068857\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339068874\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339217357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227339217635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227339217651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227339217662\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227339217672\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339217683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227339217693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227339217704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +706ms\"\n },\n {\n \"at\": \"1789227339217723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227339217735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227339217746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227339217761\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339217771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x51248bf2\"\n },\n {\n \"at\": \"1789227339217781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217792\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227339217822\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227339217837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227339217850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x17dbdf73\"\n },\n {\n \"at\": \"1789227339217864\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227339217878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227339217892\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227348077289\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00181|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (843 adds, 83 deletes, 2 modifications)\"\n },\n {\n \"at\": \"1789227365528885\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789227365650844\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00182|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227365651290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227365651306\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227365677867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00185|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:36:07.843879+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T15:36:07.844857+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/create.stdout.json new file mode 100644 index 0000000..7a2b050 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.576, + "first_cross_member_ping_seconds": 3.515, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/cycle.json new file mode 100644 index 0000000..2089985 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T15:35:34.752899+00:00", + "ended_at": "2026-09-12T15:36:07.845020+00:00", + "seconds": 33.092, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:33:3f:c7", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.576, + "first_cross_member_ping_seconds": 3.515, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.097 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.099 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"0fd6b534-eba0-4a59-9391-31704e260f77\",\"volatile.eth0.host_name\":\"veth011e07a6\",\"volatile.eth0.hwaddr\":\"10:66:6a:e8:83:f2\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\"volatile.uuid.generation\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:35:39.136713458Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"0fd6b534-eba0-4a59-9391-31704e260f77\",\"volatile.eth0.host_name\":\"veth011e07a6\",\"volatile.eth0.hwaddr\":\"10:66:6a:e8:83:f2\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\"volatile.uuid.generation\":\"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:35:39.926951525Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":10297344,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fee8:83f2\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:e8:83:f2\",\"host_name\":\"veth011e07a6\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4174468,\"processes\":4,\"cpu\":{\"usage\":483192000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:35:38.950000047Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"65f87cd9-1fae-47b2-9688-7c3105f43066\",\"volatile.eth0.host_name\":\"vethe019766a\",\"volatile.eth0.hwaddr\":\"10:66:6a:5c:44:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\"volatile.uuid.generation\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:35:40.219671782Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"65f87cd9-1fae-47b2-9688-7c3105f43066\",\"volatile.eth0.host_name\":\"vethe019766a\",\"volatile.eth0.hwaddr\":\"10:66:6a:5c:44:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\"volatile.uuid.generation\":\"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:35:40.788133121Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11206656,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe5c:4471\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:5c:44:71\",\"host_name\":\"vethe019766a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":33163,\"processes\":4,\"cpu\":{\"usage\":499911000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:35:40.809999942Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.113 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.193 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.274 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.259 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.722 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.290 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.290/0.757/1.259 ms\nelapsed_seconds=2.221 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.217 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.666 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.383 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.383/0.755/1.217 ms\nelapsed_seconds=2.234 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.135 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.756 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.907 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.907/1.599/2.135 ms\nelapsed_seconds=2.455 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.161 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.598 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.953 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.953/1.570/2.161 ms\nelapsed_seconds=2.255 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nelapsed_seconds=0.709 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.221 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.316 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.315 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.028 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.115007 bytes_per_second=869512290\nelapsed_seconds=0.496 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.522 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.135790 bytes_per_second=736431254\nelapsed_seconds=0.384 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.521 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 73028, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.log", + "bytes": 175874, + "ready_signal": "time=\"2026-09-12T08:35:35-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:35:35.628140+00:00", + "stopped_at": "2026-09-12T15:35:44.898063+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 74192, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T15:35:46.280492+00:00", + "stopped_at": "2026-09-12T15:36:00.621535+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 75262, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.log", + "bytes": 40454, + "ready_signal": "time=\"2026-09-12T08:36:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:36:02.460153+00:00", + "stopped_at": "2026-09-12T15:36:06.488649+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-probe.txt new file mode 100644 index 0000000..0d7da93 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-probe.txt @@ -0,0 +1,5691 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:e8:83:f2 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:5c:44:71 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 610cb309-8282-4d8d-a2b7-e085bfbf4cad (incus-net32-ls-ext) + port incus-net32-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net32-ls-ext-lsp-router + type: router + router-port: incus-net32-lr-lrp-ext +switch aca93faa-aea8-4729-b88c-82ed44ef3937 (incus-net32-ls-int) + port incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0 + addresses: ["10:66:6a:e8:83:f2 dynamic"] + port incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0 + addresses: ["10:66:6a:5c:44:71 dynamic"] + port incus-net32-ls-int-lsp-router + type: router + router-port: incus-net32-lr-lrp-int +router bac0e241-5743-49b5-84b1-a9cedca557e4 (incus-net32-lr) + port incus-net32-lr-lrp-ext + mac: "10:66:6a:33:3f:c7" + ipv6-lla: "fe80::1266:6aff:fe33:3fc7" + networks: ["10.10.40.64/24"] + port incus-net32-lr-lrp-int + mac: "10:66:6a:33:3f:c7" + ipv6-lla: "fe80::1266:6aff:fe33:3fc7" + networks: ["10.253.73.1/24"] + nat 86281e38-e6d1-49b0-9312-550270ea278b + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net32-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 8e4ad01e-8d0e-459d-8227-88bd4cdfb753 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 7f660565-1f66-46ba-98cd-0050dba7ddb3 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:33:3f:c7" +name : incus-net32-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} + +_uuid : e3c18ecb-9ce8-4744-979d-f5e9515a371c +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:33:3f:c7" +name : incus-net32-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 531558c5-4afd-433c-bd5d-2ac485276100 +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : 63db9462-5bdb-4b90-8046-0259671d83f1 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 0b893e82-7020-4a69-a5ba-c106fd207e69 +logical_port : cr-incus-net32-lr-lrp-ext +mac : ["10:66:6a:33:3f:c7 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net32-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:33:3f:c7 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:33:3f:c7 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338272799", + "member": "lab01.glab.lol", + "message": "ovs|84031|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338273036", + "member": "lab01.glab.lol", + "message": "ovs|84032|bridge|INFO|bridge incusovn16: using datapath ID 00007a092e54774b" + }, + { + "at": "1789227338273071", + "member": "lab01.glab.lol", + "message": "ovs|84033|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338276027", + "member": "lab01.glab.lol", + "message": "ovs|84034|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338276110", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338276145", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338276171", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338276193", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338276223", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338276250", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338276288", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338276316", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338276344", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338276376", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338276405", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276433", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338276460", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338276493", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338276524", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338276546", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338276579", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276613", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338276641", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338276673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338276693", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338276721", + "member": "lab01.glab.lol", + "message": "ovs|84035|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338276747", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338276773", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338276791", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338276811", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338276827", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338276846", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338276867", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338276885", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338276909", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338276927", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338276946", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338276970", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276988", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338277010", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338277031", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277055", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338277081", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338277097", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277118", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338277139", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338277161", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277187", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338277209", + "member": "lab01.glab.lol", + "message": "ovs|84036|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338277233", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338277251", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338277273", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338277289", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338277306", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338277332", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338277351", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338277374", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338277394", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338277417", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338277434", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277459", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338277492", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338277509", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277535", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338277561", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338277579", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277594", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338277619", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338277637", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277664", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338368846", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler187)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338368952", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler187)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227338369004", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338369041", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338369093", + "member": "lab01.glab.lol", + "message": " my_disc:0x21aad08 your_disc:0x0" + }, + { + "at": "1789227338369124", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338369164", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338369202", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338369253", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338369290", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338369328", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338369357", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338369391", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616369ms" + }, + { + "at": "1789227338369431", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616369ms" + }, + { + "at": "1789227338369469", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616369ms" + }, + { + "at": "1789227338369528", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338369555", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338369593", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338369630", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338369668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338369701", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338369731", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338369767", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338369804", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338369828", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227338369862", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338369889", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338369932", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338369961", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338369991", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338370021", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338370054", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338370080", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338370106", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338370131", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338370178", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616369ms" + }, + { + "at": "1789227338370465", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616369ms" + }, + { + "at": "1789227338370678", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338370707", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338370745", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338370774", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338370807", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338370837", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338370873", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338370904", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338370932", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338370956", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227338370987", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371024", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371054", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338371079", + "member": "lab01.glab.lol", + "message": "ovs|84037|dpif|WARN|Dropped 386 log messages in last 239 seconds (most recently, 239 seconds ago) due to excessive rate" + }, + { + "at": "1789227338371118", + "member": "lab01.glab.lol", + "message": "ovs|84038|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371163", + "member": "lab01.glab.lol", + "message": "ovs|84039|bridge|WARN|Dropped 11150 log messages in last 244 seconds (most recently, 239 seconds ago) due to excessive rate" + }, + { + "at": "1789227338371214", + "member": "lab01.glab.lol", + "message": "ovs|84040|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371261", + "member": "lab01.glab.lol", + "message": "ovs|84041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371297", + "member": "lab01.glab.lol", + "message": "ovs|84042|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371340", + "member": "lab01.glab.lol", + "message": "ovs|84043|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371389", + "member": "lab01.glab.lol", + "message": "ovs|84044|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371968", + "member": "lab01.glab.lol", + "message": "ovs|84045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338372086", + "member": "lab01.glab.lol", + "message": "ovs|84046|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338372633", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler187)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338372742", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler187)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338372781", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338372819", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338372849", + "member": "lab01.glab.lol", + "message": " my_disc:0x9ccef038 your_disc:0x0" + }, + { + "at": "1789227338372889", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338372916", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338372953", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338372977", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338373005", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338373043", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338373067", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338373095", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616373ms" + }, + { + "at": "1789227338373131", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +863ms" + }, + { + "at": "1789227338373179", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789227338373203", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338373281", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338373310", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373341", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338373369", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338373396", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338373420", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338373448", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338373474", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373514", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227338373549", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338373581", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338373607", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338373634", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338373672", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338373695", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338373735", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338373770", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338373800", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338373826", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338373852", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +863ms" + }, + { + "at": "1789227338373878", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789227338373909", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338373932", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338373961", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373995", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338374020", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374052", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374080", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338374102", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338374127", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338374156", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227338374191", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374223", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374259", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338374286", + "member": "lab01.glab.lol", + "message": "ovs|84047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338374318", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler187)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338374350", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler187)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227338374381", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338374410", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338374437", + "member": "lab01.glab.lol", + "message": " my_disc:0xf807dd2c your_disc:0x0" + }, + { + "at": "1789227338374470", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338374509", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338374540", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338374568", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338374600", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338374630", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338374662", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338374688", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616373ms" + }, + { + "at": "1789227338374724", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616373ms" + }, + { + "at": "1789227338374758", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616373ms" + }, + { + "at": "1789227338374785", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338374811", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338374837", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338374864", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338374896", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374922", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374951", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338374984", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338375008", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375033", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338375068", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338375094", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375120", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338375142", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338375174", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338375209", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338375247", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338375269", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338375292", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338375323", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338375359", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616373ms" + }, + { + "at": "1789227338375390", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616373ms" + }, + { + "at": "1789227338375416", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338375442", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338375470", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375503", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338375535", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338375563", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375590", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338375615", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338375648", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375671", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338375701", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338375727", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375752", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338376402", + "member": "lab01.glab.lol", + "message": "ovs|84048|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227338376500", + "member": "lab01.glab.lol", + "message": "ovs|84049|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227339198829", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339198979", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339199014", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339199032", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339199044", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339199058", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339199071", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339199079", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +68ms" + }, + { + "at": "1789227339199087", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -822ms" + }, + { + "at": "1789227339199107", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339199126", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339199138", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339199153", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227339199170", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339199178", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339199192", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339199209", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339199218", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339199225", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227339199247", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339199258", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339199276", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339368900", + "member": "lab01.glab.lol", + "message": "ovs|84050|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227339369086", + "member": "lab01.glab.lol", + "message": "ovs|84051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227339372637", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339372734", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339372773", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339372803", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339372836", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339372868", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339372887", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339372916", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +654ms" + }, + { + "at": "1789227339372945", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -136ms" + }, + { + "at": "1789227339372976", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339372998", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339373023", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373047", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339373072", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339373094", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339373113", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339373138", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339373159", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373191", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227339373214", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339373238", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339373452", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339373865", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339373881", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339373894", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339373901", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339373912", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339373920", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339373934", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339373944", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +733ms" + }, + { + "at": "1789227339373952", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -37ms" + }, + { + "at": "1789227339373962", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339373975", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339373984", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373995", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227339374004", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339374011", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339374023", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339374036", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339374047", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339374057", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227339374065", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339374074", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339374081", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339688142", + "member": "lab01.glab.lol", + "message": "ovs|84052|bridge|INFO|bridge br-int: added interface veth011e07a6 on port 28" + }, + { + "at": "1789227340368741", + "member": "lab01.glab.lol", + "message": "ovs|84053|dpif|WARN|Dropped 1982 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227340368832", + "member": "lab01.glab.lol", + "message": "ovs|84054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227340732722", + "member": "lab01.glab.lol", + "message": "ovs|84055|poll_loop|INFO|Dropped 4609 log messages in last 243 seconds (most recently, 238 seconds ago) due to excessive rate" + }, + { + "at": "1789227340732925", + "member": "lab01.glab.lol", + "message": "ovs|84056|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340733054", + "member": "lab01.glab.lol", + "message": "ovs|84057|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340733549", + "member": "lab01.glab.lol", + "message": "ovs|84058|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340734039", + "member": "lab01.glab.lol", + "message": "ovs|84059|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340734543", + "member": "lab01.glab.lol", + "message": "ovs|84060|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340735033", + "member": "lab01.glab.lol", + "message": "ovs|84061|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340735538", + "member": "lab01.glab.lol", + "message": "ovs|84062|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340736041", + "member": "lab01.glab.lol", + "message": "ovs|84063|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340736549", + "member": "lab01.glab.lol", + "message": "ovs|84064|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340737054", + "member": "lab01.glab.lol", + "message": "ovs|84065|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227341368665", + "member": "lab01.glab.lol", + "message": "ovs|84066|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227341368762", + "member": "lab01.glab.lol", + "message": "ovs|84067|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227342368897", + "member": "lab01.glab.lol", + "message": "ovs|84068|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227342369123", + "member": "lab01.glab.lol", + "message": "ovs|84069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227343368955", + "member": "lab01.glab.lol", + "message": "ovs|84070|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227343369140", + "member": "lab01.glab.lol", + "message": "ovs|84071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227344368688", + "member": "lab01.glab.lol", + "message": "ovs|84072|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227344368794", + "member": "lab01.glab.lol", + "message": "ovs|84073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227345368707", + "member": "lab01.glab.lol", + "message": "ovs|84074|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227345368936", + "member": "lab01.glab.lol", + "message": "ovs|84075|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227346368688", + "member": "lab01.glab.lol", + "message": "ovs|84076|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227346368788", + "member": "lab01.glab.lol", + "message": "ovs|84077|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227346733034", + "member": "lab01.glab.lol", + "message": "ovs|84078|poll_loop|INFO|Dropped 12304 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227346733150", + "member": "lab01.glab.lol", + "message": "ovs|84079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227347368658", + "member": "lab01.glab.lol", + "message": "ovs|84080|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227347368761", + "member": "lab01.glab.lol", + "message": "ovs|84081|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227348278776", + "member": "lab01.glab.lol", + "message": "ovs|84082|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 6 s starting 10 s ago (852 adds, 78 deletes, 7 modifications)" + }, + { + "at": "1789227348368863", + "member": "lab01.glab.lol", + "message": "ovs|84083|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227348368920", + "member": "lab01.glab.lol", + "message": "ovs|84084|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227349368823", + "member": "lab01.glab.lol", + "message": "ovs|84085|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227349369055", + "member": "lab01.glab.lol", + "message": "ovs|84086|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227350369001", + "member": "lab01.glab.lol", + "message": "ovs|84087|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227350369235", + "member": "lab01.glab.lol", + "message": "ovs|84088|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227351368916", + "member": "lab01.glab.lol", + "message": "ovs|84089|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227351369028", + "member": "lab01.glab.lol", + "message": "ovs|84090|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227352368871", + "member": "lab01.glab.lol", + "message": "ovs|84091|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227352368986", + "member": "lab01.glab.lol", + "message": "ovs|84092|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227352732881", + "member": "lab01.glab.lol", + "message": "ovs|84093|poll_loop|INFO|Dropped 12343 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227352733055", + "member": "lab01.glab.lol", + "message": "ovs|84094|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227353368970", + "member": "lab01.glab.lol", + "message": "ovs|84095|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227353369062", + "member": "lab01.glab.lol", + "message": "ovs|84096|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227354368720", + "member": "lab01.glab.lol", + "message": "ovs|84097|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227354368908", + "member": "lab01.glab.lol", + "message": "ovs|84098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227355368756", + "member": "lab01.glab.lol", + "message": "ovs|84099|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227355368964", + "member": "lab01.glab.lol", + "message": "ovs|84100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227356368976", + "member": "lab01.glab.lol", + "message": "ovs|84101|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227356369203", + "member": "lab01.glab.lol", + "message": "ovs|84102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227357368759", + "member": "lab01.glab.lol", + "message": "ovs|84103|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227357368864", + "member": "lab01.glab.lol", + "message": "ovs|84104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227358368618", + "member": "lab01.glab.lol", + "message": "ovs|84105|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227358368907", + "member": "lab01.glab.lol", + "message": "ovs|84106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227358732639", + "member": "lab01.glab.lol", + "message": "ovs|84107|poll_loop|INFO|Dropped 12377 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227358732758", + "member": "lab01.glab.lol", + "message": "ovs|84108|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227359368747", + "member": "lab01.glab.lol", + "message": "ovs|84109|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227359368936", + "member": "lab01.glab.lol", + "message": "ovs|84110|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227360368665", + "member": "lab01.glab.lol", + "message": "ovs|84111|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227360368777", + "member": "lab01.glab.lol", + "message": "ovs|84112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227361368663", + "member": "lab01.glab.lol", + "message": "ovs|84113|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227361368747", + "member": "lab01.glab.lol", + "message": "ovs|84114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338260096", + "member": "lab02.glab.lol", + "message": "ovs|00167|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338260250", + "member": "lab02.glab.lol", + "message": "ovs|00168|bridge|INFO|bridge incusovn16: using datapath ID 000042b3b8d8b845" + }, + { + "at": "1789227338260271", + "member": "lab02.glab.lol", + "message": "ovs|00169|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338260288", + "member": "lab02.glab.lol", + "message": "ovs|00170|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338260305", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338260322", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338260337", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338260351", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338260366", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338260381", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593259ms" + }, + { + "at": "1789227338260400", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593259ms" + }, + { + "at": "1789227338260415", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593259ms" + }, + { + "at": "1789227338260431", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338260448", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338260463", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338260478", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227338260496", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338260510", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338260524", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338260540", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338260555", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338260568", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338260581", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338260597", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338260612", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338260626", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338269943", + "member": "lab02.glab.lol", + "message": "ovs|00171|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338269984", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338269996", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338270007", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338270020", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338270030", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338270045", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593269ms" + }, + { + "at": "1789227338270057", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593269ms" + }, + { + "at": "1789227338270068", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593269ms" + }, + { + "at": "1789227338270080", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338270091", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338270102", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270113", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338270125", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338270134", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270144", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338270154", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338270163", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270174", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338270184", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338270194", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270203", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338270214", + "member": "lab02.glab.lol", + "message": "ovs|00172|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338270225", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338270235", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338270247", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338270256", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338270266", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338270277", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593269ms" + }, + { + "at": "1789227338270287", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593269ms" + }, + { + "at": "1789227338270297", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593269ms" + }, + { + "at": "1789227338270307", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338270318", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338270327", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270338", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227338270348", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338270358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270368", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338270378", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338270388", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270403", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338270414", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338270424", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270435", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338355186", + "member": "lab02.glab.lol", + "message": "ovs|00173|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338355590", + "member": "lab02.glab.lol", + "message": "ovs|00174|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227338358605", + "member": "lab02.glab.lol", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338358647", + "member": "lab02.glab.lol", + "message": "ovs|00176|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789227339056207", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler169)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339056350", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler169)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227339056384", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339056428", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339056452", + "member": "lab02.glab.lol", + "message": " my_disc:0x7639c892 your_disc:0x6b88a426" + }, + { + "at": "1789227339056481", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339056507", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339056530", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339056551", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339056573", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339056596", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339056617", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339056648", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594055ms" + }, + { + "at": "1789227339056670", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -16ms" + }, + { + "at": "1789227339056699", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -796ms" + }, + { + "at": "1789227339056723", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339056744", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339056768", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339056791", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227339056813", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339056836", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339056861", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339056883", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339056916", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339056944", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7639c892" + }, + { + "at": "1789227339056967", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339056989", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057012", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339057032", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler169)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339057054", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339057076", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339057152", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339057174", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339057194", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339057215", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339057240", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -16ms" + }, + { + "at": "1789227339057261", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -796ms" + }, + { + "at": "1789227339057288", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339057309", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339057328", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339057348", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227339057370", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339057390", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057419", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339057440", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339057461", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339057484", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7639c892" + }, + { + "at": "1789227339057510", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339057534", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057555", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339224346", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler169)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339224434", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler169)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227339224470", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339224495", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339224515", + "member": "lab02.glab.lol", + "message": " my_disc:0x349dc1e2 your_disc:0x9ccef038" + }, + { + "at": "1789227339224541", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339224564", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339224595", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339224619", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339224640", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339224663", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339224688", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339224715", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594223ms" + }, + { + "at": "1789227339224750", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +47ms" + }, + { + "at": "1789227339224773", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -863ms" + }, + { + "at": "1789227339224796", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339224818", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339224837", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339224857", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227339224879", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339224900", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339224921", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339224942", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339224963", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339224983", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339225008", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339225029", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225050", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339225071", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler169)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339225095", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339225117", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339225138", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339225156", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339225175", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339225195", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339225216", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +47ms" + }, + { + "at": "1789227339225237", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -863ms" + }, + { + "at": "1789227339225259", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339225278", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339225299", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339225319", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227339225343", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339225362", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225382", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339225408", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339225429", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339225450", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339225471", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339225491", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225509", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339251697", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler169)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339251752", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler169)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227339251771", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339251786", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339251800", + "member": "lab02.glab.lol", + "message": " my_disc:0xdd2303b9 your_disc:0xccffcd9e" + }, + { + "at": "1789227339251814", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339251829", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339251844", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339251859", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339251872", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339251887", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339251903", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339251918", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594251ms" + }, + { + "at": "1789227339251935", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +839ms" + }, + { + "at": "1789227339251953", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -71ms" + }, + { + "at": "1789227339251968", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339251982", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339251995", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252009", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227339252024", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252038", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252050", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339252064", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339252078", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252091", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdd2303b9" + }, + { + "at": "1789227339252106", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339252121", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252135", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339252154", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler169)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339252170", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339252184", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339252197", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339252211", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339252226", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339252240", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339252254", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +839ms" + }, + { + "at": "1789227339252267", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -71ms" + }, + { + "at": "1789227339252279", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339252291", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339252303", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252316", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227339252329", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252342", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252354", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339252368", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339252381", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252400", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdd2303b9" + }, + { + "at": "1789227339252416", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252430", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252444", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227348263315", + "member": "lab02.glab.lol", + "message": "ovs|00177|connmgr|INFO|br-int<->unix#7: 905 flow_mods in the 6 s starting 10 s ago (838 adds, 59 deletes, 8 modifications)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338260510", + "member": "lab03.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338260920", + "member": "lab03.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00008a575f87ca4a" + }, + { + "at": "1789227338260946", + "member": "lab03.glab.lol", + "message": "ovs|00185|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338263324", + "member": "lab03.glab.lol", + "message": "ovs|00186|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338263393", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338263420", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338263444", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338263465", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338263482", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338263503", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493261ms" + }, + { + "at": "1789227338263521", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493261ms" + }, + { + "at": "1789227338263541", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493261ms" + }, + { + "at": "1789227338263559", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338263576", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338263593", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263611", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338263636", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338263652", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338263670", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338263686", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338263700", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263715", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338263732", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338263754", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338263771", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338263788", + "member": "lab03.glab.lol", + "message": "ovs|00187|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338263804", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338263821", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338263837", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338263855", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338263872", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338263888", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493261ms" + }, + { + "at": "1789227338263908", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493261ms" + }, + { + "at": "1789227338263924", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493261ms" + }, + { + "at": "1789227338263944", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338263960", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338263976", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263996", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338264014", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338264030", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338264046", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338264065", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338264082", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338264098", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338264116", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338264132", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338264147", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338264165", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338271321", + "member": "lab03.glab.lol", + "message": "ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338271361", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338271377", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338271389", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338271402", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338271413", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338271423", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493269ms" + }, + { + "at": "1789227338271435", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493269ms" + }, + { + "at": "1789227338271450", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493269ms" + }, + { + "at": "1789227338271469", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338271480", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338271491", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338271501", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338271513", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338271524", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338271535", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338271546", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338271557", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338271567", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338271578", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338271589", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338271600", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338358711", + "member": "lab03.glab.lol", + "message": "ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338358762", + "member": "lab03.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227338359240", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler163)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338359333", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler163)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227338359371", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338359687", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338359754", + "member": "lab03.glab.lol", + "message": " my_disc:0x51248bf2 your_disc:0x17dbdf73" + }, + { + "at": "1789227338359785", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338359813", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338359837", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338359861", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338359884", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338359910", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338359936", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338359963", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493357ms" + }, + { + "at": "1789227338359988", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +854ms" + }, + { + "at": "1789227338360015", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227338360040", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338360072", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338360111", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360136", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338360161", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360184", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360208", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338360233", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338360259", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360284", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x51248bf2" + }, + { + "at": "1789227338360315", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338360338", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360364", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338360389", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler163)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338360417", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338360441", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338360462", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338360485", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338360509", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338360532", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338360558", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +854ms" + }, + { + "at": "1789227338360582", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227338360605", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338360628", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338360652", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360673", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338360696", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360722", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360746", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338360771", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338360794", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360818", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x51248bf2" + }, + { + "at": "1789227338360841", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360869", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360895", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338362911", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler163)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338362994", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler163)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338363029", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338363067", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338363091", + "member": "lab03.glab.lol", + "message": " my_disc:0xccffcd9e your_disc:0x0" + }, + { + "at": "1789227338363119", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338363143", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338363165", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338363189", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338363210", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338363233", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338363256", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338363287", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493360ms" + }, + { + "at": "1789227338363312", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227338363338", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227338363368", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338363391", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338363415", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363439", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338363470", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338363492", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338363516", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338363540", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338363569", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363591", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338363618", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338363642", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338363664", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338363692", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338363717", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338363743", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338363766", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338363789", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338363815", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338363839", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338363865", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227338363887", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227338363913", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338363936", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338363961", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363986", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338364014", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338364036", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338364066", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338364090", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338364114", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338364138", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338364162", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338364186", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338364209", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338366697", + "member": "lab03.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338366781", + "member": "lab03.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789227338367563", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler163)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338367637", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler163)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227338367670", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338367699", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338367718", + "member": "lab03.glab.lol", + "message": " my_disc:0x189931f2 your_disc:0xf807dd2c" + }, + { + "at": "1789227338367742", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338367768", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338367787", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338367805", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338367820", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338367843", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338367860", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338367875", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493365ms" + }, + { + "at": "1789227338367896", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +996ms" + }, + { + "at": "1789227338367914", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227338367934", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338367952", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338367969", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338367987", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338368005", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368021", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368038", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338368053", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338368072", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368098", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x189931f2" + }, + { + "at": "1789227338368122", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338368139", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368154", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338368174", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler163)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338368193", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338368208", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338368224", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338368241", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338368258", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338368274", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338368289", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +996ms" + }, + { + "at": "1789227338368306", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227338368321", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338368342", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338368359", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368378", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338368394", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368411", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368428", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338368444", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338368461", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368477", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x189931f2" + }, + { + "at": "1789227338368494", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368509", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368526", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227340094406", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227340094719", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227340094747", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227340094764", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227340094782", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227340094808", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227340094827", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227340094853", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +870ms" + }, + { + "at": "1789227340094872", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -60ms" + }, + { + "at": "1789227340094894", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227340094911", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227340094932", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227340094951", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227340094969", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227340094988", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227340095006", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227340095022", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227340095040", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227340095058", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227340095086", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227340095106", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227340095127", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227340702548", + "member": "lab03.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge br-int: added interface vethe019766a on port 26" + }, + { + "at": "1789227348265904", + "member": "lab03.glab.lol", + "message": "ovs|00194|connmgr|INFO|br-int<->unix#7: 936 flow_mods in the 6 s starting 10 s ago (850 adds, 78 deletes, 8 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338072228", + "member": "nas01.glab.lol", + "message": "ovs|00171|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338072375", + "member": "nas01.glab.lol", + "message": "ovs|00172|bridge|INFO|bridge incusovn16: using datapath ID 000006169a233441" + }, + { + "at": "1789227338072390", + "member": "nas01.glab.lol", + "message": "ovs|00173|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338170866", + "member": "nas01.glab.lol", + "message": "ovs|00174|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338171095", + "member": "nas01.glab.lol", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227338176363", + "member": "nas01.glab.lol", + "message": "ovs|00176|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338176419", + "member": "nas01.glab.lol", + "message": "ovs|00177|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227338261355", + "member": "nas01.glab.lol", + "message": "ovs|00178|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338261407", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338261432", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338261452", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338261466", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338261481", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338261499", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720125ms" + }, + { + "at": "1789227338261516", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720125ms" + }, + { + "at": "1789227338261531", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720125ms" + }, + { + "at": "1789227338261547", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338261564", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338261580", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338261595", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338261612", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338261628", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338261643", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338261660", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338261678", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338261694", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338261709", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338261727", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338261741", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338261756", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338265444", + "member": "nas01.glab.lol", + "message": "ovs|00179|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338265481", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338265498", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338265513", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338265529", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338265545", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338265560", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720129ms" + }, + { + "at": "1789227338265577", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720129ms" + }, + { + "at": "1789227338265594", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720129ms" + }, + { + "at": "1789227338265610", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338265625", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338265640", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338265654", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338265671", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338265686", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338265709", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338265723", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338265738", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338265753", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338265769", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338265791", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338265807", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338266407", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler177)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338266556", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler177)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338266579", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338266607", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338266624", + "member": "nas01.glab.lol", + "message": " my_disc:0x6b88a426 your_disc:0x0" + }, + { + "at": "1789227338266642", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338266663", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338266681", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338266697", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338266713", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338266728", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338266743", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338266760", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720130ms" + }, + { + "at": "1789227338266775", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +795ms" + }, + { + "at": "1789227338266803", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227338266820", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338266836", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338266851", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338266866", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338266880", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338266895", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338266920", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338266938", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338266959", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338266975", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227338266994", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338267015", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267032", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267048", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338267065", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338267082", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267097", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267114", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267128", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267143", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338267162", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +795ms" + }, + { + "at": "1789227338267176", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227338267190", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267205", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338267220", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267235", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338267249", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267267", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267282", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338267297", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338267310", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267325", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227338267340", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267358", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267374", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267418", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler177)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338267434", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler177)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227338267449", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338267463", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338267477", + "member": "nas01.glab.lol", + "message": " my_disc:0x17dbdf73 your_disc:0x0" + }, + { + "at": "1789227338267494", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338267508", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338267529", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338267544", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267558", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267572", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267587", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267600", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720131ms" + }, + { + "at": "1789227338267616", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720131ms" + }, + { + "at": "1789227338267631", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720131ms" + }, + { + "at": "1789227338267652", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267669", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338267682", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267696", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338267710", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267724", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267739", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338267752", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338267766", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267779", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338267796", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338267809", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267824", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267839", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338267854", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338267868", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267881", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267896", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267910", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267930", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338267951", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720131ms" + }, + { + "at": "1789227338267964", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720131ms" + }, + { + "at": "1789227338267979", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267993", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338268009", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338268024", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338268039", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338268055", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338268068", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338268083", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338268097", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338268111", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338268126", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338268139", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338268153", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338272791", + "member": "nas01.glab.lol", + "message": "ovs|00180|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338272808", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338272825", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338272835", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338272845", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338272856", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338272865", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720136ms" + }, + { + "at": "1789227338272876", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720136ms" + }, + { + "at": "1789227338272891", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720136ms" + }, + { + "at": "1789227338272902", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338272917", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338272927", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338272937", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338272948", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338272957", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338272966", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338272977", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338272987", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338272997", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338273006", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338273016", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338273026", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338370906", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler177)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338371008", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler177)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227338371024", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338371042", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338371054", + "member": "nas01.glab.lol", + "message": " my_disc:0xea4aba81 your_disc:0x21aad08" + }, + { + "at": "1789227338371065", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338371075", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338371086", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338371095", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338371106", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338371117", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338371126", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338371141", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720234ms" + }, + { + "at": "1789227338371156", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227338371169", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227338371181", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338371192", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338371211", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371228", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338371241", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371251", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371261", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338371272", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338371285", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371295", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xea4aba81" + }, + { + "at": "1789227338371312", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338371322", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371333", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338371342", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler177)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338371353", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338371366", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338371379", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338371393", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338371406", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338371426", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338371438", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227338371453", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227338371466", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338371478", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338371492", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371506", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338371519", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371529", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371539", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338371549", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338371559", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371569", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xea4aba81" + }, + { + "at": "1789227338371579", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371588", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371598", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339068251", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339068452", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339068480", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339068498", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339068516", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339068535", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339068554", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339068572", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +923ms" + }, + { + "at": "1789227339068590", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227339068609", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339068627", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339068656", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339068680", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227339068700", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339068724", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339068749", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339068775", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339068799", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339068821", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227339068840", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339068857", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339068874", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339217357", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339217635", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339217651", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339217662", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339217672", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339217683", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339217693", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339217704", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +706ms" + }, + { + "at": "1789227339217723", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227339217735", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339217746", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339217761", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339217771", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227339217781", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339217792", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339217809", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339217822", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339217837", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339217850", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227339217864", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339217878", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339217892", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227348077289", + "member": "nas01.glab.lol", + "message": "ovs|00181|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (843 adds, 83 deletes, 2 modifications)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-teardown.txt new file mode 100644 index 0000000..15c48be --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-after-teardown.txt @@ -0,0 +1,5730 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:33:3f:c7 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:33:3f:c7 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338272799", + "member": "lab01.glab.lol", + "message": "ovs|84031|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338273036", + "member": "lab01.glab.lol", + "message": "ovs|84032|bridge|INFO|bridge incusovn16: using datapath ID 00007a092e54774b" + }, + { + "at": "1789227338273071", + "member": "lab01.glab.lol", + "message": "ovs|84033|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338276027", + "member": "lab01.glab.lol", + "message": "ovs|84034|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338276110", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338276145", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338276171", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338276193", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338276223", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338276250", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338276288", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338276316", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338276344", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338276376", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338276405", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276433", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338276460", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338276493", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338276524", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338276546", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338276579", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276613", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338276641", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338276673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338276693", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338276721", + "member": "lab01.glab.lol", + "message": "ovs|84035|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338276747", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338276773", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338276791", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338276811", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338276827", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338276846", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338276867", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338276885", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338276909", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338276927", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338276946", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338276970", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276988", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338277010", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338277031", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277055", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338277081", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338277097", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277118", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338277139", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338277161", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277187", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338277209", + "member": "lab01.glab.lol", + "message": "ovs|84036|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338277233", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338277251", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338277273", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338277289", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338277306", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338277332", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338277351", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338277374", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338277394", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338277417", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338277434", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277459", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338277492", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338277509", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277535", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338277561", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338277579", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277594", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338277619", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338277637", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277664", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338368846", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler187)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338368952", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler187)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227338369004", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338369041", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338369093", + "member": "lab01.glab.lol", + "message": " my_disc:0x21aad08 your_disc:0x0" + }, + { + "at": "1789227338369124", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338369164", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338369202", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338369253", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338369290", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338369328", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338369357", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338369391", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616369ms" + }, + { + "at": "1789227338369431", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616369ms" + }, + { + "at": "1789227338369469", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616369ms" + }, + { + "at": "1789227338369528", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338369555", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338369593", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338369630", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338369668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338369701", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338369731", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338369767", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338369804", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338369828", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227338369862", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338369889", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338369932", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338369961", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338369991", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338370021", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338370054", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338370080", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338370106", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338370131", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338370178", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616369ms" + }, + { + "at": "1789227338370465", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616369ms" + }, + { + "at": "1789227338370678", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338370707", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338370745", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338370774", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338370807", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338370837", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338370873", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338370904", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338370932", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338370956", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227338370987", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371024", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371054", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338371079", + "member": "lab01.glab.lol", + "message": "ovs|84037|dpif|WARN|Dropped 386 log messages in last 239 seconds (most recently, 239 seconds ago) due to excessive rate" + }, + { + "at": "1789227338371118", + "member": "lab01.glab.lol", + "message": "ovs|84038|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371163", + "member": "lab01.glab.lol", + "message": "ovs|84039|bridge|WARN|Dropped 11150 log messages in last 244 seconds (most recently, 239 seconds ago) due to excessive rate" + }, + { + "at": "1789227338371214", + "member": "lab01.glab.lol", + "message": "ovs|84040|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371261", + "member": "lab01.glab.lol", + "message": "ovs|84041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371297", + "member": "lab01.glab.lol", + "message": "ovs|84042|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371340", + "member": "lab01.glab.lol", + "message": "ovs|84043|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371389", + "member": "lab01.glab.lol", + "message": "ovs|84044|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371968", + "member": "lab01.glab.lol", + "message": "ovs|84045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338372086", + "member": "lab01.glab.lol", + "message": "ovs|84046|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338372633", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler187)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338372742", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler187)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338372781", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338372819", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338372849", + "member": "lab01.glab.lol", + "message": " my_disc:0x9ccef038 your_disc:0x0" + }, + { + "at": "1789227338372889", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338372916", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338372953", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338372977", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338373005", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338373043", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338373067", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338373095", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616373ms" + }, + { + "at": "1789227338373131", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +863ms" + }, + { + "at": "1789227338373179", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789227338373203", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338373281", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338373310", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373341", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338373369", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338373396", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338373420", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338373448", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338373474", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373514", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227338373549", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338373581", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338373607", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338373634", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338373672", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338373695", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338373735", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338373770", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338373800", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338373826", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338373852", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +863ms" + }, + { + "at": "1789227338373878", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789227338373909", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338373932", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338373961", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373995", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338374020", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374052", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374080", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338374102", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338374127", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338374156", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227338374191", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374223", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374259", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338374286", + "member": "lab01.glab.lol", + "message": "ovs|84047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338374318", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler187)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338374350", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler187)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227338374381", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338374410", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338374437", + "member": "lab01.glab.lol", + "message": " my_disc:0xf807dd2c your_disc:0x0" + }, + { + "at": "1789227338374470", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338374509", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338374540", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338374568", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338374600", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338374630", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338374662", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338374688", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616373ms" + }, + { + "at": "1789227338374724", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616373ms" + }, + { + "at": "1789227338374758", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616373ms" + }, + { + "at": "1789227338374785", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338374811", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338374837", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338374864", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338374896", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374922", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374951", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338374984", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338375008", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375033", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338375068", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338375094", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375120", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338375142", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338375174", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338375209", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338375247", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338375269", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338375292", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338375323", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338375359", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616373ms" + }, + { + "at": "1789227338375390", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616373ms" + }, + { + "at": "1789227338375416", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338375442", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338375470", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375503", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338375535", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338375563", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375590", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338375615", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338375648", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375671", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338375701", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338375727", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375752", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338376402", + "member": "lab01.glab.lol", + "message": "ovs|84048|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227338376500", + "member": "lab01.glab.lol", + "message": "ovs|84049|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227339198829", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339198979", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339199014", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339199032", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339199044", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339199058", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339199071", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339199079", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +68ms" + }, + { + "at": "1789227339199087", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -822ms" + }, + { + "at": "1789227339199107", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339199126", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339199138", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339199153", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227339199170", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339199178", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339199192", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339199209", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339199218", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339199225", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227339199247", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339199258", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339199276", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339368900", + "member": "lab01.glab.lol", + "message": "ovs|84050|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227339369086", + "member": "lab01.glab.lol", + "message": "ovs|84051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227339372637", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339372734", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339372773", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339372803", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339372836", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339372868", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339372887", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339372916", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +654ms" + }, + { + "at": "1789227339372945", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -136ms" + }, + { + "at": "1789227339372976", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339372998", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339373023", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373047", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339373072", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339373094", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339373113", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339373138", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339373159", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373191", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227339373214", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339373238", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339373452", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339373865", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339373881", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339373894", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339373901", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339373912", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339373920", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339373934", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339373944", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +733ms" + }, + { + "at": "1789227339373952", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -37ms" + }, + { + "at": "1789227339373962", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339373975", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339373984", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373995", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227339374004", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339374011", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339374023", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339374036", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339374047", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339374057", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227339374065", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339374074", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339374081", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339688142", + "member": "lab01.glab.lol", + "message": "ovs|84052|bridge|INFO|bridge br-int: added interface veth011e07a6 on port 28" + }, + { + "at": "1789227340368741", + "member": "lab01.glab.lol", + "message": "ovs|84053|dpif|WARN|Dropped 1982 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227340368832", + "member": "lab01.glab.lol", + "message": "ovs|84054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227340732722", + "member": "lab01.glab.lol", + "message": "ovs|84055|poll_loop|INFO|Dropped 4609 log messages in last 243 seconds (most recently, 238 seconds ago) due to excessive rate" + }, + { + "at": "1789227340732925", + "member": "lab01.glab.lol", + "message": "ovs|84056|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340733054", + "member": "lab01.glab.lol", + "message": "ovs|84057|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340733549", + "member": "lab01.glab.lol", + "message": "ovs|84058|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340734039", + "member": "lab01.glab.lol", + "message": "ovs|84059|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340734543", + "member": "lab01.glab.lol", + "message": "ovs|84060|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340735033", + "member": "lab01.glab.lol", + "message": "ovs|84061|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340735538", + "member": "lab01.glab.lol", + "message": "ovs|84062|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340736041", + "member": "lab01.glab.lol", + "message": "ovs|84063|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340736549", + "member": "lab01.glab.lol", + "message": "ovs|84064|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340737054", + "member": "lab01.glab.lol", + "message": "ovs|84065|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227341368665", + "member": "lab01.glab.lol", + "message": "ovs|84066|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227341368762", + "member": "lab01.glab.lol", + "message": "ovs|84067|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227342368897", + "member": "lab01.glab.lol", + "message": "ovs|84068|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227342369123", + "member": "lab01.glab.lol", + "message": "ovs|84069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227343368955", + "member": "lab01.glab.lol", + "message": "ovs|84070|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227343369140", + "member": "lab01.glab.lol", + "message": "ovs|84071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227344368688", + "member": "lab01.glab.lol", + "message": "ovs|84072|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227344368794", + "member": "lab01.glab.lol", + "message": "ovs|84073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227345368707", + "member": "lab01.glab.lol", + "message": "ovs|84074|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227345368936", + "member": "lab01.glab.lol", + "message": "ovs|84075|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227346368688", + "member": "lab01.glab.lol", + "message": "ovs|84076|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227346368788", + "member": "lab01.glab.lol", + "message": "ovs|84077|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227346733034", + "member": "lab01.glab.lol", + "message": "ovs|84078|poll_loop|INFO|Dropped 12304 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227346733150", + "member": "lab01.glab.lol", + "message": "ovs|84079|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227347368658", + "member": "lab01.glab.lol", + "message": "ovs|84080|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227347368761", + "member": "lab01.glab.lol", + "message": "ovs|84081|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227348278776", + "member": "lab01.glab.lol", + "message": "ovs|84082|connmgr|INFO|br-int<->unix#7: 937 flow_mods in the 6 s starting 10 s ago (852 adds, 78 deletes, 7 modifications)" + }, + { + "at": "1789227348368863", + "member": "lab01.glab.lol", + "message": "ovs|84083|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227348368920", + "member": "lab01.glab.lol", + "message": "ovs|84084|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227349368823", + "member": "lab01.glab.lol", + "message": "ovs|84085|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227349369055", + "member": "lab01.glab.lol", + "message": "ovs|84086|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227350369001", + "member": "lab01.glab.lol", + "message": "ovs|84087|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227350369235", + "member": "lab01.glab.lol", + "message": "ovs|84088|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227351368916", + "member": "lab01.glab.lol", + "message": "ovs|84089|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227351369028", + "member": "lab01.glab.lol", + "message": "ovs|84090|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227352368871", + "member": "lab01.glab.lol", + "message": "ovs|84091|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227352368986", + "member": "lab01.glab.lol", + "message": "ovs|84092|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227352732881", + "member": "lab01.glab.lol", + "message": "ovs|84093|poll_loop|INFO|Dropped 12343 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227352733055", + "member": "lab01.glab.lol", + "message": "ovs|84094|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227353368970", + "member": "lab01.glab.lol", + "message": "ovs|84095|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227353369062", + "member": "lab01.glab.lol", + "message": "ovs|84096|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227354368720", + "member": "lab01.glab.lol", + "message": "ovs|84097|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227354368908", + "member": "lab01.glab.lol", + "message": "ovs|84098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227355368756", + "member": "lab01.glab.lol", + "message": "ovs|84099|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227355368964", + "member": "lab01.glab.lol", + "message": "ovs|84100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227356368976", + "member": "lab01.glab.lol", + "message": "ovs|84101|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227356369203", + "member": "lab01.glab.lol", + "message": "ovs|84102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227357368759", + "member": "lab01.glab.lol", + "message": "ovs|84103|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227357368864", + "member": "lab01.glab.lol", + "message": "ovs|84104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227358368618", + "member": "lab01.glab.lol", + "message": "ovs|84105|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227358368907", + "member": "lab01.glab.lol", + "message": "ovs|84106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227358732639", + "member": "lab01.glab.lol", + "message": "ovs|84107|poll_loop|INFO|Dropped 12377 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227358732758", + "member": "lab01.glab.lol", + "message": "ovs|84108|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227359368747", + "member": "lab01.glab.lol", + "message": "ovs|84109|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227359368936", + "member": "lab01.glab.lol", + "message": "ovs|84110|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227360368665", + "member": "lab01.glab.lol", + "message": "ovs|84111|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227360368777", + "member": "lab01.glab.lol", + "message": "ovs|84112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227361368663", + "member": "lab01.glab.lol", + "message": "ovs|84113|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227361368747", + "member": "lab01.glab.lol", + "message": "ovs|84114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227362368765", + "member": "lab01.glab.lol", + "message": "ovs|84115|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227362368990", + "member": "lab01.glab.lol", + "message": "ovs|84116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227363219807", + "member": "lab01.glab.lol", + "message": "ovs|84117|bridge|INFO|bridge br-int: deleted interface veth011e07a6 on port 28" + }, + { + "at": "1789227363368593", + "member": "lab01.glab.lol", + "message": "ovs|84118|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227363368712", + "member": "lab01.glab.lol", + "message": "ovs|84119|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227364368516", + "member": "lab01.glab.lol", + "message": "ovs|84120|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227364368724", + "member": "lab01.glab.lol", + "message": "ovs|84121|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227364732899", + "member": "lab01.glab.lol", + "message": "ovs|84122|poll_loop|INFO|Dropped 12273 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227364732973", + "member": "lab01.glab.lol", + "message": "ovs|84123|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227365368700", + "member": "lab01.glab.lol", + "message": "ovs|84124|dpif|WARN|Dropped 2122 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227365368934", + "member": "lab01.glab.lol", + "message": "ovs|84125|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227365527462", + "member": "lab01.glab.lol", + "message": "ovs|84126|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227365527553", + "member": "lab01.glab.lol", + "message": "ovs|84127|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227365556648", + "member": "lab01.glab.lol", + "message": "ovs|84128|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227365556693", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338260096", + "member": "lab02.glab.lol", + "message": "ovs|00167|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338260250", + "member": "lab02.glab.lol", + "message": "ovs|00168|bridge|INFO|bridge incusovn16: using datapath ID 000042b3b8d8b845" + }, + { + "at": "1789227338260271", + "member": "lab02.glab.lol", + "message": "ovs|00169|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338260288", + "member": "lab02.glab.lol", + "message": "ovs|00170|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338260305", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338260322", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338260337", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338260351", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338260366", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338260381", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593259ms" + }, + { + "at": "1789227338260400", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593259ms" + }, + { + "at": "1789227338260415", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593259ms" + }, + { + "at": "1789227338260431", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338260448", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338260463", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338260478", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227338260496", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338260510", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338260524", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338260540", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338260555", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338260568", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338260581", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338260597", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338260612", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338260626", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338269943", + "member": "lab02.glab.lol", + "message": "ovs|00171|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338269984", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338269996", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338270007", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338270020", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338270030", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338270045", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593269ms" + }, + { + "at": "1789227338270057", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593269ms" + }, + { + "at": "1789227338270068", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593269ms" + }, + { + "at": "1789227338270080", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338270091", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338270102", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270113", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338270125", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338270134", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270144", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338270154", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338270163", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270174", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338270184", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338270194", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270203", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338270214", + "member": "lab02.glab.lol", + "message": "ovs|00172|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338270225", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338270235", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338270247", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338270256", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338270266", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338270277", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593269ms" + }, + { + "at": "1789227338270287", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593269ms" + }, + { + "at": "1789227338270297", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593269ms" + }, + { + "at": "1789227338270307", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338270318", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338270327", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270338", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227338270348", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338270358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270368", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338270378", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338270388", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270403", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338270414", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338270424", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270435", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338355186", + "member": "lab02.glab.lol", + "message": "ovs|00173|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338355590", + "member": "lab02.glab.lol", + "message": "ovs|00174|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227338358605", + "member": "lab02.glab.lol", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338358647", + "member": "lab02.glab.lol", + "message": "ovs|00176|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789227339056207", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler169)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339056350", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler169)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227339056384", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339056428", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339056452", + "member": "lab02.glab.lol", + "message": " my_disc:0x7639c892 your_disc:0x6b88a426" + }, + { + "at": "1789227339056481", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339056507", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339056530", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339056551", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339056573", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339056596", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339056617", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339056648", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594055ms" + }, + { + "at": "1789227339056670", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -16ms" + }, + { + "at": "1789227339056699", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -796ms" + }, + { + "at": "1789227339056723", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339056744", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339056768", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339056791", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227339056813", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339056836", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339056861", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339056883", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339056916", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339056944", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7639c892" + }, + { + "at": "1789227339056967", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339056989", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057012", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339057032", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler169)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339057054", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339057076", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339057152", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339057174", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339057194", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339057215", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339057240", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -16ms" + }, + { + "at": "1789227339057261", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -796ms" + }, + { + "at": "1789227339057288", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339057309", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339057328", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339057348", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227339057370", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339057390", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057419", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339057440", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339057461", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339057484", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7639c892" + }, + { + "at": "1789227339057510", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339057534", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057555", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339224346", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler169)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339224434", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler169)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227339224470", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339224495", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339224515", + "member": "lab02.glab.lol", + "message": " my_disc:0x349dc1e2 your_disc:0x9ccef038" + }, + { + "at": "1789227339224541", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339224564", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339224595", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339224619", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339224640", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339224663", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339224688", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339224715", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594223ms" + }, + { + "at": "1789227339224750", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +47ms" + }, + { + "at": "1789227339224773", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -863ms" + }, + { + "at": "1789227339224796", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339224818", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339224837", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339224857", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227339224879", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339224900", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339224921", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339224942", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339224963", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339224983", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339225008", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339225029", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225050", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339225071", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler169)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339225095", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339225117", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339225138", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339225156", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339225175", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339225195", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339225216", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +47ms" + }, + { + "at": "1789227339225237", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -863ms" + }, + { + "at": "1789227339225259", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339225278", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339225299", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339225319", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227339225343", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339225362", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225382", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339225408", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339225429", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339225450", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339225471", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339225491", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225509", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339251697", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler169)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339251752", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler169)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227339251771", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339251786", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339251800", + "member": "lab02.glab.lol", + "message": " my_disc:0xdd2303b9 your_disc:0xccffcd9e" + }, + { + "at": "1789227339251814", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339251829", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339251844", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339251859", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339251872", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339251887", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339251903", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339251918", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594251ms" + }, + { + "at": "1789227339251935", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +839ms" + }, + { + "at": "1789227339251953", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -71ms" + }, + { + "at": "1789227339251968", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339251982", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339251995", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252009", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227339252024", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252038", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252050", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339252064", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339252078", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252091", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdd2303b9" + }, + { + "at": "1789227339252106", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339252121", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252135", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339252154", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler169)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339252170", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339252184", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339252197", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339252211", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339252226", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339252240", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339252254", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +839ms" + }, + { + "at": "1789227339252267", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -71ms" + }, + { + "at": "1789227339252279", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339252291", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339252303", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252316", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227339252329", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252342", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252354", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339252368", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339252381", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252400", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdd2303b9" + }, + { + "at": "1789227339252416", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252430", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252444", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227348263315", + "member": "lab02.glab.lol", + "message": "ovs|00177|connmgr|INFO|br-int<->unix#7: 905 flow_mods in the 6 s starting 10 s ago (838 adds, 59 deletes, 8 modifications)" + }, + { + "at": "1789227365519446", + "member": "lab02.glab.lol", + "message": "ovs|00178|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227365520027", + "member": "lab02.glab.lol", + "message": "ovs|00179|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227365520053", + "member": "lab02.glab.lol", + "message": "ovs|00180|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227365537376", + "member": "lab02.glab.lol", + "message": "ovs|00181|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789227365537428", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338260510", + "member": "lab03.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338260920", + "member": "lab03.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00008a575f87ca4a" + }, + { + "at": "1789227338260946", + "member": "lab03.glab.lol", + "message": "ovs|00185|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338263324", + "member": "lab03.glab.lol", + "message": "ovs|00186|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338263393", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338263420", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338263444", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338263465", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338263482", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338263503", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493261ms" + }, + { + "at": "1789227338263521", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493261ms" + }, + { + "at": "1789227338263541", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493261ms" + }, + { + "at": "1789227338263559", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338263576", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338263593", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263611", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338263636", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338263652", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338263670", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338263686", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338263700", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263715", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338263732", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338263754", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338263771", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338263788", + "member": "lab03.glab.lol", + "message": "ovs|00187|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338263804", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338263821", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338263837", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338263855", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338263872", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338263888", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493261ms" + }, + { + "at": "1789227338263908", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493261ms" + }, + { + "at": "1789227338263924", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493261ms" + }, + { + "at": "1789227338263944", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338263960", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338263976", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263996", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338264014", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338264030", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338264046", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338264065", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338264082", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338264098", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338264116", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338264132", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338264147", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338264165", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338271321", + "member": "lab03.glab.lol", + "message": "ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338271361", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338271377", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338271389", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338271402", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338271413", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338271423", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493269ms" + }, + { + "at": "1789227338271435", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493269ms" + }, + { + "at": "1789227338271450", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493269ms" + }, + { + "at": "1789227338271469", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338271480", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338271491", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338271501", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338271513", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338271524", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338271535", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338271546", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338271557", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338271567", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338271578", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338271589", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338271600", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338358711", + "member": "lab03.glab.lol", + "message": "ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338358762", + "member": "lab03.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227338359240", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler163)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338359333", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler163)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227338359371", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338359687", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338359754", + "member": "lab03.glab.lol", + "message": " my_disc:0x51248bf2 your_disc:0x17dbdf73" + }, + { + "at": "1789227338359785", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338359813", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338359837", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338359861", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338359884", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338359910", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338359936", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338359963", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493357ms" + }, + { + "at": "1789227338359988", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +854ms" + }, + { + "at": "1789227338360015", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227338360040", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338360072", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338360111", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360136", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338360161", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360184", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360208", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338360233", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338360259", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360284", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x51248bf2" + }, + { + "at": "1789227338360315", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338360338", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360364", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338360389", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler163)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338360417", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338360441", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338360462", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338360485", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338360509", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338360532", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338360558", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +854ms" + }, + { + "at": "1789227338360582", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227338360605", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338360628", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338360652", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360673", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338360696", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360722", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360746", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338360771", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338360794", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360818", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x51248bf2" + }, + { + "at": "1789227338360841", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360869", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360895", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338362911", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler163)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338362994", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler163)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338363029", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338363067", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338363091", + "member": "lab03.glab.lol", + "message": " my_disc:0xccffcd9e your_disc:0x0" + }, + { + "at": "1789227338363119", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338363143", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338363165", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338363189", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338363210", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338363233", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338363256", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338363287", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493360ms" + }, + { + "at": "1789227338363312", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227338363338", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227338363368", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338363391", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338363415", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363439", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338363470", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338363492", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338363516", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338363540", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338363569", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363591", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338363618", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338363642", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338363664", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338363692", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338363717", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338363743", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338363766", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338363789", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338363815", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338363839", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338363865", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227338363887", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227338363913", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338363936", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338363961", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363986", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338364014", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338364036", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338364066", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338364090", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338364114", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338364138", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338364162", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338364186", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338364209", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338366697", + "member": "lab03.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338366781", + "member": "lab03.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789227338367563", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler163)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338367637", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler163)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227338367670", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338367699", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338367718", + "member": "lab03.glab.lol", + "message": " my_disc:0x189931f2 your_disc:0xf807dd2c" + }, + { + "at": "1789227338367742", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338367768", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338367787", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338367805", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338367820", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338367843", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338367860", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338367875", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493365ms" + }, + { + "at": "1789227338367896", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +996ms" + }, + { + "at": "1789227338367914", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227338367934", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338367952", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338367969", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338367987", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338368005", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368021", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368038", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338368053", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338368072", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368098", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x189931f2" + }, + { + "at": "1789227338368122", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338368139", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368154", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338368174", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler163)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338368193", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338368208", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338368224", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338368241", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338368258", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338368274", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338368289", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +996ms" + }, + { + "at": "1789227338368306", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227338368321", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338368342", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338368359", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368378", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338368394", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368411", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368428", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338368444", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338368461", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368477", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x189931f2" + }, + { + "at": "1789227338368494", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368509", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368526", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227340094406", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227340094719", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227340094747", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227340094764", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227340094782", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227340094808", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227340094827", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227340094853", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +870ms" + }, + { + "at": "1789227340094872", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -60ms" + }, + { + "at": "1789227340094894", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227340094911", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227340094932", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227340094951", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227340094969", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227340094988", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227340095006", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227340095022", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227340095040", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227340095058", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227340095086", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227340095106", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227340095127", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227340702548", + "member": "lab03.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge br-int: added interface vethe019766a on port 26" + }, + { + "at": "1789227348265904", + "member": "lab03.glab.lol", + "message": "ovs|00194|connmgr|INFO|br-int<->unix#7: 936 flow_mods in the 6 s starting 10 s ago (850 adds, 78 deletes, 8 modifications)" + }, + { + "at": "1789227364293427", + "member": "lab03.glab.lol", + "message": "ovs|00195|bridge|INFO|bridge br-int: deleted interface vethe019766a on port 26" + }, + { + "at": "1789227365521742", + "member": "lab03.glab.lol", + "message": "ovs|00196|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227365522003", + "member": "lab03.glab.lol", + "message": "ovs|00197|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227365522039", + "member": "lab03.glab.lol", + "message": "ovs|00198|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227365551079", + "member": "lab03.glab.lol", + "message": "ovs|00199|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789227365551408", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338072228", + "member": "nas01.glab.lol", + "message": "ovs|00171|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338072375", + "member": "nas01.glab.lol", + "message": "ovs|00172|bridge|INFO|bridge incusovn16: using datapath ID 000006169a233441" + }, + { + "at": "1789227338072390", + "member": "nas01.glab.lol", + "message": "ovs|00173|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338170866", + "member": "nas01.glab.lol", + "message": "ovs|00174|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338171095", + "member": "nas01.glab.lol", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227338176363", + "member": "nas01.glab.lol", + "message": "ovs|00176|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338176419", + "member": "nas01.glab.lol", + "message": "ovs|00177|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227338261355", + "member": "nas01.glab.lol", + "message": "ovs|00178|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338261407", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338261432", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338261452", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338261466", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338261481", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338261499", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720125ms" + }, + { + "at": "1789227338261516", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720125ms" + }, + { + "at": "1789227338261531", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720125ms" + }, + { + "at": "1789227338261547", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338261564", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338261580", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338261595", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338261612", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338261628", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338261643", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338261660", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338261678", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338261694", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338261709", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338261727", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338261741", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338261756", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338265444", + "member": "nas01.glab.lol", + "message": "ovs|00179|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338265481", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338265498", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338265513", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338265529", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338265545", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338265560", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720129ms" + }, + { + "at": "1789227338265577", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720129ms" + }, + { + "at": "1789227338265594", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720129ms" + }, + { + "at": "1789227338265610", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338265625", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338265640", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338265654", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338265671", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338265686", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338265709", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338265723", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338265738", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338265753", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338265769", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338265791", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338265807", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338266407", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler177)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338266556", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler177)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338266579", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338266607", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338266624", + "member": "nas01.glab.lol", + "message": " my_disc:0x6b88a426 your_disc:0x0" + }, + { + "at": "1789227338266642", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338266663", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338266681", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338266697", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338266713", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338266728", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338266743", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338266760", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720130ms" + }, + { + "at": "1789227338266775", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +795ms" + }, + { + "at": "1789227338266803", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227338266820", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338266836", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338266851", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338266866", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338266880", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338266895", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338266920", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338266938", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338266959", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338266975", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227338266994", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338267015", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267032", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267048", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338267065", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338267082", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267097", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267114", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267128", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267143", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338267162", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +795ms" + }, + { + "at": "1789227338267176", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227338267190", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267205", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338267220", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267235", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338267249", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267267", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267282", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338267297", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338267310", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267325", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227338267340", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267358", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267374", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267418", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler177)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338267434", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler177)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227338267449", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338267463", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338267477", + "member": "nas01.glab.lol", + "message": " my_disc:0x17dbdf73 your_disc:0x0" + }, + { + "at": "1789227338267494", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338267508", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338267529", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338267544", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267558", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267572", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267587", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267600", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720131ms" + }, + { + "at": "1789227338267616", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720131ms" + }, + { + "at": "1789227338267631", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720131ms" + }, + { + "at": "1789227338267652", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267669", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338267682", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267696", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338267710", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267724", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267739", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338267752", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338267766", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267779", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338267796", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338267809", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267824", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267839", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338267854", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338267868", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267881", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267896", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267910", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267930", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338267951", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720131ms" + }, + { + "at": "1789227338267964", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720131ms" + }, + { + "at": "1789227338267979", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267993", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338268009", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338268024", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338268039", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338268055", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338268068", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338268083", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338268097", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338268111", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338268126", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338268139", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338268153", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338272791", + "member": "nas01.glab.lol", + "message": "ovs|00180|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338272808", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338272825", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338272835", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338272845", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338272856", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338272865", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720136ms" + }, + { + "at": "1789227338272876", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720136ms" + }, + { + "at": "1789227338272891", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720136ms" + }, + { + "at": "1789227338272902", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338272917", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338272927", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338272937", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338272948", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338272957", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338272966", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338272977", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338272987", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338272997", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338273006", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338273016", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338273026", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338370906", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler177)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338371008", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler177)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227338371024", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338371042", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338371054", + "member": "nas01.glab.lol", + "message": " my_disc:0xea4aba81 your_disc:0x21aad08" + }, + { + "at": "1789227338371065", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338371075", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338371086", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338371095", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338371106", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338371117", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338371126", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338371141", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720234ms" + }, + { + "at": "1789227338371156", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227338371169", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227338371181", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338371192", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338371211", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371228", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338371241", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371251", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371261", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338371272", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338371285", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371295", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xea4aba81" + }, + { + "at": "1789227338371312", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338371322", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371333", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338371342", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler177)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338371353", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338371366", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338371379", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338371393", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338371406", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338371426", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338371438", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227338371453", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227338371466", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338371478", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338371492", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371506", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338371519", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371529", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371539", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338371549", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338371559", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371569", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xea4aba81" + }, + { + "at": "1789227338371579", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371588", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371598", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339068251", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339068452", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339068480", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339068498", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339068516", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339068535", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339068554", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339068572", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +923ms" + }, + { + "at": "1789227339068590", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227339068609", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339068627", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339068656", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339068680", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227339068700", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339068724", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339068749", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339068775", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339068799", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339068821", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227339068840", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339068857", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339068874", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339217357", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339217635", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339217651", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339217662", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339217672", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339217683", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339217693", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339217704", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +706ms" + }, + { + "at": "1789227339217723", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227339217735", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339217746", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339217761", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339217771", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227339217781", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339217792", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339217809", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339217822", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339217837", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339217850", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227339217864", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339217878", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339217892", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227348077289", + "member": "nas01.glab.lol", + "message": "ovs|00181|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (843 adds, 83 deletes, 2 modifications)" + }, + { + "at": "1789227365528885", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor193)|INFO|monitor thread terminated" + }, + { + "at": "1789227365650844", + "member": "nas01.glab.lol", + "message": "ovs|00182|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227365651290", + "member": "nas01.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227365651306", + "member": "nas01.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227365677867", + "member": "nas01.glab.lol", + "message": "ovs|00185|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-before-probe.txt new file mode 100644 index 0000000..90dc051 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/diagnostics-before-probe.txt @@ -0,0 +1,5481 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:e8:83:f2 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:5c:44:71 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 610cb309-8282-4d8d-a2b7-e085bfbf4cad (incus-net32-ls-ext) + port incus-net32-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net32-ls-ext-lsp-router + type: router + router-port: incus-net32-lr-lrp-ext +switch aca93faa-aea8-4729-b88c-82ed44ef3937 (incus-net32-ls-int) + port incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0 + addresses: ["10:66:6a:e8:83:f2 dynamic"] + port incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0 + addresses: ["10:66:6a:5c:44:71 dynamic"] + port incus-net32-ls-int-lsp-router + type: router + router-port: incus-net32-lr-lrp-int +router bac0e241-5743-49b5-84b1-a9cedca557e4 (incus-net32-lr) + port incus-net32-lr-lrp-ext + mac: "10:66:6a:33:3f:c7" + ipv6-lla: "fe80::1266:6aff:fe33:3fc7" + networks: ["10.10.40.64/24"] + port incus-net32-lr-lrp-int + mac: "10:66:6a:33:3f:c7" + ipv6-lla: "fe80::1266:6aff:fe33:3fc7" + networks: ["10.253.73.1/24"] + nat 86281e38-e6d1-49b0-9312-550270ea278b + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net32-instance-45afc094-3dd4-4a68-bd77-e6af2cbb9373-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net32-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net32-instance-a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 8e4ad01e-8d0e-459d-8227-88bd4cdfb753 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 7f660565-1f66-46ba-98cd-0050dba7ddb3 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:33:3f:c7" +name : incus-net32-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} + +_uuid : e3c18ecb-9ce8-4744-979d-f5e9515a371c +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:33:3f:c7" +name : incus-net32-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 531558c5-4afd-433c-bd5d-2ac485276100 +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : 63db9462-5bdb-4b90-8046-0259671d83f1 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 0b893e82-7020-4a69-a5ba-c106fd207e69 +logical_port : cr-incus-net32-lr-lrp-ext +mac : ["10:66:6a:33:3f:c7 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net32-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:33:3f:c7 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:33:3f:c7 DELAY +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338272799", + "member": "lab01.glab.lol", + "message": "ovs|84031|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338273036", + "member": "lab01.glab.lol", + "message": "ovs|84032|bridge|INFO|bridge incusovn16: using datapath ID 00007a092e54774b" + }, + { + "at": "1789227338273071", + "member": "lab01.glab.lol", + "message": "ovs|84033|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338276027", + "member": "lab01.glab.lol", + "message": "ovs|84034|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338276110", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338276145", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338276171", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338276193", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338276223", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338276250", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338276288", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338276316", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338276344", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338276376", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338276405", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276433", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338276460", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338276493", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338276524", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338276546", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338276579", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276613", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338276641", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338276673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338276693", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338276721", + "member": "lab01.glab.lol", + "message": "ovs|84035|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338276747", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338276773", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338276791", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338276811", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338276827", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338276846", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338276867", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338276885", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338276909", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338276927", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338276946", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338276970", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338276988", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338277010", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338277031", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277055", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338277081", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338277097", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277118", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338277139", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338277161", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277187", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338277209", + "member": "lab01.glab.lol", + "message": "ovs|84036|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338277233", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338277251", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338277273", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338277289", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338277306", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338277332", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616276ms" + }, + { + "at": "1789227338277351", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616276ms" + }, + { + "at": "1789227338277374", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616276ms" + }, + { + "at": "1789227338277394", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338277417", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338277434", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277459", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338277492", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338277509", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277535", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338277561", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338277579", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338277594", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338277619", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338277637", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338277664", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338368846", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler187)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338368952", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler187)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227338369004", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338369041", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338369093", + "member": "lab01.glab.lol", + "message": " my_disc:0x21aad08 your_disc:0x0" + }, + { + "at": "1789227338369124", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338369164", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338369202", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338369253", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338369290", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338369328", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338369357", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338369391", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616369ms" + }, + { + "at": "1789227338369431", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616369ms" + }, + { + "at": "1789227338369469", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616369ms" + }, + { + "at": "1789227338369528", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338369555", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338369593", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338369630", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338369668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338369701", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338369731", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338369767", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338369804", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338369828", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227338369862", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338369889", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338369932", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338369961", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338369991", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338370021", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338370054", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338370080", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338370106", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338370131", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338370178", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616369ms" + }, + { + "at": "1789227338370465", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616369ms" + }, + { + "at": "1789227338370678", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338370707", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338370745", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338370774", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227338370807", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338370837", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338370873", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338370904", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338370932", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338370956", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227338370987", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371024", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371054", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338371079", + "member": "lab01.glab.lol", + "message": "ovs|84037|dpif|WARN|Dropped 386 log messages in last 239 seconds (most recently, 239 seconds ago) due to excessive rate" + }, + { + "at": "1789227338371118", + "member": "lab01.glab.lol", + "message": "ovs|84038|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371163", + "member": "lab01.glab.lol", + "message": "ovs|84039|bridge|WARN|Dropped 11150 log messages in last 244 seconds (most recently, 239 seconds ago) due to excessive rate" + }, + { + "at": "1789227338371214", + "member": "lab01.glab.lol", + "message": "ovs|84040|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371261", + "member": "lab01.glab.lol", + "message": "ovs|84041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371297", + "member": "lab01.glab.lol", + "message": "ovs|84042|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371340", + "member": "lab01.glab.lol", + "message": "ovs|84043|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338371389", + "member": "lab01.glab.lol", + "message": "ovs|84044|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338371968", + "member": "lab01.glab.lol", + "message": "ovs|84045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338372086", + "member": "lab01.glab.lol", + "message": "ovs|84046|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227338372633", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler187)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338372742", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler187)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338372781", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338372819", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338372849", + "member": "lab01.glab.lol", + "message": " my_disc:0x9ccef038 your_disc:0x0" + }, + { + "at": "1789227338372889", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338372916", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338372953", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338372977", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338373005", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338373043", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338373067", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338373095", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616373ms" + }, + { + "at": "1789227338373131", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +863ms" + }, + { + "at": "1789227338373179", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789227338373203", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338373281", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338373310", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373341", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338373369", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338373396", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338373420", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338373448", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338373474", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373514", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227338373549", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338373581", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338373607", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338373634", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338373672", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338373695", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338373735", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338373770", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338373800", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338373826", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338373852", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +863ms" + }, + { + "at": "1789227338373878", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789227338373909", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338373932", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338373961", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338373995", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227338374020", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374052", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374080", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338374102", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338374127", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338374156", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227338374191", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374223", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374259", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338374286", + "member": "lab01.glab.lol", + "message": "ovs|84047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227338374318", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler187)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338374350", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler187)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227338374381", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338374410", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338374437", + "member": "lab01.glab.lol", + "message": " my_disc:0xf807dd2c your_disc:0x0" + }, + { + "at": "1789227338374470", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338374509", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338374540", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338374568", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338374600", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338374630", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338374662", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338374688", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541616373ms" + }, + { + "at": "1789227338374724", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616373ms" + }, + { + "at": "1789227338374758", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616373ms" + }, + { + "at": "1789227338374785", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338374811", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338374837", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338374864", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338374896", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338374922", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338374951", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338374984", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338375008", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375033", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338375068", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338375094", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375120", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338375142", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338375174", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338375209", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338375247", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338375269", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338375292", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338375323", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338375359", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541616373ms" + }, + { + "at": "1789227338375390", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541616373ms" + }, + { + "at": "1789227338375416", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338375442", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338375470", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375503", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227338375535", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338375563", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375590", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338375615", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338375648", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338375671", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338375701", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338375727", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338375752", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338376402", + "member": "lab01.glab.lol", + "message": "ovs|84048|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227338376500", + "member": "lab01.glab.lol", + "message": "ovs|84049|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227339198829", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler187)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339198979", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339199014", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339199032", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339199044", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339199058", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339199071", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339199079", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +68ms" + }, + { + "at": "1789227339199087", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -822ms" + }, + { + "at": "1789227339199107", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339199126", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339199138", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339199153", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xea4aba81" + }, + { + "at": "1789227339199170", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339199178", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339199192", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339199209", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339199218", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339199225", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x21aad08" + }, + { + "at": "1789227339199247", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339199258", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339199276", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339368900", + "member": "lab01.glab.lol", + "message": "ovs|84050|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227339369086", + "member": "lab01.glab.lol", + "message": "ovs|84051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227339372637", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler187)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339372734", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339372773", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339372803", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339372836", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339372868", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339372887", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339372916", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +654ms" + }, + { + "at": "1789227339372945", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -136ms" + }, + { + "at": "1789227339372976", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339372998", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339373023", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373047", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339373072", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339373094", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339373113", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339373138", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339373159", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373191", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9ccef038" + }, + { + "at": "1789227339373214", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339373238", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339373452", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339373865", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler187)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339373881", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339373894", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339373901", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339373912", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339373920", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339373934", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339373944", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +733ms" + }, + { + "at": "1789227339373952", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -37ms" + }, + { + "at": "1789227339373962", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339373975", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339373984", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339373995", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x189931f2" + }, + { + "at": "1789227339374004", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339374011", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339374023", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339374036", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339374047", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339374057", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf807dd2c" + }, + { + "at": "1789227339374065", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339374074", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339374081", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339688142", + "member": "lab01.glab.lol", + "message": "ovs|84052|bridge|INFO|bridge br-int: added interface veth011e07a6 on port 28" + }, + { + "at": "1789227340368741", + "member": "lab01.glab.lol", + "message": "ovs|84053|dpif|WARN|Dropped 1982 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227340368832", + "member": "lab01.glab.lol", + "message": "ovs|84054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227340732722", + "member": "lab01.glab.lol", + "message": "ovs|84055|poll_loop|INFO|Dropped 4609 log messages in last 243 seconds (most recently, 238 seconds ago) due to excessive rate" + }, + { + "at": "1789227340732925", + "member": "lab01.glab.lol", + "message": "ovs|84056|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340733054", + "member": "lab01.glab.lol", + "message": "ovs|84057|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340733549", + "member": "lab01.glab.lol", + "message": "ovs|84058|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340734039", + "member": "lab01.glab.lol", + "message": "ovs|84059|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340734543", + "member": "lab01.glab.lol", + "message": "ovs|84060|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340735033", + "member": "lab01.glab.lol", + "message": "ovs|84061|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340735538", + "member": "lab01.glab.lol", + "message": "ovs|84062|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340736041", + "member": "lab01.glab.lol", + "message": "ovs|84063|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340736549", + "member": "lab01.glab.lol", + "message": "ovs|84064|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227340737054", + "member": "lab01.glab.lol", + "message": "ovs|84065|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (77% CPU usage)" + }, + { + "at": "1789227341368665", + "member": "lab01.glab.lol", + "message": "ovs|84066|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227341368762", + "member": "lab01.glab.lol", + "message": "ovs|84067|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227342368897", + "member": "lab01.glab.lol", + "message": "ovs|84068|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227342369123", + "member": "lab01.glab.lol", + "message": "ovs|84069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227343368955", + "member": "lab01.glab.lol", + "message": "ovs|84070|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227343369140", + "member": "lab01.glab.lol", + "message": "ovs|84071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227344368688", + "member": "lab01.glab.lol", + "message": "ovs|84072|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227344368794", + "member": "lab01.glab.lol", + "message": "ovs|84073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227345368707", + "member": "lab01.glab.lol", + "message": "ovs|84074|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227345368936", + "member": "lab01.glab.lol", + "message": "ovs|84075|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338260096", + "member": "lab02.glab.lol", + "message": "ovs|00167|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338260250", + "member": "lab02.glab.lol", + "message": "ovs|00168|bridge|INFO|bridge incusovn16: using datapath ID 000042b3b8d8b845" + }, + { + "at": "1789227338260271", + "member": "lab02.glab.lol", + "message": "ovs|00169|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338260288", + "member": "lab02.glab.lol", + "message": "ovs|00170|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338260305", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338260322", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338260337", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338260351", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338260366", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338260381", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593259ms" + }, + { + "at": "1789227338260400", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593259ms" + }, + { + "at": "1789227338260415", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593259ms" + }, + { + "at": "1789227338260431", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338260448", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338260463", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338260478", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227338260496", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338260510", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338260524", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338260540", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338260555", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338260568", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338260581", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338260597", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338260612", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338260626", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338269943", + "member": "lab02.glab.lol", + "message": "ovs|00171|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338269984", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338269996", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338270007", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338270020", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338270030", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338270045", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593269ms" + }, + { + "at": "1789227338270057", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593269ms" + }, + { + "at": "1789227338270068", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593269ms" + }, + { + "at": "1789227338270080", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338270091", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338270102", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270113", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338270125", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338270134", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270144", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338270154", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338270163", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270174", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338270184", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338270194", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270203", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338270214", + "member": "lab02.glab.lol", + "message": "ovs|00172|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338270225", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338270235", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338270247", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338270256", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338270266", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338270277", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590593269ms" + }, + { + "at": "1789227338270287", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590593269ms" + }, + { + "at": "1789227338270297", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590593269ms" + }, + { + "at": "1789227338270307", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338270318", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338270327", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270338", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227338270348", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338270358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270368", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338270378", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338270388", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338270403", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338270414", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338270424", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338270435", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338355186", + "member": "lab02.glab.lol", + "message": "ovs|00173|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338355590", + "member": "lab02.glab.lol", + "message": "ovs|00174|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227338358605", + "member": "lab02.glab.lol", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338358647", + "member": "lab02.glab.lol", + "message": "ovs|00176|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789227339056207", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler169)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339056350", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler169)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227339056384", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339056428", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339056452", + "member": "lab02.glab.lol", + "message": " my_disc:0x7639c892 your_disc:0x6b88a426" + }, + { + "at": "1789227339056481", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339056507", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339056530", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339056551", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339056573", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339056596", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339056617", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339056648", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594055ms" + }, + { + "at": "1789227339056670", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -16ms" + }, + { + "at": "1789227339056699", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -796ms" + }, + { + "at": "1789227339056723", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339056744", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339056768", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339056791", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227339056813", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339056836", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339056861", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339056883", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339056916", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339056944", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7639c892" + }, + { + "at": "1789227339056967", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339056989", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057012", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339057032", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler169)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339057054", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339057076", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339057152", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339057174", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339057194", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339057215", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339057240", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -16ms" + }, + { + "at": "1789227339057261", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -796ms" + }, + { + "at": "1789227339057288", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339057309", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339057328", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339057348", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x6b88a426" + }, + { + "at": "1789227339057370", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339057390", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057419", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339057440", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339057461", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339057484", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7639c892" + }, + { + "at": "1789227339057510", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339057534", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339057555", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339224346", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler169)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339224434", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler169)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227339224470", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339224495", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339224515", + "member": "lab02.glab.lol", + "message": " my_disc:0x349dc1e2 your_disc:0x9ccef038" + }, + { + "at": "1789227339224541", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339224564", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339224595", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339224619", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339224640", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339224663", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339224688", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339224715", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594223ms" + }, + { + "at": "1789227339224750", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +47ms" + }, + { + "at": "1789227339224773", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -863ms" + }, + { + "at": "1789227339224796", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339224818", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339224837", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339224857", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227339224879", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339224900", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339224921", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339224942", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339224963", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339224983", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339225008", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339225029", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225050", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339225071", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler169)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339225095", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339225117", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339225138", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339225156", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339225175", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339225195", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339225216", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +47ms" + }, + { + "at": "1789227339225237", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -863ms" + }, + { + "at": "1789227339225259", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339225278", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339225299", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339225319", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x9ccef038" + }, + { + "at": "1789227339225343", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339225362", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225382", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339225408", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339225429", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339225450", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x349dc1e2" + }, + { + "at": "1789227339225471", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339225491", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339225509", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339251697", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler169)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227339251752", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler169)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227339251771", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227339251786", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227339251800", + "member": "lab02.glab.lol", + "message": " my_disc:0xdd2303b9 your_disc:0xccffcd9e" + }, + { + "at": "1789227339251814", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227339251829", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227339251844", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227339251859", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339251872", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339251887", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339251903", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339251918", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590594251ms" + }, + { + "at": "1789227339251935", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +839ms" + }, + { + "at": "1789227339251953", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -71ms" + }, + { + "at": "1789227339251968", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339251982", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339251995", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252009", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227339252024", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252038", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252050", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339252064", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339252078", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252091", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdd2303b9" + }, + { + "at": "1789227339252106", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227339252121", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252135", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339252154", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler169)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339252170", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339252184", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339252197", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339252211", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339252226", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339252240", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339252254", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +839ms" + }, + { + "at": "1789227339252267", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -71ms" + }, + { + "at": "1789227339252279", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339252291", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227339252303", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252316", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xccffcd9e" + }, + { + "at": "1789227339252329", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252342", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252354", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339252368", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227339252381", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339252400", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdd2303b9" + }, + { + "at": "1789227339252416", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339252430", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339252444", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338260510", + "member": "lab03.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338260920", + "member": "lab03.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00008a575f87ca4a" + }, + { + "at": "1789227338260946", + "member": "lab03.glab.lol", + "message": "ovs|00185|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338263324", + "member": "lab03.glab.lol", + "message": "ovs|00186|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338263393", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338263420", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338263444", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338263465", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338263482", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338263503", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493261ms" + }, + { + "at": "1789227338263521", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493261ms" + }, + { + "at": "1789227338263541", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493261ms" + }, + { + "at": "1789227338263559", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338263576", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338263593", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263611", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338263636", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338263652", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338263670", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338263686", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338263700", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263715", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338263732", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338263754", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338263771", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338263788", + "member": "lab03.glab.lol", + "message": "ovs|00187|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338263804", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338263821", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338263837", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338263855", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338263872", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338263888", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493261ms" + }, + { + "at": "1789227338263908", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493261ms" + }, + { + "at": "1789227338263924", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493261ms" + }, + { + "at": "1789227338263944", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338263960", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338263976", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338263996", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338264014", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338264030", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338264046", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338264065", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338264082", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338264098", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338264116", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338264132", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338264147", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338264165", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338271321", + "member": "lab03.glab.lol", + "message": "ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338271361", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338271377", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338271389", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338271402", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338271413", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338271423", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493269ms" + }, + { + "at": "1789227338271435", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49493269ms" + }, + { + "at": "1789227338271450", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49493269ms" + }, + { + "at": "1789227338271469", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338271480", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338271491", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338271501", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338271513", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338271524", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338271535", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338271546", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338271557", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338271567", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338271578", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338271589", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338271600", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338358711", + "member": "lab03.glab.lol", + "message": "ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338358762", + "member": "lab03.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227338359240", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler163)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338359333", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler163)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227338359371", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338359687", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338359754", + "member": "lab03.glab.lol", + "message": " my_disc:0x51248bf2 your_disc:0x17dbdf73" + }, + { + "at": "1789227338359785", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338359813", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338359837", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338359861", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338359884", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338359910", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338359936", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338359963", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493357ms" + }, + { + "at": "1789227338359988", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +854ms" + }, + { + "at": "1789227338360015", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227338360040", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338360072", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338360111", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360136", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338360161", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360184", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360208", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338360233", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338360259", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360284", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x51248bf2" + }, + { + "at": "1789227338360315", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338360338", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360364", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338360389", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler163)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338360417", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338360441", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338360462", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338360485", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338360509", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338360532", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338360558", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +854ms" + }, + { + "at": "1789227338360582", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227338360605", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338360628", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338360652", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360673", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338360696", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360722", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360746", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338360771", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338360794", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338360818", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x51248bf2" + }, + { + "at": "1789227338360841", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338360869", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338360895", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338362911", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler163)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338362994", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler163)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338363029", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338363067", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338363091", + "member": "lab03.glab.lol", + "message": " my_disc:0xccffcd9e your_disc:0x0" + }, + { + "at": "1789227338363119", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338363143", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338363165", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338363189", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338363210", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338363233", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338363256", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338363287", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493360ms" + }, + { + "at": "1789227338363312", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227338363338", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227338363368", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338363391", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338363415", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363439", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338363470", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338363492", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338363516", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338363540", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338363569", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363591", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338363618", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338363642", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338363664", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338363692", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338363717", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338363743", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338363766", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338363789", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338363815", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338363839", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338363865", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227338363887", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227338363913", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338363936", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338363961", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338363986", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227338364014", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338364036", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338364066", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338364090", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338364114", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338364138", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227338364162", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338364186", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338364209", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338366697", + "member": "lab03.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338366781", + "member": "lab03.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789227338367563", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler163)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338367637", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler163)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227338367670", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338367699", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338367718", + "member": "lab03.glab.lol", + "message": " my_disc:0x189931f2 your_disc:0xf807dd2c" + }, + { + "at": "1789227338367742", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338367768", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338367787", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338367805", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338367820", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338367843", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338367860", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338367875", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49493365ms" + }, + { + "at": "1789227338367896", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +996ms" + }, + { + "at": "1789227338367914", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227338367934", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338367952", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338367969", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338367987", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338368005", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368021", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368038", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338368053", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338368072", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368098", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x189931f2" + }, + { + "at": "1789227338368122", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338368139", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368154", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338368174", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler163)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338368193", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338368208", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338368224", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338368241", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338368258", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338368274", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338368289", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +996ms" + }, + { + "at": "1789227338368306", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227338368321", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338368342", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338368359", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368378", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf807dd2c" + }, + { + "at": "1789227338368394", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368411", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368428", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338368444", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338368461", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338368477", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x189931f2" + }, + { + "at": "1789227338368494", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338368509", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338368526", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227340094406", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler163)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227340094719", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227340094747", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227340094764", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227340094782", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227340094808", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227340094827", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227340094853", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +870ms" + }, + { + "at": "1789227340094872", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -60ms" + }, + { + "at": "1789227340094894", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227340094911", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227340094932", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227340094951", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdd2303b9" + }, + { + "at": "1789227340094969", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227340094988", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227340095006", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227340095022", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227340095040", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227340095058", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xccffcd9e" + }, + { + "at": "1789227340095086", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227340095106", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227340095127", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227340702548", + "member": "lab03.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge br-int: added interface vethe019766a on port 26" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227338072228", + "member": "nas01.glab.lol", + "message": "ovs|00171|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227338072375", + "member": "nas01.glab.lol", + "message": "ovs|00172|bridge|INFO|bridge incusovn16: using datapath ID 000006169a233441" + }, + { + "at": "1789227338072390", + "member": "nas01.glab.lol", + "message": "ovs|00173|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227338170866", + "member": "nas01.glab.lol", + "message": "ovs|00174|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227338171095", + "member": "nas01.glab.lol", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227338176363", + "member": "nas01.glab.lol", + "message": "ovs|00176|bridge|INFO|bridge incusovn16: added interface patch-incus-net32-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227338176419", + "member": "nas01.glab.lol", + "message": "ovs|00177|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net32-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227338261355", + "member": "nas01.glab.lol", + "message": "ovs|00178|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338261407", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338261432", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338261452", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338261466", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338261481", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338261499", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720125ms" + }, + { + "at": "1789227338261516", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720125ms" + }, + { + "at": "1789227338261531", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720125ms" + }, + { + "at": "1789227338261547", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338261564", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338261580", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338261595", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338261612", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338261628", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338261643", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338261660", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338261678", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338261694", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338261709", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338261727", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338261741", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338261756", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor193)|INFO|monitor thread created" + }, + { + "at": "1789227338265444", + "member": "nas01.glab.lol", + "message": "ovs|00179|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338265481", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338265498", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338265513", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338265529", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338265545", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338265560", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720129ms" + }, + { + "at": "1789227338265577", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720129ms" + }, + { + "at": "1789227338265594", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720129ms" + }, + { + "at": "1789227338265610", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338265625", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338265640", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338265654", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338265671", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338265686", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338265709", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338265723", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338265738", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338265753", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338265769", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338265791", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338265807", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338266407", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler177)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338266556", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler177)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227338266579", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338266607", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338266624", + "member": "nas01.glab.lol", + "message": " my_disc:0x6b88a426 your_disc:0x0" + }, + { + "at": "1789227338266642", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338266663", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338266681", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338266697", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338266713", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338266728", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338266743", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338266760", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720130ms" + }, + { + "at": "1789227338266775", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +795ms" + }, + { + "at": "1789227338266803", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227338266820", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338266836", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338266851", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338266866", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338266880", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338266895", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338266920", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338266938", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338266959", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338266975", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227338266994", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338267015", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267032", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267048", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338267065", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338267082", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267097", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267114", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267128", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267143", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338267162", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +795ms" + }, + { + "at": "1789227338267176", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227338267190", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267205", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338267220", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267235", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227338267249", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267267", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267282", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338267297", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338267310", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267325", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227338267340", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267358", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267374", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267418", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler177)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338267434", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler177)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227338267449", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227338267463", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338267477", + "member": "nas01.glab.lol", + "message": " my_disc:0x17dbdf73 your_disc:0x0" + }, + { + "at": "1789227338267494", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338267508", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338267529", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338267544", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267558", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267572", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267587", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267600", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720131ms" + }, + { + "at": "1789227338267616", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720131ms" + }, + { + "at": "1789227338267631", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720131ms" + }, + { + "at": "1789227338267652", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267669", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338267682", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267696", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338267710", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338267724", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267739", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338267752", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338267766", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338267779", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338267796", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338267809", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338267824", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338267839", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338267854", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338267868", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338267881", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338267896", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338267910", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338267930", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338267951", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720131ms" + }, + { + "at": "1789227338267964", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720131ms" + }, + { + "at": "1789227338267979", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338267993", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338268009", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338268024", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227338268039", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338268055", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338268068", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338268083", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227338268097", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338268111", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227338268126", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338268139", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338268153", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338272791", + "member": "nas01.glab.lol", + "message": "ovs|00180|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338272808", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338272825", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338272835", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338272845", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338272856", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227338272865", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720136ms" + }, + { + "at": "1789227338272876", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590720136ms" + }, + { + "at": "1789227338272891", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590720136ms" + }, + { + "at": "1789227338272902", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338272917", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227338272927", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338272937", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338272948", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338272957", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227338272966", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338272977", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227338272987", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338272997", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227338273006", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338273016", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227338273026", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227338370906", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler177)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227338371008", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler177)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227338371024", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227338371042", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227338371054", + "member": "nas01.glab.lol", + "message": " my_disc:0xea4aba81 your_disc:0x21aad08" + }, + { + "at": "1789227338371065", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227338371075", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227338371086", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227338371095", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338371106", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338371117", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338371126", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338371141", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590720234ms" + }, + { + "at": "1789227338371156", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227338371169", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227338371181", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338371192", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338371211", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371228", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338371241", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371251", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371261", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338371272", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338371285", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371295", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xea4aba81" + }, + { + "at": "1789227338371312", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227338371322", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371333", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227338371342", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler177)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227338371353", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227338371366", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227338371379", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227338371393", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227338371406", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227338371426", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227338371438", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227338371453", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227338371466", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227338371478", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227338371492", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371506", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x21aad08" + }, + { + "at": "1789227338371519", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371529", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371539", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227338371549", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227338371559", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227338371569", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xea4aba81" + }, + { + "at": "1789227338371579", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227338371588", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227338371598", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339068251", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler177)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339068452", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339068480", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339068498", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339068516", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339068535", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339068554", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339068572", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +923ms" + }, + { + "at": "1789227339068590", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227339068609", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339068627", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339068656", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339068680", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7639c892" + }, + { + "at": "1789227339068700", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339068724", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339068749", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339068775", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339068799", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339068821", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6b88a426" + }, + { + "at": "1789227339068840", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339068857", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339068874", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227339217357", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler177)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227339217635", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227339217651", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227339217662", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227339217672", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227339217683", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227339217693", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227339217704", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +706ms" + }, + { + "at": "1789227339217723", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227339217735", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227339217746", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227339217761", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227339217771", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x51248bf2" + }, + { + "at": "1789227339217781", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227339217792", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339217809", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227339217822", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227339217837", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227339217850", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x17dbdf73" + }, + { + "at": "1789227339217864", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227339217878", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227339217892", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.debug.log new file mode 100644 index 0000000..636b196 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:35:35-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.log new file mode 100644 index 0000000..cf7d24a --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-create.log @@ -0,0 +1,544 @@ +time="2026-09-12T15:35:35Z" level=debug msg="[nas01] Event listener server handler started" id=c1d8eda2-a404-4e85-a682-1c75f3a49da9 local="10.10.10.14:8443" remote="100.122.142.76:53509" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53527" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53528" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53529" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53530" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53531" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53532" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53533" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53534" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53552" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53553" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:33:3f:c7" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.32 +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net32 driver=ovn memberID=1 network=default priority=10304 project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53556" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53557" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53558" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53561" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53562" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53563" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53564" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53569" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Event listener server handler started" id=cebcae2a-dc28-44e1-a02c-a4291ebc4992 local="10.10.10.14:8443" remote="100.122.142.76:53570" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53570" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53574" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=7904cf63-762f-43d1-a058-0790530ca7f1 project=image-build +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=7904cf63-762f-43d1-a058-0790530ca7f1 project=image-build +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53587" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:38Z" level=debug msg="[nas01] Event listener server handler started" id=dbd3cb5c-8123-4f1a-9274-72e21246d9f1 local="10.10.10.14:8443" remote="100.122.142.76:53587" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53588" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=e54b6882-61ec-4872-af45-296372bef208 project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=e54b6882-61ec-4872-af45-296372bef208 project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53589" method=GET protocol=tls url="/1.0/operations/e54b6882-61ec-4872-af45-296372bef208?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=e54b6882-61ec-4872-af45-296372bef208 project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=e54b6882-61ec-4872-af45-296372bef208 project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=dbd3cb5c-8123-4f1a-9274-72e21246d9f1 local="10.10.10.14:8443" remote="100.122.142.76:53587" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=cebcae2a-dc28-44e1-a02c-a4291ebc4992 local="10.10.10.14:8443" remote="100.122.142.76:53570" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53593" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53594" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"62cb3b1a-e699-4085-9f75-0cda0610ab63\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:35:39.126786029Z\",\n\t\t\"updated_at\": \"2026-09-12T15:35:39.126786029Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53595" method=GET protocol=tls url="/1.0/operations/62cb3b1a-e699-4085-9f75-0cda0610ab63/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53608" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53609" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Event listener server handler started" id=105daaf0-78b2-4308-a3f3-c9ba098cc7e0 local="10.10.10.14:8443" remote="100.122.142.76:53610" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53610" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53611" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 15:35:39.136713458 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53612" method=GET protocol=tls url="/1.0/operations/01eb1e53-8963-46ea-9568-b950800fb950?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:35:39Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:35:40Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 15:35:39.136713458 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=105daaf0-78b2-4308-a3f3-c9ba098cc7e0 local="10.10.10.14:8443" remote="100.122.142.76:53610" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53614" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53615" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"da3d0724-bbd6-42b9-8d11-473e1c3925cd\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:35:40.172622063Z\",\n\t\t\"updated_at\": \"2026-09-12T15:35:40.172622063Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53616" method=GET protocol=tls url="/1.0/operations/da3d0724-bbd6-42b9-8d11-473e1c3925cd/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:35:40Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to update warning status for warning \"519f6fb0-a631-4d61-8805-d814f3ffb22f\": database is locked" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53617" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53618" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53619" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Event listener server handler started" id=b6d9e3d1-10cb-4b93-98a3-b1684bf59405 local="10.10.10.14:8443" remote="100.122.142.76:53619" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53620" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 15:35:40.219671782 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53621" method=GET protocol=tls url="/1.0/operations/bcdf630d-332f-417b-a4a1-aa10929f27c0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 15:35:40.219671782 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b6d9e3d1-10cb-4b93-98a3-b1684bf59405 local="10.10.10.14:8443" remote="100.122.142.76:53619" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53622" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53623" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53624" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53625" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53626" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53633" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53635" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53636" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53637" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53638" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Event listener server handler started" id=919497f9-0d21-4b48-9131-22d06203d158 local="10.10.10.14:8443" remote="100.122.142.76:53638" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53639" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53641" method=GET protocol=tls url="/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=4e50d446d9a00993aa08e518f2557c32c595c1dd14b68b4b53508faec43a4486" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=4e50d446d9a00993aa08e518f2557c32c595c1dd14b68b4b53508faec43a4486" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53641" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53642" method=GET protocol=tls url="/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=942cd957880ffbb06782dc4e5e30777bd17f357bcadda529589cf97ee0d3e620" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53642" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=942cd957880ffbb06782dc4e5e30777bd17f357bcadda529589cf97ee0d3e620" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53643" method=GET protocol=tls url="/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=4db553d7616936fa7fa3d0609051120e68f6db83b8ae20c3600876b426a7c4f4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53643" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=4db553d7616936fa7fa3d0609051120e68f6db83b8ae20c3600876b426a7c4f4" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53644" method=GET protocol=tls url="/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=632f4639d692c07f4bac40c47196e5e27805d1d1093f879c9aca660c4c2ca683" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53644" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1/websocket?secret=632f4639d692c07f4bac40c47196e5e27805d1d1093f879c9aca660c4c2ca683" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53642" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53645" method=GET protocol=tls url="/1.0/operations/b2e42e63-2a85-4fec-9a94-ed198e5ef4f1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53641" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53644" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53643" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Event listener server handler stopped" listener=919497f9-0d21-4b48-9131-22d06203d158 local="10.10.10.14:8443" remote="100.122.142.76:53638" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53646" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53647" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.64 network=default project=ac-ovn-spike +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Completed heartbeat round" duration=3.510932333s +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53649" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53651" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Event listener server handler started" id=adc9b1d5-4f15-4e3a-ad5f-02d8ff0d10ce local="10.10.10.14:8443" remote="100.122.142.76:53651" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53652" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53653" method=GET protocol=tls url="/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=58b3346a2302f9de53aba239d2b891c433cd68622e65de97f1f57feadbcd34c5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=58b3346a2302f9de53aba239d2b891c433cd68622e65de97f1f57feadbcd34c5" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53653" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53654" method=GET protocol=tls url="/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=9c11e2bc17c6cde6d0d312522ed991f7be58f86a43fee90b0bcb5a4ceb8bfd03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=9c11e2bc17c6cde6d0d312522ed991f7be58f86a43fee90b0bcb5a4ceb8bfd03" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53654" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53655" method=GET protocol=tls url="/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=09e5a34512ae9d6d014ba6a68ab9f2f2d2cfff7cda3e784ab6334a7e90df7d22" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53655" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=09e5a34512ae9d6d014ba6a68ab9f2f2d2cfff7cda3e784ab6334a7e90df7d22" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53656" method=GET protocol=tls url="/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=ff6f1e1fc4b7590eec857806180f2ad77bad1b95563460bd02063305d68950fc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53656" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788/websocket?secret=ff6f1e1fc4b7590eec857806180f2ad77bad1b95563460bd02063305d68950fc" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53654" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53657" method=GET protocol=tls url="/1.0/operations/27c98549-7908-43c1-bb90-da1c59fa7788?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53656" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53653" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53655" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Event listener server handler stopped" listener=adc9b1d5-4f15-4e3a-ad5f-02d8ff0d10ce local="10.10.10.14:8443" remote="100.122.142.76:53651" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53663" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53664" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Event listener server handler started" id=34862e19-54aa-4d1c-916f-186d447689ba local="10.10.10.14:8443" remote="100.122.142.76:53664" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53669" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53682" method=GET protocol=tls url="/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=44727877d3636599933f0cbdd74d744d821e77c8430225b38e4ce7322bc920a6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=44727877d3636599933f0cbdd74d744d821e77c8430225b38e4ce7322bc920a6" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53682" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53683" method=GET protocol=tls url="/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=1bfba7c628f174ebb8f90580fb18655e68ba46e439dab4a4707ce3d29d16fc48" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53683" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=1bfba7c628f174ebb8f90580fb18655e68ba46e439dab4a4707ce3d29d16fc48" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53684" method=GET protocol=tls url="/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=f7c2b5c78ab5666d7deb844c61bf06853a08e803f3ff71c1d998328116fea7f5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=f7c2b5c78ab5666d7deb844c61bf06853a08e803f3ff71c1d998328116fea7f5" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53684" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53685" method=GET protocol=tls url="/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=626e13027b4ffa59a27cf9d61faaf97f09f273d963aa73a6c5a7714fb8f34bf2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1/websocket?secret=626e13027b4ffa59a27cf9d61faaf97f09f273d963aa73a6c5a7714fb8f34bf2" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53685" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53683" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53686" method=GET protocol=tls url="/1.0/operations/8390a20e-6469-4b51-8561-43e4db914fb1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53682" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53684" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53685" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Event listener server handler stopped" listener=34862e19-54aa-4d1c-916f-186d447689ba local="10.10.10.14:8443" remote="100.122.142.76:53664" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53687" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53688" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53690" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53692" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Event listener server handler started" id=a80ac9fa-fda3-4c28-8cb6-e3c23cfe2990 local="10.10.10.14:8443" remote="100.122.142.76:53692" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53693" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53694" method=GET protocol=tls url="/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=86a9afec76eab6d2ec0ff7da05300c98ff49e6be02f75d5bf627bf725ceabb73" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53694" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=86a9afec76eab6d2ec0ff7da05300c98ff49e6be02f75d5bf627bf725ceabb73" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53695" method=GET protocol=tls url="/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=60f7386102ba2844a28e483f47e3b4ea714854ac60dcb97f2f212295e084a87f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=60f7386102ba2844a28e483f47e3b4ea714854ac60dcb97f2f212295e084a87f" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53695" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53696" method=GET protocol=tls url="/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=f9e43f5be1c9b8b9b2ec440d76a26ea842517b11ad65c44461d19b07f10e1476" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53696" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=f9e43f5be1c9b8b9b2ec440d76a26ea842517b11ad65c44461d19b07f10e1476" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53697" method=GET protocol=tls url="/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=421dc4299d943735396904d26a24cc2cee77bee9c0077dc57cadd40194445fb8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e/websocket?secret=421dc4299d943735396904d26a24cc2cee77bee9c0077dc57cadd40194445fb8" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53697" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53695" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53698" method=GET protocol=tls url="/1.0/operations/1e34556a-0369-43e6-9277-cd7afe83cb0e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53694" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53696" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53697" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a80ac9fa-fda3-4c28-8cb6-e3c23cfe2990 local="10.10.10.14:8443" remote="100.122.142.76:53692" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53699" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53700" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Event listener server handler started" id=da955216-1b8e-4e45-adf7-4fcc7ec2895f local="10.10.10.14:8443" remote="100.122.142.76:53700" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53701" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53702" method=GET protocol=tls url="/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=ecb835128ec31bc2953f77f37d30cc02d01e1ae5ab67316e238e5e0de7ce94f4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=ecb835128ec31bc2953f77f37d30cc02d01e1ae5ab67316e238e5e0de7ce94f4" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53702" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53703" method=GET protocol=tls url="/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=d65da9c08aa56c779caeb9e907ff15beebf4b93ab4c63d25af1edfc3a5953cc9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53703" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=d65da9c08aa56c779caeb9e907ff15beebf4b93ab4c63d25af1edfc3a5953cc9" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53705" method=GET protocol=tls url="/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=985cf28ee2855bb99d241fd78c04b90ca69feb565bd2ee22f07fb64b9a7800e9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=985cf28ee2855bb99d241fd78c04b90ca69feb565bd2ee22f07fb64b9a7800e9" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53705" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53706" method=GET protocol=tls url="/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=1ffa3e5a5bc36b228f792307894ea2ed01110982a7e205bcd2a80ec865c7d805" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542/websocket?secret=1ffa3e5a5bc36b228f792307894ea2ed01110982a7e205bcd2a80ec865c7d805" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53706" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53703" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53707" method=GET protocol=tls url="/1.0/operations/69f1e798-dee8-49fb-96c8-af053efbc542?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53702" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53705" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53706" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=da955216-1b8e-4e45-adf7-4fcc7ec2895f local="10.10.10.14:8443" remote="100.122.142.76:53700" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53708" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53709" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Event listener server handler started" id=540c477f-fc69-4a70-94b6-52ced4160f88 local="10.10.10.14:8443" remote="100.122.142.76:53709" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53711" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53712" method=GET protocol=tls url="/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=6eaccf51dcbe7de68142e1e7253b24976ac39a79e832ef9c8eb8ae1004654703" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53712" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=6eaccf51dcbe7de68142e1e7253b24976ac39a79e832ef9c8eb8ae1004654703" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53713" method=GET protocol=tls url="/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=aae39d57d3f29b6f0427bbcbebc0177035752b12b3076de16d97bdfc0f77b8ec" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53713" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=aae39d57d3f29b6f0427bbcbebc0177035752b12b3076de16d97bdfc0f77b8ec" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53714" method=GET protocol=tls url="/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=bc936847d65bc22cd9c2dedd57948d1cb0712fbcc93f01cbc5f2ad1b6f4d8cd3" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=bc936847d65bc22cd9c2dedd57948d1cb0712fbcc93f01cbc5f2ad1b6f4d8cd3" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53714" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53715" method=GET protocol=tls url="/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=b475b63f23f48464dba04839f2dd13549def8b61462bc3f02ee348fb1da0b3ed" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:53715" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3/websocket?secret=b475b63f23f48464dba04839f2dd13549def8b61462bc3f02ee348fb1da0b3ed" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53713" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53716" method=GET protocol=tls url="/1.0/operations/b5b97d27-9471-4762-a1d7-d2d8a8285de3?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53712" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53715" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:53714" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Event listener server handler stopped" listener=540c477f-fc69-4a70-94b6-52ced4160f88 local="10.10.10.14:8443" remote="100.122.142.76:53709" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53719" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53721" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Event listener server handler started" id=46194329-ee02-4fa2-a8d6-adfa2f2d373e local="10.10.10.14:8443" remote="100.122.142.76:53721" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53722" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53723" method=GET protocol=tls url="/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=3cd08e6654c598e27f1475ae7a9c211279f466bc13894c36e18e33aa79d7a0b3" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53723" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=3cd08e6654c598e27f1475ae7a9c211279f466bc13894c36e18e33aa79d7a0b3" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53724" method=GET protocol=tls url="/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=04ee5c5abc1679910ab87325113ede1d507f12a4ff90b2c47b78a91588db14bc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=04ee5c5abc1679910ab87325113ede1d507f12a4ff90b2c47b78a91588db14bc" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53724" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53725" method=GET protocol=tls url="/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=1a7f2798b724cdef597d50c8ec326140a84641911a78657cfb0427a5a610ae8c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53725" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=1a7f2798b724cdef597d50c8ec326140a84641911a78657cfb0427a5a610ae8c" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53726" method=GET protocol=tls url="/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=8eff628975ce6897754559e4d09b9f29c319ce6bc2451d8de2e2006fa4ceee76" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:53726" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276/websocket?secret=8eff628975ce6897754559e4d09b9f29c319ce6bc2451d8de2e2006fa4ceee76" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53724" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53727" method=GET protocol=tls url="/1.0/operations/6d4d88bd-68a0-4d46-8229-e085fc4c1276?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53726" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53725" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:53723" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Event listener server handler stopped" listener=46194329-ee02-4fa2-a8d6-adfa2f2d373e local="10.10.10.14:8443" remote="100.122.142.76:53721" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53728" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53729" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:35:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.debug.log new file mode 100644 index 0000000..3609c19 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:36:02-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.log new file mode 100644 index 0000000..f19b579 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/monitor-delete.log @@ -0,0 +1,167 @@ +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Event listener server handler started" id=ac5888cb-74fe-4f29-9e15-fb62b65d51fd local="10.10.10.14:8443" remote="100.122.142.76:53926" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53927" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53928" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53929" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53930" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:35:39.136713458Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:35:39.926951525Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:36:02Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:35:40.219671782Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:35:40.788133121Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53931" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53932" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Event listener server handler started" id=4ac34ae7-4063-4299-8c25-88cf1907cbd0 local="10.10.10.14:8443" remote="100.122.142.76:53933" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53933" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53934" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 15:35:39.136713458 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:35:39.926951525 +0000 UTC" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53935" method=GET protocol=tls url="/1.0/operations/c6e10eef-996c-49f9-a670-0ae00ccd4160?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53936" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:03Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 15:35:39.136713458 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:35:39.926951525 +0000 UTC" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53937" method=GET protocol=tls url="/1.0/operations/0ec69900-5865-45f4-9843-2233b8f58eac?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:03Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 15:35:39.136713458 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:35:39.926951525 +0000 UTC" +time="2026-09-12T15:36:03Z" level=debug msg="[nas01] Event listener server handler stopped" listener=4ac34ae7-4063-4299-8c25-88cf1907cbd0 local="10.10.10.14:8443" remote="100.122.142.76:53933" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53938" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53939" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Event listener server handler started" id=6b3d0f7f-510d-4f3c-921b-9e4104555aa0 local="10.10.10.14:8443" remote="100.122.142.76:53940" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53940" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53941" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 15:35:40.219671782 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:35:40.788133121 +0000 UTC" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53942" method=GET protocol=tls url="/1.0/operations/f79f8c52-de83-4f73-b9ba-92aaeca76194?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:36:04Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.586278794s +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53943" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 15:35:40.219671782 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:35:40.788133121 +0000 UTC" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53944" method=GET protocol=tls url="/1.0/operations/6ce9d6ff-b267-4cf0-9b17-73504c1a8532?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:05Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 15:35:40.219671782 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:35:40.788133121 +0000 UTC" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Event listener server handler stopped" listener=6b3d0f7f-510d-4f3c-921b-9e4104555aa0 local="10.10.10.14:8443" remote="100.122.142.76:53940" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53945" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53946" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53947" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53948" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53949" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53950" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53951" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53952" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Delete \"warnings\": database is locked" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53953" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53954" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53957" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53958" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53959" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53960" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53961" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53962" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53963" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Event listener server handler started" id=ad082815-25fc-4701-8699-b1889adee919 local="10.10.10.14:8443" remote="100.122.142.76:53963" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53964" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=5b9df209-e761-4d99-abe6-f921f77d6ba4 project=ac-ovn-spike +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=5b9df209-e761-4d99-abe6-f921f77d6ba4 project=ac-ovn-spike +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=5b9df209-e761-4d99-abe6-f921f77d6ba4 project=ac-ovn-spike +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53966" method=GET protocol=tls url="/1.0/operations/5b9df209-e761-4d99-abe6-f921f77d6ba4?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ad082815-25fc-4701-8699-b1889adee919 local="10.10.10.14:8443" remote="100.122.142.76:53963" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53967" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:53968" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:36:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/probe.stdout.txt new file mode 100644 index 0000000..12436cd --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/probe.stdout.txt @@ -0,0 +1,137 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.097 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.099 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"0fd6b534-eba0-4a59-9391-31704e260f77","volatile.eth0.host_name":"veth011e07a6","volatile.eth0.hwaddr":"10:66:6a:e8:83:f2","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459","volatile.uuid.generation":"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:35:39.136713458Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"0fd6b534-eba0-4a59-9391-31704e260f77","volatile.eth0.host_name":"veth011e07a6","volatile.eth0.hwaddr":"10:66:6a:e8:83:f2","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459","volatile.uuid.generation":"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:35:39.926951525Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":10297344,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fee8:83f2","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:e8:83:f2","host_name":"veth011e07a6","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4174468,"processes":4,"cpu":{"usage":483192000,"allocated_time":24000000000},"started_at":"2026-09-12T15:35:38.950000047Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"65f87cd9-1fae-47b2-9688-7c3105f43066","volatile.eth0.host_name":"vethe019766a","volatile.eth0.hwaddr":"10:66:6a:5c:44:71","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"45afc094-3dd4-4a68-bd77-e6af2cbb9373","volatile.uuid.generation":"45afc094-3dd4-4a68-bd77-e6af2cbb9373"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:35:40.219671782Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"65f87cd9-1fae-47b2-9688-7c3105f43066","volatile.eth0.host_name":"vethe019766a","volatile.eth0.hwaddr":"10:66:6a:5c:44:71","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"45afc094-3dd4-4a68-bd77-e6af2cbb9373","volatile.uuid.generation":"45afc094-3dd4-4a68-bd77-e6af2cbb9373"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:35:40.788133121Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11206656,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe5c:4471","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:5c:44:71","host_name":"vethe019766a","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":33163,"processes":4,"cpu":{"usage":499911000,"allocated_time":24000000000},"started_at":"2026-09-12T15:35:40.809999942Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.113 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.193 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.274 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.259 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.722 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.290 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.290/0.757/1.259 ms +elapsed_seconds=2.221 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.217 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.666 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.383 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.383/0.755/1.217 ms +elapsed_seconds=2.234 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.135 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.756 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.907 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.907/1.599/2.135 ms +elapsed_seconds=2.455 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.161 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.598 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.953 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.953/1.570/2.161 ms +elapsed_seconds=2.255 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Non-authoritative answer: +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +Non-authoritative answer: +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +elapsed_seconds=0.709 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.221 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.316 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.315 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.028 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.115007 bytes_per_second=869512290 +elapsed_seconds=0.496 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.522 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.135790 bytes_per_second=736431254 +elapsed_seconds=0.384 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.521 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/tcpdump-arp.log new file mode 100644 index 0000000..bd6ef55 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +15:35:47.198951 10:66:6a:33:3f:c7 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +15:35:55.199644 10:66:6a:33:3f:c7 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/topology.jsonl new file mode 100644 index 0000000..9fc4904 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-1/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.427, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.576, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.139, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.154, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.237, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.435, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:35:39.126786029Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"62cb3b1a-e699-4085-9f75-0cda0610ab63\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:35:39.126786029Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.614, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.409, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:35:40.172622063Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"da3d0724-bbd6-42b9-8d11-473e1c3925cd\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:35:40.172622063Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.399, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.219, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 146705000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 6590464,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fee8:83f2\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth011e07a6\",\n\t\t\t\"hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4174468,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:35:38.950000047Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.207, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 130849000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6344704,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe5c:4471\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 758,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 3,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"vethe019766a\",\n\t\t\t\"hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 33163,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:35:40.809999942Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t},\n\t\"created_at\": \"2026-09-12T15:35:39.136713458Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:35:39.926951525Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t},\n\t\"created_at\": \"2026-09-12T15:35:40.219671782Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:35:40.788133121Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.492, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.540 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.540/1.540/1.540 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.339, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.268, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.27, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.343, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-cmppyxbo/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.198, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.269, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.566, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.027780 seconds, 3.4GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.542, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.025508 seconds, 3.7GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.149, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:35:39.136713458Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"0fd6b534-eba0-4a59-9391-31704e260f77\",\n\t\t\t\"volatile.eth0.host_name\": \"veth011e07a6\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:e8:83:f2\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\",\n\t\t\t\"volatile.uuid.generation\": \"a67ad2fa-c6e5-4ade-9c3d-036b5f2c3459\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:35:39.926951525Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:35:40.219671782Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"65f87cd9-1fae-47b2-9688-7c3105f43066\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe019766a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:5c:44:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\",\n\t\t\t\"volatile.uuid.generation\": \"45afc094-3dd4-4a68-bd77-e6af2cbb9373\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:35:40.788133121Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.985, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.083, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.148, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.483, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.104, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.124, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T15:35:40.258955433Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T15:35:39.012821185Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.234, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.106, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/commands.jsonl new file mode 100644 index 0000000..8bfd7dd --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.09, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:38:25.368547+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.312, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:38:25.681195+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.093, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T15:38:25.774697+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 84911, "ready": true, "ready_signal": "time=\"2026-09-12T08:38:25-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:38:25.857416+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/topology.jsonl", "create"], "seconds": 8.05, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.602,\n \"first_cross_member_ping_seconds\": 3.205,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:33.907320+00:00"} +{"capture": "monitor-create", "pid": 84911, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.log", "ready_signal": "time=\"2026-09-12T08:38:25-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:38:33.909626+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:33.995972+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.083, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:c1:3a:bb |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:23:36:e5 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:34.079381+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.118, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 9c7fd63d-02e5-4725-89d8-20a93b5b4c22 (incus-net33-ls-int)\n port incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0\n addresses: [\"10:66:6a:23:36:e5 dynamic\"]\n port incus-net33-ls-int-lsp-router\n type: router\n router-port: incus-net33-lr-lrp-int\n port incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0\n addresses: [\"10:66:6a:c1:3a:bb dynamic\"]\nswitch c00fa569-4968-411f-ac26-a8e96a3fc785 (incus-net33-ls-ext)\n port incus-net33-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net33-ls-ext-lsp-router\n type: router\n router-port: incus-net33-lr-lrp-ext\nrouter 23008478-d6de-4cf9-9c72-49b77c3c9e77 (incus-net33-lr)\n port incus-net33-lr-lrp-ext\n mac: \"10:66:6a:74:95:5e\"\n ipv6-lla: \"fe80::1266:6aff:fe74:955e\"\n networks: [\"10.10.40.64/24\"]\n port incus-net33-lr-lrp-int\n mac: \"10:66:6a:74:95:5e\"\n ipv6-lla: \"fe80::1266:6aff:fe74:955e\"\n networks: [\"10.253.73.1/24\"]\n nat 927155e2-a0a4-4858-9bff-3ed132cfbb8c\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net33-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 213ce4ec-49aa-4056-ab31-2753ba6265ea\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f5542e8a-f5b9-47ed-bf7e-79796b6cac96\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:74:95:5e\"\nname : incus-net33-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n\n_uuid : 24f02c6b-fdff-4373-956e-0d2c02b266d4\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:74:95:5e\"\nname : incus-net33-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : c3a4712b-0df6-4eee-b28e-298666393faf\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : a68ceb67-150e-485e-9708-75c40ff8fa4d\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f35549ad-87de-45c6-a476-95d37d94d468\nlogical_port : cr-incus-net33-lr-lrp-ext\nmac : [\"10:66:6a:74:95:5e 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net33-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:74:95:5e STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:38:34.198058+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.273, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:74:95:5e DELAY \n", "stderr": "", "error": null, "at": "2026-09-12T15:38:34.471691+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.169, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507722372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84130|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507722696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84131|bridge|INFO|bridge incusovn16: using datapath ID 0000dad0828f3c4b\"\n },\n {\n \"at\": \"1789227507722724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84132|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507724746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84133|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507724810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507724836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507724854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507724873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507724886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507724899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507724987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507725028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725137\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84134|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507725161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507725172\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507725181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507725199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507725214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507725230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725240\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725270\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507725282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507725330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725338\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725362\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725382\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725395\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725414\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725422\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84135|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507725441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507725456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507725472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507725491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507725505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507725515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725537\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507725562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725580\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507725593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507816983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler196)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507817142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler196)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507817193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507817234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507817270\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x4cb6d301 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507817309\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507817340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507817373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507817403\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507817434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507817474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507817530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507817561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785817ms\"\n },\n {\n \"at\": \"1789227507817608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +728ms\"\n },\n {\n \"at\": \"1789227507817655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -92ms\"\n },\n {\n \"at\": \"1789227507817700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507817730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507817760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507817790\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507817817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507817845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507817877\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507817914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507817956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507817995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507818034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507818065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507818180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507818210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507818280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507818317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507818354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507818397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +728ms\"\n },\n {\n \"at\": \"1789227507818433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -92ms\"\n },\n {\n \"at\": \"1789227507818471\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507818518\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507818549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507818579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507818609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507818708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507818736\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507818765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507818797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84136|dpif|WARN|Dropped 333 log messages in last 142 seconds (most recently, 142 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227507818965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84137|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507819006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84138|bridge|WARN|Dropped 55709 log messages in last 169 seconds (most recently, 142 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227507819038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84139|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227507819357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler196)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507819413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler196)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507819461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507819500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507819536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xda265f98 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507819584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507819617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507819650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507819688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507819716\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507819757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507819789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507819822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785819ms\"\n },\n {\n \"at\": \"1789227507819868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +786ms\"\n },\n {\n \"at\": \"1789227507820245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227507820348\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507820389\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507820426\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507820458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507820671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507820709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507820741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507820773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507820810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507820850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507820888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84141|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227507820924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507820954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507820990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821051\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507821091\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507821122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821151\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507821180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507821218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507821248\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507821279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +786ms\"\n },\n {\n \"at\": \"1789227507821315\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227507821346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507821375\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507821411\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507821451\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507821477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507821584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507821612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507821641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507821673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler196)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507821801\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler196)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507821841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507821880\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507821919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xec809328 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507821961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507821987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507822016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507822048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507822114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785821ms\"\n },\n {\n \"at\": \"1789227507822224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +794ms\"\n },\n {\n \"at\": \"1789227507822263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227507822295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507822324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507822353\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507822390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507822429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822460\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507822530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507822559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507822585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507822615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507822655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507822766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507822797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507822862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507822944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +794ms\"\n },\n {\n \"at\": \"1789227507822970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227507823006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507823034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507823068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507823100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507823133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507823221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507823247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507823282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507823317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507823416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507823883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84143|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507825889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507830590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84145|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227507830635\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227508617643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508617751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508617770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508617786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508617796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508617805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508617826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508617836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +697ms\"\n },\n {\n \"at\": \"1789227508617856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -73ms\"\n },\n {\n \"at\": \"1789227508617886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508617897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508617923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508617935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508617951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508617967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508617978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508617991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508618013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508618026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508618043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508618061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508618080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508690035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508690132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508690157\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508690171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508690187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508690205\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508690224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508690239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +785ms\"\n },\n {\n \"at\": \"1789227508690254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -85ms\"\n },\n {\n \"at\": \"1789227508690277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508690291\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508690309\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508690319\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508690331\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508690385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508690399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508690410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508690420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508690430\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508761179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508761366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508761386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508761400\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508761410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508761431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508761448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508761464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789227508761491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -146ms\"\n },\n {\n \"at\": \"1789227508761515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508761529\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508761543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508761553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508761570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508761612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508761623\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508761637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508761653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508761668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508818644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84147|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227508818688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227509144720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84149|bridge|INFO|bridge br-int: added interface veth1af313e3 on port 30\"\n },\n {\n \"at\": \"1789227509818712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84150|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227509818860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84151|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227510818725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84152|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227510818914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84153|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227511818892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84154|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227511819080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84155|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227512267846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84156|poll_loop|INFO|Dropped 1710 log messages in last 148 seconds (most recently, 145 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227512267929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84157|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512268373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84158|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512268897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512269413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84160|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512269926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84161|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512270439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84162|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512270954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84163|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512271469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84164|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512271983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84165|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512272489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512818925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84167|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227512819138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227513818804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84169|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227513818956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227514139554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84171|bridge|WARN|Dropped 12682 log messages in last 7 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227514139650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84172|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:34.641089+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.172, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507704380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507704705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00004259e0da4248\"\n },\n {\n \"at\": \"1789227507704737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00185|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507706897\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00186|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507706957\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507706981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507706994\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507707006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507707022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507707035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507707082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507707098\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507707110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507707122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507707131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507707153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507707164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507707177\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507707187\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507707222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507713650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00187|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713732\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507713754\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713798\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713809\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507713819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507713840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713850\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713870\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507713880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713891\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507713902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713913\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713923\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507713937\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713950\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713960\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507714006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507714051\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507714086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507714097\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507714116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714135\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507714146\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714155\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507801672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507801725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227507808580\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507808688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18\"\n },\n {\n \"at\": \"1789227508539423\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler204)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508539562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler204)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508539591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508539621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508539643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xdc9ba2fe your_disc:0xca515c77\"\n },\n {\n \"at\": \"1789227508539665\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508539724\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539743\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539792\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763538ms\"\n },\n {\n \"at\": \"1789227508539839\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +38ms\"\n },\n {\n \"at\": \"1789227508539860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -732ms\"\n },\n {\n \"at\": \"1789227508539880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539922\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508539959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539977\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508540022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508540045\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508540084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508540103\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508540145\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler204)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508540165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508540183\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508540200\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508540218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508540235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508540253\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508540277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +38ms\"\n },\n {\n \"at\": \"1789227508540296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -732ms\"\n },\n {\n \"at\": \"1789227508540314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508540333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508540357\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540376\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508540459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508540512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508540529\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540548\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508540566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540587\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584221\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler204)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508584298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler204)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508584327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508584350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508584374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x497f288e your_disc:0x40a41aa9\"\n },\n {\n \"at\": \"1789227508584414\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508584437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508584463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508584484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508584525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508584544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508584565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763583ms\"\n },\n {\n \"at\": \"1789227508584586\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227508584608\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789227508584631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508584651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508584672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508584694\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227508584716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584735\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508584775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508584793\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508584813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227508584836\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508584856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler204)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508584926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508584947\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508584987\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508585008\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508585029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508585051\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227508585072\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789227508585092\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508585116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508585136\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508585189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227508585211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508585268\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508585290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508585310\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227508585331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler204)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508593458\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler204)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508593474\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508593484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508593494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x81e3b173 your_disc:0xda265f98\"\n },\n {\n \"at\": \"1789227508593504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508593514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508593523\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508593534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508593553\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593563\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593572\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763592ms\"\n },\n {\n \"at\": \"1789227508593585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +54ms\"\n },\n {\n \"at\": \"1789227508593595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -786ms\"\n },\n {\n \"at\": \"1789227508593612\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508593621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508593630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508593651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593661\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508593679\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508593688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508593711\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508593721\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593741\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler204)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508593758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508593768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508593789\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593798\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508593819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +54ms\"\n },\n {\n \"at\": \"1789227508593833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -786ms\"\n },\n {\n \"at\": \"1789227508593843\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508593852\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508593864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593873\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508593884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593894\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508593917\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508593926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593935\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508593944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593954\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593965\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:34.813672+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.174, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507707789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00201|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507707984\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00202|bridge|INFO|bridge incusovn16: using datapath ID 000072a4e283cf43\"\n },\n {\n \"at\": \"1789227507708012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00203|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507710639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00204|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507710681\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507710698\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507710712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507710726\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507710737\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507710749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710790\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710803\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507710826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507710837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507710849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507710861\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507710872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710885\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507710895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507710905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507710917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507710928\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710941\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507710966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00205|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507710980\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507710993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507711004\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507711015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507711025\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507711036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711048\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711063\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711075\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507711086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507711096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507711108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507711120\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507711131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711142\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507711152\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507711162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507711173\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507711185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507711196\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711216\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507717597\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00206|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507717644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507717657\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507717667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507717678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507717691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507717702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717713\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717724\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717741\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507717752\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507717768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507717778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507717789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507717800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717812\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507717823\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507717833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507717843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507717855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507804643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507804692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227507806329\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler199)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507806399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler199)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507806433\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507806465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507806496\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x89809725 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507806522\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507806549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507806573\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507806601\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507806627\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507806651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507806674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507806707\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507806811\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507806837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507806864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507806887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507806911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507806978\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507807004\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507807032\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807055\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507807089\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507807113\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807141\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507807174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507807200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507807224\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507807248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507807271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507807297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507807320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507807347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507807374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507807397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507807420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507807444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507807487\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507807559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507807579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507807625\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler199)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507809238\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler199)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507809274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507809300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507809324\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xca515c77 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507809350\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507809377\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507809398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507809421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507809474\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507809497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507809520\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662807ms\"\n },\n {\n \"at\": \"1789227507809543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +731ms\"\n },\n {\n \"at\": \"1789227507809568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227507809598\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507809620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507809644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507809665\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507809694\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809720\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507809775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507809798\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507809824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507809849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507809873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809898\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507809947\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507809972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507810018\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507810039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507810070\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507810095\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +731ms\"\n },\n {\n \"at\": \"1789227507810119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227507810142\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507810164\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507810187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507810217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507810240\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507810311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507810342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507810363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507810386\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810409\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810430\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507811441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507811536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00210|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227508589288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508589394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508589425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508589451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508589477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508589503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508589534\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508589557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227508589586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49ms\"\n },\n {\n \"at\": \"1789227508589610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508589635\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508589663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508589685\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508589708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589729\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508589773\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508589805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508589828\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508589850\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508589873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler199)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508605367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler199)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508605382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508605397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508605408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xe78f835 your_disc:0xec809328\"\n },\n {\n \"at\": \"1789227508605425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508605438\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508605449\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508605462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508605486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49663603ms\"\n },\n {\n \"at\": \"1789227508605523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789227508605544\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -795ms\"\n },\n {\n \"at\": \"1789227508605557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508605570\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508605581\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508605609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605633\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508605646\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508605659\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605672\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508605684\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508605696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605707\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler199)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508605733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508605744\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605756\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508605768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605791\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508605808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789227508605822\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -795ms\"\n },\n {\n \"at\": \"1789227508605833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508605845\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508605856\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605868\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508605880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605903\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508605915\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508605926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508605949\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508647285\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508647375\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508647407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508647439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508647462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508647485\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508647513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508647534\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +73ms\"\n },\n {\n \"at\": \"1789227508647563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -837ms\"\n },\n {\n \"at\": \"1789227508647588\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508647611\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508647636\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508647662\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227508647686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647710\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508647755\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508647778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508647805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227508647826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508647850\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647871\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227510169696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00211|bridge|INFO|bridge br-int: added interface veth00b99e0c on port 28\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:34.987978+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.167, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507517047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00187|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507517197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00188|bridge|INFO|bridge incusovn16: using datapath ID 00001e51c01ceb4a\"\n },\n {\n \"at\": \"1789227507517217\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00189|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507615058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507615174\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227507620318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507620366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227507708466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00194|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507708514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507708534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507708550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507708561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507708573\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507708584\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708605\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708617\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507708628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507708639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507708650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507708661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507708679\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507708702\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507708713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507708724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507708734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708757\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507709128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507713004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler209)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507713097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler209)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507713135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507713166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507713189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x40a41aa9 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507713216\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507713240\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507713259\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507713280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713336\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713359\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507713383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +876ms\"\n },\n {\n \"at\": \"1789227507713402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227507713432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507713486\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507713525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713544\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713564\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713584\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507713605\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507713654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713673\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713760\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713773\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713788\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507713805\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +876ms\"\n },\n {\n \"at\": \"1789227507713824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227507713840\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507713868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507713896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507713944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507713962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00195|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507714008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507714018\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507714027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507714037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507714047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507714057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507714101\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507714132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507714141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714151\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507714161\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714171\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507714190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714209\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507720388\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00196|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507720400\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507720409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507720420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507720428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507720441\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507720451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720461\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507720492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507720501\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507720513\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507720524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507720534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720543\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507720555\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507720566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507720575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507720587\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720606\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507815260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler209)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507815357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler209)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507815379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227507815395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507815408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb042e51c your_disc:0x89809725\"\n },\n {\n \"at\": \"1789227507815420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507815436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507815468\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507815482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507815505\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889679ms\"\n },\n {\n \"at\": \"1789227507815537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +775ms\"\n },\n {\n \"at\": \"1789227507815552\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227507815567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507815582\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507815596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507815633\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815648\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507815678\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227507815696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815712\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507815726\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507815742\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815757\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815770\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler209)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507815781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507815791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815800\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507815810\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815819\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815830\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507815847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +775ms\"\n },\n {\n \"at\": \"1789227507815858\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227507815873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507815881\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507815891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815901\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507815911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815921\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507815947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227507815958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507815977\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815986\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508538879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler209)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508539181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler209)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508539204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508539220\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508539236\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x3eb441ca your_disc:0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539264\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508539288\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539309\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539327\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590890402ms\"\n },\n {\n \"at\": \"1789227508539340\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +72ms\"\n },\n {\n \"at\": \"1789227508539351\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -728ms\"\n },\n {\n \"at\": \"1789227508539363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539373\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539435\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508539448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508539462\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508539496\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508539505\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler209)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508539539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508539552\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539562\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539571\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508539600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +72ms\"\n },\n {\n \"at\": \"1789227508539609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -728ms\"\n },\n {\n \"at\": \"1789227508539625\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539646\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539664\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508539694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508539704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508539723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539742\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227509463186\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227509463362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227509463389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227509463410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227509463436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227509463464\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227509463492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227509463530\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +856ms\"\n },\n {\n \"at\": \"1789227509463561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -64ms\"\n },\n {\n \"at\": \"1789227509463589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227509463616\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227509463651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227509463667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227509463683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463699\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227509463729\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227509463746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227509463765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227509463782\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227509463795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:35.155802+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-before-probe.txt", "router_mac": "10:66:6a:74:95:5e", "at": "2026-09-12T15:38:35.156438+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.129, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:38:28.512881335Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:38:29.367733407Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:38:29.623502575Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:38:30.251599733Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:35.285111+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 85416, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T15:38:35.400601+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 13.616, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.110 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\nelapsed_seconds=0.086 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c71cb648-f999-4c0d-9b33-333a5829fc16\",\"volatile.eth0.host_name\":\"veth1af313e3\",\"volatile.eth0.hwaddr\":\"10:66:6a:c1:3a:bb\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\"volatile.uuid.generation\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:38:28.512881335Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c71cb648-f999-4c0d-9b33-333a5829fc16\",\"volatile.eth0.host_name\":\"veth1af313e3\",\"volatile.eth0.hwaddr\":\"10:66:6a:c1:3a:bb\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\"volatile.uuid.generation\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:38:29.367733407Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9461760,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fec1:3abb\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:c1:3a:bb\",\"host_name\":\"veth1af313e3\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4175526,\"processes\":4,\"cpu\":{\"usage\":477770000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:38:28.390000104Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\"volatile.eth0.host_name\":\"veth00b99e0c\",\"volatile.eth0.hwaddr\":\"10:66:6a:23:36:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\",\"volatile.uuid.generation\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:38:29.623502575Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\"volatile.eth0.host_name\":\"veth00b99e0c\",\"volatile.eth0.hwaddr\":\"10:66:6a:23:36:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\",\"volatile.uuid.generation\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:38:30.251599733Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11243520,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe23:36e5\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:23:36:e5\",\"host_name\":\"veth00b99e0c\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":33927,\"processes\":4,\"cpu\":{\"usage\":499957000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:38:30.25999999Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.096 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.217 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.233 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=0.977 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.667 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.391 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.391/0.678/0.977 ms\nelapsed_seconds=2.237 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.254 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.884 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.378 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.378/0.838/1.254 ms\nelapsed_seconds=2.198 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.165 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.603 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.891 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.891/1.553/2.165 ms\nelapsed_seconds=2.350 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.300 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.553 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.846 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.846/1.566/2.300 ms\nelapsed_seconds=2.487 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.184 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.225 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.294 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.323 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.028 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.115235 bytes_per_second=867791903\nelapsed_seconds=0.368 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.480 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.144505 bytes_per_second=692017577\nelapsed_seconds=0.404 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.474 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.016998+00:00"} +{"capture": "tcpdump-arp", "pid": 85416, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T15:38:49.019345+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.1, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.119652+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.084, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:c1:3a:bb |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:23:36:e5 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.203946+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.107, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 9c7fd63d-02e5-4725-89d8-20a93b5b4c22 (incus-net33-ls-int)\n port incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0\n addresses: [\"10:66:6a:23:36:e5 dynamic\"]\n port incus-net33-ls-int-lsp-router\n type: router\n router-port: incus-net33-lr-lrp-int\n port incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0\n addresses: [\"10:66:6a:c1:3a:bb dynamic\"]\nswitch c00fa569-4968-411f-ac26-a8e96a3fc785 (incus-net33-ls-ext)\n port incus-net33-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net33-ls-ext-lsp-router\n type: router\n router-port: incus-net33-lr-lrp-ext\nrouter 23008478-d6de-4cf9-9c72-49b77c3c9e77 (incus-net33-lr)\n port incus-net33-lr-lrp-ext\n mac: \"10:66:6a:74:95:5e\"\n ipv6-lla: \"fe80::1266:6aff:fe74:955e\"\n networks: [\"10.10.40.64/24\"]\n port incus-net33-lr-lrp-int\n mac: \"10:66:6a:74:95:5e\"\n ipv6-lla: \"fe80::1266:6aff:fe74:955e\"\n networks: [\"10.253.73.1/24\"]\n nat 927155e2-a0a4-4858-9bff-3ed132cfbb8c\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net33-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 213ce4ec-49aa-4056-ab31-2753ba6265ea\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f5542e8a-f5b9-47ed-bf7e-79796b6cac96\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:74:95:5e\"\nname : incus-net33-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n\n_uuid : 24f02c6b-fdff-4373-956e-0d2c02b266d4\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:74:95:5e\"\nname : incus-net33-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : c3a4712b-0df6-4eee-b28e-298666393faf\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : a68ceb67-150e-485e-9708-75c40ff8fa4d\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f35549ad-87de-45c6-a476-95d37d94d468\nlogical_port : cr-incus-net33-lr-lrp-ext\nmac : [\"10:66:6a:74:95:5e 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net33-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:74:95:5e STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.311553+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.253, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:74:95:5e REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.565036+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.191, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507722372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84130|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507722696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84131|bridge|INFO|bridge incusovn16: using datapath ID 0000dad0828f3c4b\"\n },\n {\n \"at\": \"1789227507722724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84132|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507724746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84133|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507724810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507724836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507724854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507724873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507724886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507724899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507724987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507725028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725137\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84134|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507725161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507725172\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507725181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507725199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507725214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507725230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725240\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725270\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507725282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507725330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725338\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725362\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725382\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725395\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725414\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725422\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84135|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507725441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507725456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507725472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507725491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507725505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507725515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725537\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507725562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725580\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507725593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507816983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler196)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507817142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler196)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507817193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507817234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507817270\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x4cb6d301 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507817309\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507817340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507817373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507817403\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507817434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507817474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507817530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507817561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785817ms\"\n },\n {\n \"at\": \"1789227507817608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +728ms\"\n },\n {\n \"at\": \"1789227507817655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -92ms\"\n },\n {\n \"at\": \"1789227507817700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507817730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507817760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507817790\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507817817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507817845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507817877\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507817914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507817956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507817995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507818034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507818065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507818180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507818210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507818280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507818317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507818354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507818397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +728ms\"\n },\n {\n \"at\": \"1789227507818433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -92ms\"\n },\n {\n \"at\": \"1789227507818471\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507818518\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507818549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507818579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507818609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507818708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507818736\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507818765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507818797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84136|dpif|WARN|Dropped 333 log messages in last 142 seconds (most recently, 142 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227507818965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84137|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507819006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84138|bridge|WARN|Dropped 55709 log messages in last 169 seconds (most recently, 142 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227507819038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84139|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227507819357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler196)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507819413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler196)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507819461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507819500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507819536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xda265f98 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507819584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507819617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507819650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507819688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507819716\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507819757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507819789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507819822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785819ms\"\n },\n {\n \"at\": \"1789227507819868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +786ms\"\n },\n {\n \"at\": \"1789227507820245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227507820348\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507820389\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507820426\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507820458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507820671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507820709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507820741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507820773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507820810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507820850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507820888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84141|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227507820924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507820954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507820990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821051\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507821091\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507821122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821151\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507821180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507821218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507821248\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507821279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +786ms\"\n },\n {\n \"at\": \"1789227507821315\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227507821346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507821375\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507821411\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507821451\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507821477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507821584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507821612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507821641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507821673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler196)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507821801\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler196)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507821841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507821880\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507821919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xec809328 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507821961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507821987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507822016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507822048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507822114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785821ms\"\n },\n {\n \"at\": \"1789227507822224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +794ms\"\n },\n {\n \"at\": \"1789227507822263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227507822295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507822324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507822353\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507822390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507822429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822460\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507822530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507822559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507822585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507822615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507822655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507822766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507822797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507822862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507822944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +794ms\"\n },\n {\n \"at\": \"1789227507822970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227507823006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507823034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507823068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507823100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507823133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507823221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507823247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507823282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507823317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507823416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507823883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84143|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507825889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507830590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84145|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227507830635\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227508617643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508617751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508617770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508617786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508617796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508617805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508617826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508617836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +697ms\"\n },\n {\n \"at\": \"1789227508617856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -73ms\"\n },\n {\n \"at\": \"1789227508617886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508617897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508617923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508617935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508617951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508617967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508617978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508617991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508618013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508618026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508618043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508618061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508618080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508690035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508690132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508690157\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508690171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508690187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508690205\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508690224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508690239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +785ms\"\n },\n {\n \"at\": \"1789227508690254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -85ms\"\n },\n {\n \"at\": \"1789227508690277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508690291\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508690309\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508690319\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508690331\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508690385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508690399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508690410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508690420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508690430\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508761179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508761366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508761386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508761400\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508761410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508761431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508761448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508761464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789227508761491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -146ms\"\n },\n {\n \"at\": \"1789227508761515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508761529\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508761543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508761553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508761570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508761612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508761623\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508761637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508761653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508761668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508818644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84147|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227508818688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227509144720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84149|bridge|INFO|bridge br-int: added interface veth1af313e3 on port 30\"\n },\n {\n \"at\": \"1789227509818712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84150|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227509818860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84151|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227510818725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84152|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227510818914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84153|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227511818892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84154|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227511819080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84155|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227512267846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84156|poll_loop|INFO|Dropped 1710 log messages in last 148 seconds (most recently, 145 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227512267929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84157|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512268373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84158|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512268897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512269413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84160|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512269926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84161|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512270439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84162|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512270954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84163|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512271469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84164|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512271983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84165|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512272489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512818925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84167|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227512819138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227513818804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84169|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227513818956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227514139554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84171|bridge|WARN|Dropped 12682 log messages in last 7 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227514139650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84172|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227514818556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84173|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227514818644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227515818548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84175|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227515818765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227516818561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84177|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227516818764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227517725596\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84179|connmgr|INFO|br-int<->unix#7: 887 flow_mods in the 6 s starting 10 s ago (827 adds, 53 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789227517818947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84180|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227517819095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84181|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227518267778\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84182|poll_loop|INFO|Dropped 12199 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227518267872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84183|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227518818532\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84184|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227518818613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84185|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227519818609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84186|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227519818847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84187|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227520818960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84188|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227520819268\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84189|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227521818958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84190|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227521819125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84191|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227522818965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84192|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227522819116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84193|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227523818873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84194|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227523819110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84195|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227524267927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84196|poll_loop|INFO|Dropped 12146 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227524268026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84197|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227524818798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84198|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227524818904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84199|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227525818894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84200|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227525819123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84201|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227526818926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84202|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227526819150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84203|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227527818530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84204|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227527818648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227528818852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84206|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227528819177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84207|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.756596+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.166, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507704380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507704705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00004259e0da4248\"\n },\n {\n \"at\": \"1789227507704737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00185|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507706897\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00186|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507706957\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507706981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507706994\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507707006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507707022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507707035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507707082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507707098\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507707110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507707122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507707131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507707153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507707164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507707177\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507707187\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507707222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507713650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00187|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713732\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507713754\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713798\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713809\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507713819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507713840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713850\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713870\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507713880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713891\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507713902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713913\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713923\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507713937\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713950\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713960\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507714006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507714051\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507714086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507714097\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507714116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714135\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507714146\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714155\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507801672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507801725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227507808580\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507808688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18\"\n },\n {\n \"at\": \"1789227508539423\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler204)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508539562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler204)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508539591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508539621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508539643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xdc9ba2fe your_disc:0xca515c77\"\n },\n {\n \"at\": \"1789227508539665\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508539724\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539743\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539792\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763538ms\"\n },\n {\n \"at\": \"1789227508539839\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +38ms\"\n },\n {\n \"at\": \"1789227508539860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -732ms\"\n },\n {\n \"at\": \"1789227508539880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539922\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508539959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539977\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508540022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508540045\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508540084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508540103\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508540145\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler204)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508540165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508540183\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508540200\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508540218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508540235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508540253\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508540277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +38ms\"\n },\n {\n \"at\": \"1789227508540296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -732ms\"\n },\n {\n \"at\": \"1789227508540314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508540333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508540357\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540376\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508540459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508540512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508540529\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540548\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508540566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540587\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584221\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler204)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508584298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler204)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508584327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508584350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508584374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x497f288e your_disc:0x40a41aa9\"\n },\n {\n \"at\": \"1789227508584414\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508584437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508584463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508584484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508584525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508584544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508584565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763583ms\"\n },\n {\n \"at\": \"1789227508584586\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227508584608\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789227508584631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508584651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508584672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508584694\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227508584716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584735\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508584775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508584793\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508584813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227508584836\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508584856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler204)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508584926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508584947\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508584987\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508585008\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508585029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508585051\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227508585072\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789227508585092\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508585116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508585136\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508585189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227508585211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508585268\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508585290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508585310\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227508585331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler204)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508593458\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler204)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508593474\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508593484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508593494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x81e3b173 your_disc:0xda265f98\"\n },\n {\n \"at\": \"1789227508593504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508593514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508593523\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508593534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508593553\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593563\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593572\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763592ms\"\n },\n {\n \"at\": \"1789227508593585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +54ms\"\n },\n {\n \"at\": \"1789227508593595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -786ms\"\n },\n {\n \"at\": \"1789227508593612\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508593621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508593630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508593651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593661\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508593679\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508593688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508593711\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508593721\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593741\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler204)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508593758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508593768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508593789\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593798\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508593819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +54ms\"\n },\n {\n \"at\": \"1789227508593833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -786ms\"\n },\n {\n \"at\": \"1789227508593843\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508593852\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508593864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593873\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508593884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593894\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508593917\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508593926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593935\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508593944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593954\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593965\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227517709422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00193|connmgr|INFO|br-int<->unix#7: 903 flow_mods in the 6 s starting 10 s ago (836 adds, 59 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:49.923084+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.181, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507707789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00201|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507707984\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00202|bridge|INFO|bridge incusovn16: using datapath ID 000072a4e283cf43\"\n },\n {\n \"at\": \"1789227507708012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00203|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507710639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00204|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507710681\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507710698\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507710712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507710726\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507710737\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507710749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710790\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710803\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507710826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507710837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507710849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507710861\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507710872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710885\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507710895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507710905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507710917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507710928\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710941\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507710966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00205|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507710980\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507710993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507711004\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507711015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507711025\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507711036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711048\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711063\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711075\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507711086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507711096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507711108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507711120\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507711131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711142\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507711152\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507711162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507711173\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507711185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507711196\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711216\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507717597\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00206|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507717644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507717657\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507717667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507717678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507717691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507717702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717713\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717724\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717741\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507717752\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507717768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507717778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507717789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507717800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717812\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507717823\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507717833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507717843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507717855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507804643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507804692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227507806329\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler199)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507806399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler199)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507806433\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507806465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507806496\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x89809725 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507806522\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507806549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507806573\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507806601\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507806627\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507806651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507806674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507806707\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507806811\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507806837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507806864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507806887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507806911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507806978\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507807004\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507807032\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807055\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507807089\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507807113\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807141\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507807174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507807200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507807224\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507807248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507807271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507807297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507807320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507807347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507807374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507807397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507807420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507807444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507807487\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507807559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507807579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507807625\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler199)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507809238\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler199)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507809274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507809300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507809324\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xca515c77 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507809350\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507809377\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507809398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507809421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507809474\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507809497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507809520\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662807ms\"\n },\n {\n \"at\": \"1789227507809543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +731ms\"\n },\n {\n \"at\": \"1789227507809568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227507809598\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507809620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507809644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507809665\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507809694\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809720\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507809775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507809798\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507809824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507809849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507809873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809898\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507809947\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507809972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507810018\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507810039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507810070\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507810095\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +731ms\"\n },\n {\n \"at\": \"1789227507810119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227507810142\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507810164\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507810187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507810217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507810240\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507810311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507810342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507810363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507810386\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810409\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810430\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507811441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507811536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00210|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227508589288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508589394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508589425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508589451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508589477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508589503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508589534\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508589557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227508589586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49ms\"\n },\n {\n \"at\": \"1789227508589610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508589635\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508589663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508589685\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508589708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589729\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508589773\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508589805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508589828\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508589850\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508589873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler199)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508605367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler199)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508605382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508605397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508605408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xe78f835 your_disc:0xec809328\"\n },\n {\n \"at\": \"1789227508605425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508605438\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508605449\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508605462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508605486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49663603ms\"\n },\n {\n \"at\": \"1789227508605523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789227508605544\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -795ms\"\n },\n {\n \"at\": \"1789227508605557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508605570\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508605581\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508605609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605633\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508605646\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508605659\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605672\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508605684\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508605696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605707\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler199)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508605733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508605744\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605756\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508605768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605791\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508605808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789227508605822\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -795ms\"\n },\n {\n \"at\": \"1789227508605833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508605845\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508605856\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605868\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508605880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605903\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508605915\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508605926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508605949\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508647285\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508647375\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508647407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508647439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508647462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508647485\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508647513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508647534\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +73ms\"\n },\n {\n \"at\": \"1789227508647563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -837ms\"\n },\n {\n \"at\": \"1789227508647588\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508647611\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508647636\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508647662\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227508647686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647710\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508647755\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508647778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508647805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227508647826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508647850\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647871\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227510169696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00211|bridge|INFO|bridge br-int: added interface veth00b99e0c on port 28\"\n },\n {\n \"at\": \"1789227517713244\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00212|connmgr|INFO|br-int<->unix#7: 892 flow_mods in the 6 s starting 10 s ago (829 adds, 55 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:50.104186+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.173, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507517047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00187|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507517197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00188|bridge|INFO|bridge incusovn16: using datapath ID 00001e51c01ceb4a\"\n },\n {\n \"at\": \"1789227507517217\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00189|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507615058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507615174\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227507620318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507620366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227507708466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00194|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507708514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507708534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507708550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507708561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507708573\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507708584\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708605\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708617\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507708628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507708639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507708650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507708661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507708679\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507708702\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507708713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507708724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507708734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708757\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507709128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507713004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler209)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507713097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler209)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507713135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507713166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507713189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x40a41aa9 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507713216\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507713240\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507713259\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507713280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713336\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713359\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507713383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +876ms\"\n },\n {\n \"at\": \"1789227507713402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227507713432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507713486\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507713525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713544\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713564\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713584\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507713605\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507713654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713673\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713760\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713773\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713788\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507713805\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +876ms\"\n },\n {\n \"at\": \"1789227507713824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227507713840\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507713868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507713896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507713944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507713962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00195|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507714008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507714018\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507714027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507714037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507714047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507714057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507714101\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507714132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507714141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714151\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507714161\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714171\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507714190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714209\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507720388\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00196|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507720400\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507720409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507720420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507720428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507720441\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507720451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720461\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507720492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507720501\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507720513\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507720524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507720534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720543\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507720555\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507720566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507720575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507720587\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720606\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507815260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler209)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507815357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler209)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507815379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227507815395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507815408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb042e51c your_disc:0x89809725\"\n },\n {\n \"at\": \"1789227507815420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507815436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507815468\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507815482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507815505\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889679ms\"\n },\n {\n \"at\": \"1789227507815537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +775ms\"\n },\n {\n \"at\": \"1789227507815552\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227507815567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507815582\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507815596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507815633\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815648\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507815678\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227507815696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815712\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507815726\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507815742\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815757\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815770\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler209)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507815781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507815791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815800\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507815810\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815819\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815830\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507815847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +775ms\"\n },\n {\n \"at\": \"1789227507815858\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227507815873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507815881\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507815891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815901\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507815911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815921\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507815947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227507815958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507815977\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815986\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508538879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler209)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508539181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler209)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508539204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508539220\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508539236\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x3eb441ca your_disc:0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539264\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508539288\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539309\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539327\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590890402ms\"\n },\n {\n \"at\": \"1789227508539340\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +72ms\"\n },\n {\n \"at\": \"1789227508539351\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -728ms\"\n },\n {\n \"at\": \"1789227508539363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539373\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539435\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508539448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508539462\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508539496\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508539505\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler209)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508539539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508539552\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539562\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539571\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508539600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +72ms\"\n },\n {\n \"at\": \"1789227508539609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -728ms\"\n },\n {\n \"at\": \"1789227508539625\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539646\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539664\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508539694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508539704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508539723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539742\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227509463186\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227509463362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227509463389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227509463410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227509463436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227509463464\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227509463492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227509463530\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +856ms\"\n },\n {\n \"at\": \"1789227509463561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -64ms\"\n },\n {\n \"at\": \"1789227509463589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227509463616\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227509463651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227509463667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227509463683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463699\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227509463729\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227509463746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227509463765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227509463782\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227509463795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227517521324\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00197|connmgr|INFO|br-int<->unix#7: 972 flow_mods in the 6 s starting 10 s ago (866 adds, 104 deletes, 2 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:50.278066+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-probe.txt", "router_mac": "10:66:6a:74:95:5e", "at": "2026-09-12T15:38:50.279296+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 86786, "ready": true, "ready_signal": "time=\"2026-09-12T08:38:50-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:38:50.366594+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/topology.jsonl", "destroy"], "seconds": 3.47, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:53.836450+00:00"} +{"capture": "monitor-delete", "pid": 86786, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.log", "ready_signal": "time=\"2026-09-12T08:38:50-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:38:53.841480+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.089, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:38:53.930972+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:38:54.017023+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.122, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:74:95:5e STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:38:54.139607+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.315, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:74:95:5e REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:38:54.455293+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.202, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507722372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84130|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507722696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84131|bridge|INFO|bridge incusovn16: using datapath ID 0000dad0828f3c4b\"\n },\n {\n \"at\": \"1789227507722724\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84132|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507724746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84133|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507724810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507724836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507724854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507724873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507724886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507724899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507724969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507724987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507725028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725137\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84134|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507725161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507725172\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507725181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507725199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507725214\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507725230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725240\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725270\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507725282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507725330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725338\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725362\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725382\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725395\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725414\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725422\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84135|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507725441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507725456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507725472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507725491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507725505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507725515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725537\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541785725ms\"\n },\n {\n \"at\": \"1789227507725553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507725562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725580\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507725593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507725608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507725632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507725643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507725658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507725674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507725692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507725702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507816983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler196)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507817142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler196)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507817193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507817234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507817270\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x4cb6d301 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507817309\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507817340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507817373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507817403\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507817434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507817474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507817530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507817561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785817ms\"\n },\n {\n \"at\": \"1789227507817608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +728ms\"\n },\n {\n \"at\": \"1789227507817655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -92ms\"\n },\n {\n \"at\": \"1789227507817700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507817730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507817760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507817790\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507817817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507817845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507817877\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507817914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507817956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507817995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507818034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507818065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507818180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507818210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507818280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507818317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507818354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507818397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +728ms\"\n },\n {\n \"at\": \"1789227507818433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -92ms\"\n },\n {\n \"at\": \"1789227507818471\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507818518\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507818549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507818579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227507818609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507818708\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507818736\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507818765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507818797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507818878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507818914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84136|dpif|WARN|Dropped 333 log messages in last 142 seconds (most recently, 142 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227507818965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84137|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507819006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84138|bridge|WARN|Dropped 55709 log messages in last 169 seconds (most recently, 142 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227507819038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84139|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227507819357\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler196)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507819413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler196)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507819461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507819500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507819536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xda265f98 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507819584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507819617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507819650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507819688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507819716\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507819757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507819789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507819822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785819ms\"\n },\n {\n \"at\": \"1789227507819868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +786ms\"\n },\n {\n \"at\": \"1789227507820245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227507820348\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507820389\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507820426\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507820458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507820671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507820709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507820741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507820773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507820810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507820850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507820888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84141|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227507820924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507820954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507820990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821051\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507821091\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507821122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821151\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507821180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507821218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507821248\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507821279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +786ms\"\n },\n {\n \"at\": \"1789227507821315\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -94ms\"\n },\n {\n \"at\": \"1789227507821346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507821375\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507821411\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507821451\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227507821477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507821584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507821612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507821641\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507821673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507821734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507821771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler196)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507821801\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler196)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507821841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507821880\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507821919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xec809328 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507821961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507821987\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507822016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507822048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507822114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541785821ms\"\n },\n {\n \"at\": \"1789227507822224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +794ms\"\n },\n {\n \"at\": \"1789227507822263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227507822295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507822324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507822353\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507822390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507822429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822460\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507822530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507822559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507822585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507822615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507822655\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507822690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507822766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507822797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507822832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507822862\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507822915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507822944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +794ms\"\n },\n {\n \"at\": \"1789227507822970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227507823006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507823034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507823068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507823100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227507823133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507823221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507823247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507823282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507823317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507823384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507823416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507823883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84143|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507825889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227507830590\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84145|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227507830635\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227508617643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508617751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508617770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508617786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508617796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508617805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508617826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508617836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +697ms\"\n },\n {\n \"at\": \"1789227508617856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -73ms\"\n },\n {\n \"at\": \"1789227508617886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508617897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508617923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508617935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508617951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508617967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508617978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508617991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508618013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508618026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508618043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508618061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508618080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508690035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508690132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508690157\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508690171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508690187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508690205\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508690224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508690239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +785ms\"\n },\n {\n \"at\": \"1789227508690254\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -85ms\"\n },\n {\n \"at\": \"1789227508690277\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508690291\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508690309\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508690319\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508690331\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690352\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508690385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508690399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508690410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508690420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508690430\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508690448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508761179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508761366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508761386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508761400\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508761410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508761431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508761448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508761464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789227508761491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -146ms\"\n },\n {\n \"at\": \"1789227508761515\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508761529\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508761543\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508761553\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508761570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508761612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508761623\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508761637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508761653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508761668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508761678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508818644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84147|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227508818688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227509144720\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84149|bridge|INFO|bridge br-int: added interface veth1af313e3 on port 30\"\n },\n {\n \"at\": \"1789227509818712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84150|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227509818860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84151|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227510818725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84152|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227510818914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84153|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227511818892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84154|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227511819080\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84155|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227512267846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84156|poll_loop|INFO|Dropped 1710 log messages in last 148 seconds (most recently, 145 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227512267929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84157|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512268373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84158|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512268897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512269413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84160|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512269926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84161|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512270439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84162|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512270954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84163|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512271469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84164|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512271983\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84165|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512272489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227512818925\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84167|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227512819138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227513818804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84169|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227513818956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227514139554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84171|bridge|WARN|Dropped 12682 log messages in last 7 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227514139650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84172|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227514818556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84173|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227514818644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227515818548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84175|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227515818765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227516818561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84177|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227516818764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227517725596\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84179|connmgr|INFO|br-int<->unix#7: 887 flow_mods in the 6 s starting 10 s ago (827 adds, 53 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789227517818947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84180|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227517819095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84181|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227518267778\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84182|poll_loop|INFO|Dropped 12199 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227518267872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84183|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227518818532\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84184|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227518818613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84185|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227519818609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84186|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227519818847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84187|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227520818960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84188|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227520819268\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84189|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227521818958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84190|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227521819125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84191|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227522818965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84192|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227522819116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84193|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227523818873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84194|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227523819110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84195|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227524267927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84196|poll_loop|INFO|Dropped 12146 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227524268026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84197|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227524818798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84198|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227524818904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84199|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227525818894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84200|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227525819123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84201|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227526818926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84202|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227526819150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84203|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227527818530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84204|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227527818648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227528818852\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84206|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227528819177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84207|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227529818750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84208|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227529818909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84209|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227530267692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84210|poll_loop|INFO|Dropped 12224 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227530267798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84211|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227530818747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84212|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227530818846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84213|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227531067372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84214|bridge|INFO|bridge br-int: deleted interface veth1af313e3 on port 30\"\n },\n {\n \"at\": \"1789227531818621\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84215|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227531818725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84216|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227532818646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84217|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227532818845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84218|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227533272378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84219|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227533272417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84220|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227533294185\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789227533297970\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84221|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:54.657460+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.167, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507704380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507704705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00004259e0da4248\"\n },\n {\n \"at\": \"1789227507704737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00185|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507706897\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00186|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507706957\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507706981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507706994\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507707006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507707022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507707035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762706ms\"\n },\n {\n \"at\": \"1789227507707071\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507707082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507707098\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507707110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507707122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507707131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507707153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507707164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507707177\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507707187\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507707211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507707222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507713650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00187|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713723\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713732\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507713754\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507713798\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713809\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507713819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507713840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713850\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713870\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507713880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713891\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507713902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713913\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713923\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507713937\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713950\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713960\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713984\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507714006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590762713ms\"\n },\n {\n \"at\": \"1789227507714042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507714051\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227507714086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507714097\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507714116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714135\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507714146\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714155\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507801672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507801725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227507808580\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507808688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18\"\n },\n {\n \"at\": \"1789227508539423\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler204)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508539562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler204)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508539591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508539621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508539643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xdc9ba2fe your_disc:0xca515c77\"\n },\n {\n \"at\": \"1789227508539665\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508539724\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539743\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539792\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763538ms\"\n },\n {\n \"at\": \"1789227508539839\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +38ms\"\n },\n {\n \"at\": \"1789227508539860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -732ms\"\n },\n {\n \"at\": \"1789227508539880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539922\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508539959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539977\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508540022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508540045\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508540084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508540103\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508540145\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler204)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508540165\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508540183\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508540200\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508540218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508540235\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508540253\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508540277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +38ms\"\n },\n {\n \"at\": \"1789227508540296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -732ms\"\n },\n {\n \"at\": \"1789227508540314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508540333\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508540357\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540376\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508540459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540478\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508540512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508540529\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508540548\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508540566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540587\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508540603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584221\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler204)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508584298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler204)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508584327\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508584350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508584374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x497f288e your_disc:0x40a41aa9\"\n },\n {\n \"at\": \"1789227508584414\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508584437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508584463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508584484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508584525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508584544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508584565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763583ms\"\n },\n {\n \"at\": \"1789227508584586\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227508584608\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789227508584631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508584651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508584672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508584694\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227508584716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584735\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508584775\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508584793\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508584813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227508584836\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508584856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508584877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler204)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508584926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508584947\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508584967\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508584987\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508585008\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508585029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508585051\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227508585072\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -77ms\"\n },\n {\n \"at\": \"1789227508585092\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508585116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508585136\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508585189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227508585211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508585268\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508585290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508585310\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227508585331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508585370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler204)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508593458\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler204)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508593474\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508593484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508593494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x81e3b173 your_disc:0xda265f98\"\n },\n {\n \"at\": \"1789227508593504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508593514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508593523\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508593534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593544\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508593553\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593563\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593572\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590763592ms\"\n },\n {\n \"at\": \"1789227508593585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +54ms\"\n },\n {\n \"at\": \"1789227508593595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -786ms\"\n },\n {\n \"at\": \"1789227508593612\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508593621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508593630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508593651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593661\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508593679\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508593688\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508593711\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508593721\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593741\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler204)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508593758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508593768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508593778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508593789\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593798\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508593808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508593819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +54ms\"\n },\n {\n \"at\": \"1789227508593833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -786ms\"\n },\n {\n \"at\": \"1789227508593843\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508593852\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508593864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593873\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xda265f98\"\n },\n {\n \"at\": \"1789227508593884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593894\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508593917\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508593926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508593935\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x81e3b173\"\n },\n {\n \"at\": \"1789227508593944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593954\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508593965\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227517709422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00193|connmgr|INFO|br-int<->unix#7: 903 flow_mods in the 6 s starting 10 s ago (836 adds, 59 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789227533262962\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00194|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227533263174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00195|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227533263198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00196|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227533279240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00197|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18\"\n },\n {\n \"at\": \"1789227533279374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:54.825254+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.184, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507707789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00201|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507707984\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00202|bridge|INFO|bridge incusovn16: using datapath ID 000072a4e283cf43\"\n },\n {\n \"at\": \"1789227507708012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00203|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507710639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00204|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507710681\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507710698\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507710712\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507710726\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507710737\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507710749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710790\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710803\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507710814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507710826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507710837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507710849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507710861\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507710872\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710885\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507710895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507710905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507710917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507710928\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710941\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507710953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507710966\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00205|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507710980\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507710993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507711004\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507711015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507711025\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507711036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711048\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711063\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662708ms\"\n },\n {\n \"at\": \"1789227507711075\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507711086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507711096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507711108\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507711120\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507711131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711142\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507711152\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507711162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507711173\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507711185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507711196\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507711216\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507717597\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00206|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507717644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507717657\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507717667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507717678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507717691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507717702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717713\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717724\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662715ms\"\n },\n {\n \"at\": \"1789227507717741\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507717752\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507717768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507717778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227507717789\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507717800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717812\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507717823\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507717833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507717843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507717855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507717875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507804643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507804692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227507806329\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler199)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507806399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler199)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507806433\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507806465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507806496\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x89809725 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507806522\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507806549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507806573\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507806601\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507806627\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507806651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507806674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507806707\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507806788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507806811\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507806837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507806864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507806887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507806911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507806978\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507807004\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507807032\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807055\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507807089\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507807113\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807141\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507807174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507807200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507807224\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507807248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507807271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507807297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507807320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507807347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507807374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49662804ms\"\n },\n {\n \"at\": \"1789227507807397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507807420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507807444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507807487\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507807559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507807579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507807602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507807625\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807652\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507807675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler199)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507809238\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler199)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507809274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507809300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507809324\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xca515c77 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507809350\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507809377\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507809398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507809421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507809474\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507809497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507809520\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49662807ms\"\n },\n {\n \"at\": \"1789227507809543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +731ms\"\n },\n {\n \"at\": \"1789227507809568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227507809598\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507809620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507809644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507809665\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507809694\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809720\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507809775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507809798\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507809824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507809849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507809873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507809898\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507809947\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507809972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507809995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507810018\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507810039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507810070\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507810095\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +731ms\"\n },\n {\n \"at\": \"1789227507810119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227507810142\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507810164\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507810187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507810217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227507810240\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507810311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507810342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507810363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227507810386\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810409\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507810430\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507811441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507811536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00210|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227508589288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508589394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508589425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508589451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508589477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508589503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508589534\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508589557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +891ms\"\n },\n {\n \"at\": \"1789227508589586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49ms\"\n },\n {\n \"at\": \"1789227508589610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508589635\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508589663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508589685\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xdc9ba2fe\"\n },\n {\n \"at\": \"1789227508589708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589729\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508589773\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508589805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508589828\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xca515c77\"\n },\n {\n \"at\": \"1789227508589850\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508589873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508589896\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler199)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508605367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler199)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508605382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508605397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508605408\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xe78f835 your_disc:0xec809328\"\n },\n {\n \"at\": \"1789227508605425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508605438\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508605449\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508605462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508605486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49663603ms\"\n },\n {\n \"at\": \"1789227508605523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789227508605544\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -795ms\"\n },\n {\n \"at\": \"1789227508605557\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508605570\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508605581\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508605609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605633\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508605646\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508605659\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605672\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508605684\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508605696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605707\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler199)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508605733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508605744\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508605756\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508605768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508605791\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508605808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789227508605822\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -795ms\"\n },\n {\n \"at\": \"1789227508605833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508605845\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508605856\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605868\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xec809328\"\n },\n {\n \"at\": \"1789227508605880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605903\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508605915\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508605926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508605936\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe78f835\"\n },\n {\n \"at\": \"1789227508605949\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508605972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508647285\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508647375\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508647407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508647439\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508647462\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508647485\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508647513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508647534\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +73ms\"\n },\n {\n \"at\": \"1789227508647563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -837ms\"\n },\n {\n \"at\": \"1789227508647588\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508647611\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227508647636\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508647662\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227508647686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647710\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508647755\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227508647778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508647805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227508647826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227508647850\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508647871\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227510169696\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00211|bridge|INFO|bridge br-int: added interface veth00b99e0c on port 28\"\n },\n {\n \"at\": \"1789227517713244\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00212|connmgr|INFO|br-int<->unix#7: 892 flow_mods in the 6 s starting 10 s ago (829 adds, 55 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789227532085225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00213|bridge|INFO|bridge br-int: deleted interface veth00b99e0c on port 28\"\n },\n {\n \"at\": \"1789227533266001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00214|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227533266259\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00215|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227533266452\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00216|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227533282645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00217|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27\"\n },\n {\n \"at\": \"1789227533282820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:55.010334+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A38%3A25.277858%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.17, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227507517047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00187|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227507517197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00188|bridge|INFO|bridge incusovn16: using datapath ID 00001e51c01ceb4a\"\n },\n {\n \"at\": \"1789227507517217\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00189|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227507615058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00190|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227507615174\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00191|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227507620318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00192|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227507620366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00193|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227507708466\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00194|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507708514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507708534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507708550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507708561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507708573\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507708584\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708605\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889572ms\"\n },\n {\n \"at\": \"1789227507708617\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507708628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507708639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507708650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507708661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507708679\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507708702\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507708713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507708724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507708734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507708757\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507709128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227507713004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler209)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507713097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler209)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507713135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227507713166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507713189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x40a41aa9 your_disc:0x0\"\n },\n {\n \"at\": \"1789227507713216\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507713240\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507713259\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507713280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713336\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713359\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507713383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +876ms\"\n },\n {\n \"at\": \"1789227507713402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227507713432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507713486\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507713525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713544\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713564\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713584\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507713605\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507713654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507713673\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507713724\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507713733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507713760\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713773\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507713788\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507713805\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +876ms\"\n },\n {\n \"at\": \"1789227507713824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227507713840\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507713854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507713868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227507713896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507713934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227507713944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507713952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227507713962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507713987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507713997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00195|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507714008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507714018\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507714027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507714037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507714047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507714057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889577ms\"\n },\n {\n \"at\": \"1789227507714092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507714101\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507714132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507714141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714151\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507714161\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507714171\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507714181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507714190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507714209\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507720388\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00196|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507720400\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507720409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507720420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507720428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507720441\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227507720451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720461\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590889584ms\"\n },\n {\n \"at\": \"1789227507720482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507720492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227507720501\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507720513\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227507720524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507720534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720543\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507720555\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227507720566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507720575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227507720587\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507720606\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227507815260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler209)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227507815357\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler209)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227507815379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227507815395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227507815408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb042e51c your_disc:0x89809725\"\n },\n {\n \"at\": \"1789227507815420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507815436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227507815468\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227507815482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507815505\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815516\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590889679ms\"\n },\n {\n \"at\": \"1789227507815537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +775ms\"\n },\n {\n \"at\": \"1789227507815552\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227507815567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507815582\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507815596\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507815633\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815648\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507815678\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227507815696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815712\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507815726\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227507815742\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815757\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815770\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler209)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227507815781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227507815791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227507815800\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227507815810\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815819\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227507815830\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227507815847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +775ms\"\n },\n {\n \"at\": \"1789227507815858\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227507815873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227507815881\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227507815891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815901\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x89809725\"\n },\n {\n \"at\": \"1789227507815911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815921\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227507815947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227507815958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227507815968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb042e51c\"\n },\n {\n \"at\": \"1789227507815977\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815986\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227507815996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508538879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler209)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227508539181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler209)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227508539204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227508539220\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227508539236\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x3eb441ca your_disc:0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539264\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227508539279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227508539288\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539309\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539327\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590890402ms\"\n },\n {\n \"at\": \"1789227508539340\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +72ms\"\n },\n {\n \"at\": \"1789227508539351\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -728ms\"\n },\n {\n \"at\": \"1789227508539363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539373\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539435\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508539448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508539462\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508539496\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227508539505\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler209)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227508539539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227508539552\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227508539562\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227508539571\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227508539590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227508539600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +72ms\"\n },\n {\n \"at\": \"1789227508539609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -728ms\"\n },\n {\n \"at\": \"1789227508539625\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227508539635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227508539646\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539654\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cb6d301\"\n },\n {\n \"at\": \"1789227508539664\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227508539694\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227508539704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227508539714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x3eb441ca\"\n },\n {\n \"at\": \"1789227508539723\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227508539742\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227509463186\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227509463362\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227509463389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227509463410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227509463436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227509463464\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227509463492\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227509463530\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +856ms\"\n },\n {\n \"at\": \"1789227509463561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -64ms\"\n },\n {\n \"at\": \"1789227509463589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227509463616\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227509463651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227509463667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x497f288e\"\n },\n {\n \"at\": \"1789227509463683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463699\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227509463729\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227509463746\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227509463765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x40a41aa9\"\n },\n {\n \"at\": \"1789227509463782\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227509463795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227509463817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227517521324\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00197|connmgr|INFO|br-int<->unix#7: 972 flow_mods in the 6 s starting 10 s ago (866 adds, 104 deletes, 2 modifications)\"\n },\n {\n \"at\": \"1789227533274234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00198|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227533274627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00199|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227533274905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00200|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227533302355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00201|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227533302455\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:38:55.181062+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T15:38:55.181943+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/create.stdout.json new file mode 100644 index 0000000..98a6dcc --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.602, + "first_cross_member_ping_seconds": 3.205, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/cycle.json new file mode 100644 index 0000000..4a39463 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T15:38:25.277858+00:00", + "ended_at": "2026-09-12T15:38:55.182289+00:00", + "seconds": 29.904, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:74:95:5e", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.602, + "first_cross_member_ping_seconds": 3.205, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.110 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\nelapsed_seconds=0.086 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c71cb648-f999-4c0d-9b33-333a5829fc16\",\"volatile.eth0.host_name\":\"veth1af313e3\",\"volatile.eth0.hwaddr\":\"10:66:6a:c1:3a:bb\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\"volatile.uuid.generation\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:38:28.512881335Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c71cb648-f999-4c0d-9b33-333a5829fc16\",\"volatile.eth0.host_name\":\"veth1af313e3\",\"volatile.eth0.hwaddr\":\"10:66:6a:c1:3a:bb\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\"volatile.uuid.generation\":\"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:38:29.367733407Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9461760,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fec1:3abb\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:c1:3a:bb\",\"host_name\":\"veth1af313e3\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4175526,\"processes\":4,\"cpu\":{\"usage\":477770000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:38:28.390000104Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\"volatile.eth0.host_name\":\"veth00b99e0c\",\"volatile.eth0.hwaddr\":\"10:66:6a:23:36:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\",\"volatile.uuid.generation\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:38:29.623502575Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\"volatile.eth0.host_name\":\"veth00b99e0c\",\"volatile.eth0.hwaddr\":\"10:66:6a:23:36:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\",\"volatile.uuid.generation\":\"8cf93694-88d2-492c-82b2-f4268a9bce48\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:38:30.251599733Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11243520,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe23:36e5\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:23:36:e5\",\"host_name\":\"veth00b99e0c\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":33927,\"processes\":4,\"cpu\":{\"usage\":499957000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:38:30.25999999Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.096 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.217 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.233 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=0.977 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.667 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.391 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.391/0.678/0.977 ms\nelapsed_seconds=2.237 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.254 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.884 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.378 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.378/0.838/1.254 ms\nelapsed_seconds=2.198 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.165 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.603 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.891 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.891/1.553/2.165 ms\nelapsed_seconds=2.350 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.300 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.553 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.846 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.846/1.566/2.300 ms\nelapsed_seconds=2.487 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.184 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.225 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.294 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.323 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.028 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.115235 bytes_per_second=867791903\nelapsed_seconds=0.368 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.480 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.144505 bytes_per_second=692017577\nelapsed_seconds=0.404 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.474 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 84911, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.log", + "bytes": 175039, + "ready_signal": "time=\"2026-09-12T08:38:25-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:38:25.775177+00:00", + "stopped_at": "2026-09-12T15:38:33.909127+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 85416, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T15:38:35.285905+00:00", + "stopped_at": "2026-09-12T15:38:49.019273+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 86786, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.log", + "bytes": 40913, + "ready_signal": "time=\"2026-09-12T08:38:50-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:38:50.279501+00:00", + "stopped_at": "2026-09-12T15:38:53.841361+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-probe.txt new file mode 100644 index 0000000..43b5160 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-probe.txt @@ -0,0 +1,5661 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:c1:3a:bb | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:23:36:e5 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 9c7fd63d-02e5-4725-89d8-20a93b5b4c22 (incus-net33-ls-int) + port incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0 + addresses: ["10:66:6a:23:36:e5 dynamic"] + port incus-net33-ls-int-lsp-router + type: router + router-port: incus-net33-lr-lrp-int + port incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0 + addresses: ["10:66:6a:c1:3a:bb dynamic"] +switch c00fa569-4968-411f-ac26-a8e96a3fc785 (incus-net33-ls-ext) + port incus-net33-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net33-ls-ext-lsp-router + type: router + router-port: incus-net33-lr-lrp-ext +router 23008478-d6de-4cf9-9c72-49b77c3c9e77 (incus-net33-lr) + port incus-net33-lr-lrp-ext + mac: "10:66:6a:74:95:5e" + ipv6-lla: "fe80::1266:6aff:fe74:955e" + networks: ["10.10.40.64/24"] + port incus-net33-lr-lrp-int + mac: "10:66:6a:74:95:5e" + ipv6-lla: "fe80::1266:6aff:fe74:955e" + networks: ["10.253.73.1/24"] + nat 927155e2-a0a4-4858-9bff-3ed132cfbb8c + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net33-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 213ce4ec-49aa-4056-ab31-2753ba6265ea +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f5542e8a-f5b9-47ed-bf7e-79796b6cac96 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:74:95:5e" +name : incus-net33-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} + +_uuid : 24f02c6b-fdff-4373-956e-0d2c02b266d4 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:74:95:5e" +name : incus-net33-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : c3a4712b-0df6-4eee-b28e-298666393faf +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : a68ceb67-150e-485e-9708-75c40ff8fa4d +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f35549ad-87de-45c6-a476-95d37d94d468 +logical_port : cr-incus-net33-lr-lrp-ext +mac : ["10:66:6a:74:95:5e 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net33-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:74:95:5e STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:74:95:5e REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507722372", + "member": "lab01.glab.lol", + "message": "ovs|84130|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507722696", + "member": "lab01.glab.lol", + "message": "ovs|84131|bridge|INFO|bridge incusovn16: using datapath ID 0000dad0828f3c4b" + }, + { + "at": "1789227507722724", + "member": "lab01.glab.lol", + "message": "ovs|84132|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507724746", + "member": "lab01.glab.lol", + "message": "ovs|84133|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507724810", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507724836", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507724854", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507724873", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507724886", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507724899", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507724929", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507724945", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507724969", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507724987", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725003", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725013", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507725028", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725048", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725062", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725071", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725087", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725100", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725111", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725128", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725137", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725148", + "member": "lab01.glab.lol", + "message": "ovs|84134|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507725161", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507725172", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507725181", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507725199", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507725214", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507725230", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507725240", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507725254", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507725270", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507725282", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725298", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725314", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507725330", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725338", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725352", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725362", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725374", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725382", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725395", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725405", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725414", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725422", + "member": "lab01.glab.lol", + "message": "ovs|84135|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507725441", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507725456", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507725472", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507725491", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507725505", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507725515", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507725528", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507725537", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507725553", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507725562", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725570", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725580", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507725593", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725608", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725617", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725632", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725643", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725658", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725674", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725683", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725692", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725702", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507816983", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler196)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507817142", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler196)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227507817193", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507817234", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507817270", + "member": "lab01.glab.lol", + "message": " my_disc:0x4cb6d301 your_disc:0x0" + }, + { + "at": "1789227507817309", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507817340", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507817373", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507817403", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507817434", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507817474", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507817530", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507817561", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785817ms" + }, + { + "at": "1789227507817608", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +728ms" + }, + { + "at": "1789227507817655", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -92ms" + }, + { + "at": "1789227507817700", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507817730", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507817760", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507817790", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507817817", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507817845", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507817877", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507817914", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507817956", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507817995", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507818034", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507818065", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818104", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507818136", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507818180", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507818210", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507818247", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507818280", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507818317", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507818354", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507818397", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +728ms" + }, + { + "at": "1789227507818433", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -92ms" + }, + { + "at": "1789227507818471", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507818518", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507818549", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507818579", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507818609", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507818641", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818678", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507818708", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507818736", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507818765", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507818797", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507818841", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818878", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507818914", + "member": "lab01.glab.lol", + "message": "ovs|84136|dpif|WARN|Dropped 333 log messages in last 142 seconds (most recently, 142 seconds ago) due to excessive rate" + }, + { + "at": "1789227507818965", + "member": "lab01.glab.lol", + "message": "ovs|84137|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507819006", + "member": "lab01.glab.lol", + "message": "ovs|84138|bridge|WARN|Dropped 55709 log messages in last 169 seconds (most recently, 142 seconds ago) due to excessive rate" + }, + { + "at": "1789227507819038", + "member": "lab01.glab.lol", + "message": "ovs|84139|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227507819357", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler196)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507819413", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler196)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507819461", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507819500", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507819536", + "member": "lab01.glab.lol", + "message": " my_disc:0xda265f98 your_disc:0x0" + }, + { + "at": "1789227507819584", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507819617", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507819650", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507819688", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507819716", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507819757", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507819789", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507819822", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785819ms" + }, + { + "at": "1789227507819868", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +786ms" + }, + { + "at": "1789227507820245", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227507820348", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507820389", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507820426", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507820458", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507820671", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507820709", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507820741", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507820773", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507820810", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507820850", + "member": "lab01.glab.lol", + "message": "ovs|84140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507820888", + "member": "lab01.glab.lol", + "message": "ovs|84141|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227507820924", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227507820954", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507820990", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821021", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507821051", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507821091", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507821122", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507821151", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507821180", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507821218", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507821248", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507821279", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +786ms" + }, + { + "at": "1789227507821315", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227507821346", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507821375", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507821411", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507821451", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507821477", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507821519", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821550", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507821584", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507821612", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507821641", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227507821673", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507821702", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821734", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507821771", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler196)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507821801", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler196)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227507821841", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507821880", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507821919", + "member": "lab01.glab.lol", + "message": " my_disc:0xec809328 your_disc:0x0" + }, + { + "at": "1789227507821961", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507821987", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507822016", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507822048", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507822087", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507822114", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507822153", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507822183", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785821ms" + }, + { + "at": "1789227507822224", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +794ms" + }, + { + "at": "1789227507822263", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227507822295", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507822324", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507822353", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507822390", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507822429", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507822460", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507822500", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507822530", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507822559", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507822585", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227507822615", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507822655", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507822690", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507822729", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507822766", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507822797", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507822832", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507822862", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507822887", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507822915", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507822944", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +794ms" + }, + { + "at": "1789227507822970", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227507823006", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507823034", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507823068", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507823100", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507823133", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507823167", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507823192", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507823221", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507823247", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507823282", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227507823317", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507823346", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507823384", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507823416", + "member": "lab01.glab.lol", + "message": "ovs|84142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507823883", + "member": "lab01.glab.lol", + "message": "ovs|84143|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507825889", + "member": "lab01.glab.lol", + "message": "ovs|84144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507830590", + "member": "lab01.glab.lol", + "message": "ovs|84145|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227507830635", + "member": "lab01.glab.lol", + "message": "ovs|84146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227508617643", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508617751", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508617770", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508617786", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508617796", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508617805", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508617826", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508617836", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +697ms" + }, + { + "at": "1789227508617856", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -73ms" + }, + { + "at": "1789227508617886", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508617897", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508617923", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508617935", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508617951", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508617967", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508617978", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508617991", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508618013", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508618026", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508618043", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508618061", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508618080", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508690035", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508690132", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508690157", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508690171", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508690187", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508690205", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508690224", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508690239", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +785ms" + }, + { + "at": "1789227508690254", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -85ms" + }, + { + "at": "1789227508690277", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508690291", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508690309", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508690319", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227508690331", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508690352", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508690364", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508690385", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508690399", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508690410", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227508690420", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508690430", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508690448", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508761179", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508761366", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508761386", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508761400", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508761410", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508761431", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508761448", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508761464", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789227508761491", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -146ms" + }, + { + "at": "1789227508761515", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508761529", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508761543", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508761553", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227508761570", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508761581", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508761592", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508761612", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508761623", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508761637", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227508761653", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508761668", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508761678", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508818644", + "member": "lab01.glab.lol", + "message": "ovs|84147|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227508818688", + "member": "lab01.glab.lol", + "message": "ovs|84148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227509144720", + "member": "lab01.glab.lol", + "message": "ovs|84149|bridge|INFO|bridge br-int: added interface veth1af313e3 on port 30" + }, + { + "at": "1789227509818712", + "member": "lab01.glab.lol", + "message": "ovs|84150|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227509818860", + "member": "lab01.glab.lol", + "message": "ovs|84151|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227510818725", + "member": "lab01.glab.lol", + "message": "ovs|84152|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227510818914", + "member": "lab01.glab.lol", + "message": "ovs|84153|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227511818892", + "member": "lab01.glab.lol", + "message": "ovs|84154|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227511819080", + "member": "lab01.glab.lol", + "message": "ovs|84155|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227512267846", + "member": "lab01.glab.lol", + "message": "ovs|84156|poll_loop|INFO|Dropped 1710 log messages in last 148 seconds (most recently, 145 seconds ago) due to excessive rate" + }, + { + "at": "1789227512267929", + "member": "lab01.glab.lol", + "message": "ovs|84157|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512268373", + "member": "lab01.glab.lol", + "message": "ovs|84158|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512268897", + "member": "lab01.glab.lol", + "message": "ovs|84159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512269413", + "member": "lab01.glab.lol", + "message": "ovs|84160|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512269926", + "member": "lab01.glab.lol", + "message": "ovs|84161|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512270439", + "member": "lab01.glab.lol", + "message": "ovs|84162|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512270954", + "member": "lab01.glab.lol", + "message": "ovs|84163|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512271469", + "member": "lab01.glab.lol", + "message": "ovs|84164|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512271983", + "member": "lab01.glab.lol", + "message": "ovs|84165|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512272489", + "member": "lab01.glab.lol", + "message": "ovs|84166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512818925", + "member": "lab01.glab.lol", + "message": "ovs|84167|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227512819138", + "member": "lab01.glab.lol", + "message": "ovs|84168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227513818804", + "member": "lab01.glab.lol", + "message": "ovs|84169|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227513818956", + "member": "lab01.glab.lol", + "message": "ovs|84170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227514139554", + "member": "lab01.glab.lol", + "message": "ovs|84171|bridge|WARN|Dropped 12682 log messages in last 7 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227514139650", + "member": "lab01.glab.lol", + "message": "ovs|84172|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227514818556", + "member": "lab01.glab.lol", + "message": "ovs|84173|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227514818644", + "member": "lab01.glab.lol", + "message": "ovs|84174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227515818548", + "member": "lab01.glab.lol", + "message": "ovs|84175|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227515818765", + "member": "lab01.glab.lol", + "message": "ovs|84176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227516818561", + "member": "lab01.glab.lol", + "message": "ovs|84177|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227516818764", + "member": "lab01.glab.lol", + "message": "ovs|84178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227517725596", + "member": "lab01.glab.lol", + "message": "ovs|84179|connmgr|INFO|br-int<->unix#7: 887 flow_mods in the 6 s starting 10 s ago (827 adds, 53 deletes, 7 modifications)" + }, + { + "at": "1789227517818947", + "member": "lab01.glab.lol", + "message": "ovs|84180|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227517819095", + "member": "lab01.glab.lol", + "message": "ovs|84181|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227518267778", + "member": "lab01.glab.lol", + "message": "ovs|84182|poll_loop|INFO|Dropped 12199 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227518267872", + "member": "lab01.glab.lol", + "message": "ovs|84183|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227518818532", + "member": "lab01.glab.lol", + "message": "ovs|84184|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227518818613", + "member": "lab01.glab.lol", + "message": "ovs|84185|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227519818609", + "member": "lab01.glab.lol", + "message": "ovs|84186|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227519818847", + "member": "lab01.glab.lol", + "message": "ovs|84187|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227520818960", + "member": "lab01.glab.lol", + "message": "ovs|84188|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227520819268", + "member": "lab01.glab.lol", + "message": "ovs|84189|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227521818958", + "member": "lab01.glab.lol", + "message": "ovs|84190|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227521819125", + "member": "lab01.glab.lol", + "message": "ovs|84191|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227522818965", + "member": "lab01.glab.lol", + "message": "ovs|84192|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227522819116", + "member": "lab01.glab.lol", + "message": "ovs|84193|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227523818873", + "member": "lab01.glab.lol", + "message": "ovs|84194|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227523819110", + "member": "lab01.glab.lol", + "message": "ovs|84195|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227524267927", + "member": "lab01.glab.lol", + "message": "ovs|84196|poll_loop|INFO|Dropped 12146 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227524268026", + "member": "lab01.glab.lol", + "message": "ovs|84197|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227524818798", + "member": "lab01.glab.lol", + "message": "ovs|84198|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227524818904", + "member": "lab01.glab.lol", + "message": "ovs|84199|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227525818894", + "member": "lab01.glab.lol", + "message": "ovs|84200|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227525819123", + "member": "lab01.glab.lol", + "message": "ovs|84201|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227526818926", + "member": "lab01.glab.lol", + "message": "ovs|84202|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227526819150", + "member": "lab01.glab.lol", + "message": "ovs|84203|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227527818530", + "member": "lab01.glab.lol", + "message": "ovs|84204|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227527818648", + "member": "lab01.glab.lol", + "message": "ovs|84205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227528818852", + "member": "lab01.glab.lol", + "message": "ovs|84206|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227528819177", + "member": "lab01.glab.lol", + "message": "ovs|84207|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507704380", + "member": "lab02.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507704705", + "member": "lab02.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00004259e0da4248" + }, + { + "at": "1789227507704737", + "member": "lab02.glab.lol", + "message": "ovs|00185|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507706897", + "member": "lab02.glab.lol", + "message": "ovs|00186|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507706957", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507706981", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507706994", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507707006", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507707022", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507707035", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762706ms" + }, + { + "at": "1789227507707047", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762706ms" + }, + { + "at": "1789227507707059", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762706ms" + }, + { + "at": "1789227507707071", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507707082", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507707098", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507707110", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507707122", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507707131", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507707142", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507707153", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507707164", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507707177", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507707187", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507707198", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507707211", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507707222", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507713650", + "member": "lab02.glab.lol", + "message": "ovs|00187|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713712", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713723", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713732", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713744", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507713754", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762713ms" + }, + { + "at": "1789227507713776", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762713ms" + }, + { + "at": "1789227507713786", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762713ms" + }, + { + "at": "1789227507713798", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713809", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507713819", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713828", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227507713840", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713850", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507713860", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713870", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507713880", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713891", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507713902", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507713913", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507713923", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507713937", + "member": "lab02.glab.lol", + "message": "ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713950", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713960", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713969", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713984", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713996", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507714006", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762713ms" + }, + { + "at": "1789227507714015", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762713ms" + }, + { + "at": "1789227507714029", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762713ms" + }, + { + "at": "1789227507714042", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507714051", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507714063", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714076", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227507714086", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507714097", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714107", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507714116", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507714126", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714135", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507714146", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507714155", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714165", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507801672", + "member": "lab02.glab.lol", + "message": "ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507801725", + "member": "lab02.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227507808580", + "member": "lab02.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507808688", + "member": "lab02.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18" + }, + { + "at": "1789227508539423", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler204)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508539562", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler204)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227508539591", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508539621", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508539643", + "member": "lab02.glab.lol", + "message": " my_disc:0xdc9ba2fe your_disc:0xca515c77" + }, + { + "at": "1789227508539665", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508539686", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508539703", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508539724", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539743", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539767", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539792", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539818", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763538ms" + }, + { + "at": "1789227508539839", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +38ms" + }, + { + "at": "1789227508539860", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -732ms" + }, + { + "at": "1789227508539880", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539902", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539922", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539942", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227508539959", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539977", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540004", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508540022", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508540045", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540063", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508540084", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508540103", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540123", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508540145", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler204)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508540165", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508540183", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508540200", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508540218", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508540235", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508540253", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508540277", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +38ms" + }, + { + "at": "1789227508540296", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -732ms" + }, + { + "at": "1789227508540314", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508540333", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508540357", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540376", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227508540459", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508540478", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540494", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508540512", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508540529", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540548", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508540566", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508540587", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540603", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508584221", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler204)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508584298", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler204)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227508584327", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508584350", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508584374", + "member": "lab02.glab.lol", + "message": " my_disc:0x497f288e your_disc:0x40a41aa9" + }, + { + "at": "1789227508584414", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508584437", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508584463", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508584484", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508584505", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508584525", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508584544", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508584565", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763583ms" + }, + { + "at": "1789227508584586", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227508584608", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789227508584631", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508584651", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508584672", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508584694", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227508584716", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508584735", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508584756", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508584775", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508584793", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508584813", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x497f288e" + }, + { + "at": "1789227508584836", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508584856", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508584877", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508584902", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler204)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508584926", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508584947", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508584967", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508584987", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508585008", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508585029", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508585051", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227508585072", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789227508585092", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508585116", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508585136", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508585189", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227508585211", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508585230", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508585250", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508585268", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508585290", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508585310", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x497f288e" + }, + { + "at": "1789227508585331", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508585351", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508585370", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508593421", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler204)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508593458", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler204)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508593474", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508593484", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508593494", + "member": "lab02.glab.lol", + "message": " my_disc:0x81e3b173 your_disc:0xda265f98" + }, + { + "at": "1789227508593504", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508593514", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508593523", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508593534", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508593544", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508593553", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508593563", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508593572", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763592ms" + }, + { + "at": "1789227508593585", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +54ms" + }, + { + "at": "1789227508593595", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -786ms" + }, + { + "at": "1789227508593612", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508593621", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508593630", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593640", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227508593651", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593661", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593670", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508593679", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508593688", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593697", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x81e3b173" + }, + { + "at": "1789227508593711", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508593721", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593730", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508593741", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler204)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508593758", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508593768", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508593778", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508593789", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508593798", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508593808", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508593819", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +54ms" + }, + { + "at": "1789227508593833", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -786ms" + }, + { + "at": "1789227508593843", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508593852", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508593864", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593873", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227508593884", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593894", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593907", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508593917", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508593926", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593935", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x81e3b173" + }, + { + "at": "1789227508593944", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593954", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593965", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227517709422", + "member": "lab02.glab.lol", + "message": "ovs|00193|connmgr|INFO|br-int<->unix#7: 903 flow_mods in the 6 s starting 10 s ago (836 adds, 59 deletes, 8 modifications)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507707789", + "member": "lab03.glab.lol", + "message": "ovs|00201|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507707984", + "member": "lab03.glab.lol", + "message": "ovs|00202|bridge|INFO|bridge incusovn16: using datapath ID 000072a4e283cf43" + }, + { + "at": "1789227507708012", + "member": "lab03.glab.lol", + "message": "ovs|00203|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507710639", + "member": "lab03.glab.lol", + "message": "ovs|00204|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507710681", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507710698", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507710712", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507710726", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507710737", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507710749", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662708ms" + }, + { + "at": "1789227507710790", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662708ms" + }, + { + "at": "1789227507710803", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662708ms" + }, + { + "at": "1789227507710814", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507710826", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507710837", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507710849", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507710861", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507710872", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507710885", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507710895", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507710905", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507710917", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507710928", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507710941", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507710953", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507710966", + "member": "lab03.glab.lol", + "message": "ovs|00205|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507710980", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507710993", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507711004", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507711015", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507711025", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507711036", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662708ms" + }, + { + "at": "1789227507711048", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662708ms" + }, + { + "at": "1789227507711063", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662708ms" + }, + { + "at": "1789227507711075", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507711086", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507711096", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507711108", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507711120", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507711131", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507711142", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507711152", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507711162", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507711173", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507711185", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507711196", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507711206", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507711216", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507717597", + "member": "lab03.glab.lol", + "message": "ovs|00206|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507717644", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507717657", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507717667", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507717678", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507717691", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507717702", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662715ms" + }, + { + "at": "1789227507717713", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662715ms" + }, + { + "at": "1789227507717724", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662715ms" + }, + { + "at": "1789227507717741", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507717752", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507717768", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507717778", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227507717789", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507717800", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507717812", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507717823", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507717833", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507717843", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507717855", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507717866", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507717875", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507804643", + "member": "lab03.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507804692", + "member": "lab03.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227507806329", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler199)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507806399", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler199)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227507806433", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507806465", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507806496", + "member": "lab03.glab.lol", + "message": " my_disc:0x89809725 your_disc:0x0" + }, + { + "at": "1789227507806522", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507806549", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507806573", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507806601", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507806627", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507806651", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507806674", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507806707", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662804ms" + }, + { + "at": "1789227507806733", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662804ms" + }, + { + "at": "1789227507806758", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662804ms" + }, + { + "at": "1789227507806788", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507806811", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507806837", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507806864", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507806887", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507806911", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507806978", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507807004", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507807032", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807055", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227507807089", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507807113", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807141", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507807174", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507807200", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507807224", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507807248", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507807271", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507807297", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507807320", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507807347", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662804ms" + }, + { + "at": "1789227507807374", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662804ms" + }, + { + "at": "1789227507807397", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507807420", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507807444", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807465", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507807487", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507807513", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807536", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507807559", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507807579", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807602", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227507807625", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507807652", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807675", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507809171", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler199)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507809238", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler199)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507809274", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507809300", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507809324", + "member": "lab03.glab.lol", + "message": " my_disc:0xca515c77 your_disc:0x0" + }, + { + "at": "1789227507809350", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507809377", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507809398", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507809421", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507809450", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507809474", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507809497", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507809520", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662807ms" + }, + { + "at": "1789227507809543", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +731ms" + }, + { + "at": "1789227507809568", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227507809598", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507809620", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507809644", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507809665", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507809694", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507809720", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507809749", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507809775", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507809798", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507809824", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227507809849", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507809873", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507809898", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507809922", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507809947", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507809972", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507809995", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507810018", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507810039", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507810070", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507810095", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +731ms" + }, + { + "at": "1789227507810119", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227507810142", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507810164", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507810187", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507810217", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507810240", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507810266", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507810288", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507810311", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507810342", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507810363", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227507810386", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507810409", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507810430", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507811441", + "member": "lab03.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507811536", + "member": "lab03.glab.lol", + "message": "ovs|00210|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227508589288", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508589394", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508589425", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508589451", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508589477", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508589503", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508589534", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508589557", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227508589586", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49ms" + }, + { + "at": "1789227508589610", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508589635", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508589663", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508589685", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508589708", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508589729", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508589751", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508589773", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508589805", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508589828", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227508589850", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508589873", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508589896", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508605322", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler199)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508605367", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler199)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508605382", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508605397", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508605408", + "member": "lab03.glab.lol", + "message": " my_disc:0xe78f835 your_disc:0xec809328" + }, + { + "at": "1789227508605425", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508605438", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508605449", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508605462", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508605475", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508605486", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508605497", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508605510", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49663603ms" + }, + { + "at": "1789227508605523", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789227508605544", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -795ms" + }, + { + "at": "1789227508605557", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508605570", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508605581", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605596", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227508605609", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605621", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605633", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508605646", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508605659", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605672", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xe78f835" + }, + { + "at": "1789227508605684", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508605696", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605707", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508605719", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler199)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508605733", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508605744", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508605756", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508605768", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508605781", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508605791", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508605808", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789227508605822", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -795ms" + }, + { + "at": "1789227508605833", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508605845", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508605856", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605868", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227508605880", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605892", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605903", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508605915", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508605926", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605936", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xe78f835" + }, + { + "at": "1789227508605949", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605961", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605972", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508647285", + "member": "lab03.glab.lol", + "message": "ovs|00011|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508647375", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508647407", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508647439", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508647462", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508647485", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508647513", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508647534", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +73ms" + }, + { + "at": "1789227508647563", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -837ms" + }, + { + "at": "1789227508647588", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508647611", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508647636", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508647662", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227508647686", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508647710", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508647733", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508647755", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508647778", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508647805", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227508647826", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508647850", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508647871", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227510169696", + "member": "lab03.glab.lol", + "message": "ovs|00211|bridge|INFO|bridge br-int: added interface veth00b99e0c on port 28" + }, + { + "at": "1789227517713244", + "member": "lab03.glab.lol", + "message": "ovs|00212|connmgr|INFO|br-int<->unix#7: 892 flow_mods in the 6 s starting 10 s ago (829 adds, 55 deletes, 8 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507517047", + "member": "nas01.glab.lol", + "message": "ovs|00187|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507517197", + "member": "nas01.glab.lol", + "message": "ovs|00188|bridge|INFO|bridge incusovn16: using datapath ID 00001e51c01ceb4a" + }, + { + "at": "1789227507517217", + "member": "nas01.glab.lol", + "message": "ovs|00189|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507615058", + "member": "nas01.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507615174", + "member": "nas01.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227507620318", + "member": "nas01.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507620366", + "member": "nas01.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227507708466", + "member": "nas01.glab.lol", + "message": "ovs|00194|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507708514", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507708534", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507708550", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507708561", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507708573", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507708584", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889572ms" + }, + { + "at": "1789227507708595", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889572ms" + }, + { + "at": "1789227507708605", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889572ms" + }, + { + "at": "1789227507708617", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507708628", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507708639", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507708650", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507708661", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507708679", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507708690", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507708702", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507708713", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507708724", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507708734", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507708746", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507708757", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507709128", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507713004", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler209)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507713097", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler209)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507713135", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507713166", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507713189", + "member": "nas01.glab.lol", + "message": " my_disc:0x40a41aa9 your_disc:0x0" + }, + { + "at": "1789227507713216", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507713240", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507713259", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507713280", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713298", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713317", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713336", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507713359", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889577ms" + }, + { + "at": "1789227507713383", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +876ms" + }, + { + "at": "1789227507713402", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227507713432", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713460", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507713486", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713506", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507713525", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713544", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713564", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713584", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507713605", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713624", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507713654", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507713673", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713691", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507713711", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713724", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713733", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713746", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713760", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713773", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507713788", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507713805", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +876ms" + }, + { + "at": "1789227507713824", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227507713840", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713854", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507713868", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713883", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507713896", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713906", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713919", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713934", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507713944", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713952", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507713962", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713975", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713987", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507713997", + "member": "nas01.glab.lol", + "message": "ovs|00195|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507714008", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507714018", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507714027", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507714037", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507714047", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507714057", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889577ms" + }, + { + "at": "1789227507714066", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889577ms" + }, + { + "at": "1789227507714076", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889577ms" + }, + { + "at": "1789227507714092", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507714101", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507714111", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714121", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507714132", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507714141", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714151", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507714161", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507714171", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714181", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507714190", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507714199", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714209", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507720388", + "member": "nas01.glab.lol", + "message": "ovs|00196|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507720400", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507720409", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507720420", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507720428", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507720441", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507720451", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889584ms" + }, + { + "at": "1789227507720461", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889584ms" + }, + { + "at": "1789227507720472", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889584ms" + }, + { + "at": "1789227507720482", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507720492", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507720501", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507720513", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507720524", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507720534", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507720543", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507720555", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507720566", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507720575", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507720587", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507720596", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507720606", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507815260", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler209)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507815357", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler209)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227507815379", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227507815395", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507815408", + "member": "nas01.glab.lol", + "message": " my_disc:0xb042e51c your_disc:0x89809725" + }, + { + "at": "1789227507815420", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507815436", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507815468", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507815482", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507815493", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507815505", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507815516", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507815525", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889679ms" + }, + { + "at": "1789227507815537", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +775ms" + }, + { + "at": "1789227507815552", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227507815567", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507815582", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507815596", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815612", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507815633", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815648", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815663", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507815678", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227507815696", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815712", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb042e51c" + }, + { + "at": "1789227507815726", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507815742", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815757", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507815770", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler209)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507815781", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507815791", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507815800", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507815810", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507815819", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507815830", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507815847", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +775ms" + }, + { + "at": "1789227507815858", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227507815873", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507815881", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507815891", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815901", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507815911", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815921", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815935", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507815947", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227507815958", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815968", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb042e51c" + }, + { + "at": "1789227507815977", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815986", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815996", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508538879", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler209)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508539181", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler209)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508539204", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508539220", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508539236", + "member": "nas01.glab.lol", + "message": " my_disc:0x3eb441ca your_disc:0x4cb6d301" + }, + { + "at": "1789227508539250", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508539264", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508539279", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508539288", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539299", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539309", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539318", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539327", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590890402ms" + }, + { + "at": "1789227508539340", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +72ms" + }, + { + "at": "1789227508539351", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -728ms" + }, + { + "at": "1789227508539363", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539373", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539383", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539398", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508539408", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539421", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539435", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508539448", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508539462", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539480", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508539496", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508539505", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539514", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508539524", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler209)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508539539", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508539552", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539562", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539571", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539580", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539590", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508539600", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +72ms" + }, + { + "at": "1789227508539609", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -728ms" + }, + { + "at": "1789227508539625", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539635", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539646", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539654", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508539664", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539674", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539683", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508539694", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508539704", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539714", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508539723", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539733", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539742", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227509463186", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227509463362", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227509463389", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227509463410", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227509463436", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227509463464", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227509463492", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227509463530", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +856ms" + }, + { + "at": "1789227509463561", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -64ms" + }, + { + "at": "1789227509463589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227509463616", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227509463651", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227509463667", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227509463683", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227509463699", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227509463714", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227509463729", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227509463746", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227509463765", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227509463782", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227509463795", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227509463817", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227517521324", + "member": "nas01.glab.lol", + "message": "ovs|00197|connmgr|INFO|br-int<->unix#7: 972 flow_mods in the 6 s starting 10 s ago (866 adds, 104 deletes, 2 modifications)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-teardown.txt new file mode 100644 index 0000000..beea738 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-after-teardown.txt @@ -0,0 +1,5700 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:74:95:5e STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:74:95:5e REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507722372", + "member": "lab01.glab.lol", + "message": "ovs|84130|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507722696", + "member": "lab01.glab.lol", + "message": "ovs|84131|bridge|INFO|bridge incusovn16: using datapath ID 0000dad0828f3c4b" + }, + { + "at": "1789227507722724", + "member": "lab01.glab.lol", + "message": "ovs|84132|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507724746", + "member": "lab01.glab.lol", + "message": "ovs|84133|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507724810", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507724836", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507724854", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507724873", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507724886", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507724899", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507724929", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507724945", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507724969", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507724987", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725003", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725013", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507725028", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725048", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725062", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725071", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725087", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725100", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725111", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725128", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725137", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725148", + "member": "lab01.glab.lol", + "message": "ovs|84134|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507725161", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507725172", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507725181", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507725199", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507725214", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507725230", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507725240", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507725254", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507725270", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507725282", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725298", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725314", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507725330", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725338", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725352", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725362", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725374", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725382", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725395", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725405", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725414", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725422", + "member": "lab01.glab.lol", + "message": "ovs|84135|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507725441", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507725456", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507725472", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507725491", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507725505", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507725515", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507725528", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507725537", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507725553", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507725562", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725570", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725580", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507725593", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725608", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725617", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725632", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725643", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725658", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725674", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725683", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725692", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725702", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507816983", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler196)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507817142", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler196)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227507817193", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507817234", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507817270", + "member": "lab01.glab.lol", + "message": " my_disc:0x4cb6d301 your_disc:0x0" + }, + { + "at": "1789227507817309", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507817340", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507817373", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507817403", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507817434", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507817474", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507817530", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507817561", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785817ms" + }, + { + "at": "1789227507817608", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +728ms" + }, + { + "at": "1789227507817655", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -92ms" + }, + { + "at": "1789227507817700", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507817730", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507817760", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507817790", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507817817", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507817845", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507817877", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507817914", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507817956", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507817995", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507818034", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507818065", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818104", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507818136", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507818180", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507818210", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507818247", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507818280", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507818317", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507818354", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507818397", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +728ms" + }, + { + "at": "1789227507818433", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -92ms" + }, + { + "at": "1789227507818471", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507818518", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507818549", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507818579", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507818609", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507818641", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818678", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507818708", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507818736", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507818765", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507818797", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507818841", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818878", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507818914", + "member": "lab01.glab.lol", + "message": "ovs|84136|dpif|WARN|Dropped 333 log messages in last 142 seconds (most recently, 142 seconds ago) due to excessive rate" + }, + { + "at": "1789227507818965", + "member": "lab01.glab.lol", + "message": "ovs|84137|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507819006", + "member": "lab01.glab.lol", + "message": "ovs|84138|bridge|WARN|Dropped 55709 log messages in last 169 seconds (most recently, 142 seconds ago) due to excessive rate" + }, + { + "at": "1789227507819038", + "member": "lab01.glab.lol", + "message": "ovs|84139|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227507819357", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler196)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507819413", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler196)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507819461", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507819500", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507819536", + "member": "lab01.glab.lol", + "message": " my_disc:0xda265f98 your_disc:0x0" + }, + { + "at": "1789227507819584", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507819617", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507819650", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507819688", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507819716", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507819757", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507819789", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507819822", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785819ms" + }, + { + "at": "1789227507819868", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +786ms" + }, + { + "at": "1789227507820245", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227507820348", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507820389", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507820426", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507820458", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507820671", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507820709", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507820741", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507820773", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507820810", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507820850", + "member": "lab01.glab.lol", + "message": "ovs|84140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507820888", + "member": "lab01.glab.lol", + "message": "ovs|84141|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227507820924", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227507820954", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507820990", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821021", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507821051", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507821091", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507821122", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507821151", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507821180", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507821218", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507821248", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507821279", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +786ms" + }, + { + "at": "1789227507821315", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227507821346", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507821375", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507821411", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507821451", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507821477", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507821519", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821550", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507821584", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507821612", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507821641", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227507821673", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507821702", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821734", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507821771", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler196)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507821801", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler196)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227507821841", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507821880", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507821919", + "member": "lab01.glab.lol", + "message": " my_disc:0xec809328 your_disc:0x0" + }, + { + "at": "1789227507821961", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507821987", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507822016", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507822048", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507822087", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507822114", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507822153", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507822183", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785821ms" + }, + { + "at": "1789227507822224", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +794ms" + }, + { + "at": "1789227507822263", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227507822295", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507822324", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507822353", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507822390", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507822429", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507822460", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507822500", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507822530", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507822559", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507822585", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227507822615", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507822655", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507822690", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507822729", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507822766", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507822797", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507822832", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507822862", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507822887", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507822915", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507822944", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +794ms" + }, + { + "at": "1789227507822970", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227507823006", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507823034", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507823068", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507823100", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507823133", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507823167", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507823192", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507823221", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507823247", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507823282", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227507823317", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507823346", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507823384", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507823416", + "member": "lab01.glab.lol", + "message": "ovs|84142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507823883", + "member": "lab01.glab.lol", + "message": "ovs|84143|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507825889", + "member": "lab01.glab.lol", + "message": "ovs|84144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507830590", + "member": "lab01.glab.lol", + "message": "ovs|84145|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227507830635", + "member": "lab01.glab.lol", + "message": "ovs|84146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227508617643", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508617751", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508617770", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508617786", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508617796", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508617805", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508617826", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508617836", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +697ms" + }, + { + "at": "1789227508617856", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -73ms" + }, + { + "at": "1789227508617886", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508617897", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508617923", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508617935", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508617951", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508617967", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508617978", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508617991", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508618013", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508618026", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508618043", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508618061", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508618080", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508690035", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508690132", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508690157", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508690171", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508690187", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508690205", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508690224", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508690239", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +785ms" + }, + { + "at": "1789227508690254", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -85ms" + }, + { + "at": "1789227508690277", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508690291", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508690309", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508690319", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227508690331", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508690352", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508690364", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508690385", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508690399", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508690410", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227508690420", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508690430", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508690448", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508761179", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508761366", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508761386", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508761400", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508761410", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508761431", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508761448", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508761464", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789227508761491", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -146ms" + }, + { + "at": "1789227508761515", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508761529", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508761543", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508761553", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227508761570", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508761581", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508761592", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508761612", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508761623", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508761637", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227508761653", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508761668", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508761678", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508818644", + "member": "lab01.glab.lol", + "message": "ovs|84147|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227508818688", + "member": "lab01.glab.lol", + "message": "ovs|84148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227509144720", + "member": "lab01.glab.lol", + "message": "ovs|84149|bridge|INFO|bridge br-int: added interface veth1af313e3 on port 30" + }, + { + "at": "1789227509818712", + "member": "lab01.glab.lol", + "message": "ovs|84150|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227509818860", + "member": "lab01.glab.lol", + "message": "ovs|84151|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227510818725", + "member": "lab01.glab.lol", + "message": "ovs|84152|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227510818914", + "member": "lab01.glab.lol", + "message": "ovs|84153|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227511818892", + "member": "lab01.glab.lol", + "message": "ovs|84154|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227511819080", + "member": "lab01.glab.lol", + "message": "ovs|84155|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227512267846", + "member": "lab01.glab.lol", + "message": "ovs|84156|poll_loop|INFO|Dropped 1710 log messages in last 148 seconds (most recently, 145 seconds ago) due to excessive rate" + }, + { + "at": "1789227512267929", + "member": "lab01.glab.lol", + "message": "ovs|84157|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512268373", + "member": "lab01.glab.lol", + "message": "ovs|84158|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512268897", + "member": "lab01.glab.lol", + "message": "ovs|84159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512269413", + "member": "lab01.glab.lol", + "message": "ovs|84160|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512269926", + "member": "lab01.glab.lol", + "message": "ovs|84161|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512270439", + "member": "lab01.glab.lol", + "message": "ovs|84162|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512270954", + "member": "lab01.glab.lol", + "message": "ovs|84163|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512271469", + "member": "lab01.glab.lol", + "message": "ovs|84164|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512271983", + "member": "lab01.glab.lol", + "message": "ovs|84165|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512272489", + "member": "lab01.glab.lol", + "message": "ovs|84166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512818925", + "member": "lab01.glab.lol", + "message": "ovs|84167|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227512819138", + "member": "lab01.glab.lol", + "message": "ovs|84168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227513818804", + "member": "lab01.glab.lol", + "message": "ovs|84169|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227513818956", + "member": "lab01.glab.lol", + "message": "ovs|84170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227514139554", + "member": "lab01.glab.lol", + "message": "ovs|84171|bridge|WARN|Dropped 12682 log messages in last 7 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227514139650", + "member": "lab01.glab.lol", + "message": "ovs|84172|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227514818556", + "member": "lab01.glab.lol", + "message": "ovs|84173|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227514818644", + "member": "lab01.glab.lol", + "message": "ovs|84174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227515818548", + "member": "lab01.glab.lol", + "message": "ovs|84175|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227515818765", + "member": "lab01.glab.lol", + "message": "ovs|84176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227516818561", + "member": "lab01.glab.lol", + "message": "ovs|84177|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227516818764", + "member": "lab01.glab.lol", + "message": "ovs|84178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227517725596", + "member": "lab01.glab.lol", + "message": "ovs|84179|connmgr|INFO|br-int<->unix#7: 887 flow_mods in the 6 s starting 10 s ago (827 adds, 53 deletes, 7 modifications)" + }, + { + "at": "1789227517818947", + "member": "lab01.glab.lol", + "message": "ovs|84180|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227517819095", + "member": "lab01.glab.lol", + "message": "ovs|84181|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227518267778", + "member": "lab01.glab.lol", + "message": "ovs|84182|poll_loop|INFO|Dropped 12199 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227518267872", + "member": "lab01.glab.lol", + "message": "ovs|84183|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227518818532", + "member": "lab01.glab.lol", + "message": "ovs|84184|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227518818613", + "member": "lab01.glab.lol", + "message": "ovs|84185|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227519818609", + "member": "lab01.glab.lol", + "message": "ovs|84186|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227519818847", + "member": "lab01.glab.lol", + "message": "ovs|84187|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227520818960", + "member": "lab01.glab.lol", + "message": "ovs|84188|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227520819268", + "member": "lab01.glab.lol", + "message": "ovs|84189|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227521818958", + "member": "lab01.glab.lol", + "message": "ovs|84190|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227521819125", + "member": "lab01.glab.lol", + "message": "ovs|84191|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227522818965", + "member": "lab01.glab.lol", + "message": "ovs|84192|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227522819116", + "member": "lab01.glab.lol", + "message": "ovs|84193|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227523818873", + "member": "lab01.glab.lol", + "message": "ovs|84194|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227523819110", + "member": "lab01.glab.lol", + "message": "ovs|84195|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227524267927", + "member": "lab01.glab.lol", + "message": "ovs|84196|poll_loop|INFO|Dropped 12146 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227524268026", + "member": "lab01.glab.lol", + "message": "ovs|84197|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227524818798", + "member": "lab01.glab.lol", + "message": "ovs|84198|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227524818904", + "member": "lab01.glab.lol", + "message": "ovs|84199|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227525818894", + "member": "lab01.glab.lol", + "message": "ovs|84200|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227525819123", + "member": "lab01.glab.lol", + "message": "ovs|84201|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227526818926", + "member": "lab01.glab.lol", + "message": "ovs|84202|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227526819150", + "member": "lab01.glab.lol", + "message": "ovs|84203|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227527818530", + "member": "lab01.glab.lol", + "message": "ovs|84204|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227527818648", + "member": "lab01.glab.lol", + "message": "ovs|84205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227528818852", + "member": "lab01.glab.lol", + "message": "ovs|84206|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227528819177", + "member": "lab01.glab.lol", + "message": "ovs|84207|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227529818750", + "member": "lab01.glab.lol", + "message": "ovs|84208|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227529818909", + "member": "lab01.glab.lol", + "message": "ovs|84209|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227530267692", + "member": "lab01.glab.lol", + "message": "ovs|84210|poll_loop|INFO|Dropped 12224 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227530267798", + "member": "lab01.glab.lol", + "message": "ovs|84211|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227530818747", + "member": "lab01.glab.lol", + "message": "ovs|84212|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227530818846", + "member": "lab01.glab.lol", + "message": "ovs|84213|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227531067372", + "member": "lab01.glab.lol", + "message": "ovs|84214|bridge|INFO|bridge br-int: deleted interface veth1af313e3 on port 30" + }, + { + "at": "1789227531818621", + "member": "lab01.glab.lol", + "message": "ovs|84215|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227531818725", + "member": "lab01.glab.lol", + "message": "ovs|84216|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227532818646", + "member": "lab01.glab.lol", + "message": "ovs|84217|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227532818845", + "member": "lab01.glab.lol", + "message": "ovs|84218|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227533272378", + "member": "lab01.glab.lol", + "message": "ovs|84219|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227533272417", + "member": "lab01.glab.lol", + "message": "ovs|84220|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227533294185", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated" + }, + { + "at": "1789227533297970", + "member": "lab01.glab.lol", + "message": "ovs|84221|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507704380", + "member": "lab02.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507704705", + "member": "lab02.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00004259e0da4248" + }, + { + "at": "1789227507704737", + "member": "lab02.glab.lol", + "message": "ovs|00185|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507706897", + "member": "lab02.glab.lol", + "message": "ovs|00186|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507706957", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507706981", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507706994", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507707006", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507707022", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507707035", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762706ms" + }, + { + "at": "1789227507707047", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762706ms" + }, + { + "at": "1789227507707059", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762706ms" + }, + { + "at": "1789227507707071", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507707082", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507707098", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507707110", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507707122", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507707131", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507707142", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507707153", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507707164", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507707177", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507707187", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507707198", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507707211", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507707222", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507713650", + "member": "lab02.glab.lol", + "message": "ovs|00187|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713712", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713723", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713732", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713744", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507713754", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762713ms" + }, + { + "at": "1789227507713776", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762713ms" + }, + { + "at": "1789227507713786", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762713ms" + }, + { + "at": "1789227507713798", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713809", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507713819", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713828", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227507713840", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713850", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507713860", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713870", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507713880", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713891", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507713902", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507713913", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507713923", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507713937", + "member": "lab02.glab.lol", + "message": "ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713950", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713960", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713969", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713984", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713996", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507714006", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762713ms" + }, + { + "at": "1789227507714015", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762713ms" + }, + { + "at": "1789227507714029", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762713ms" + }, + { + "at": "1789227507714042", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507714051", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507714063", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714076", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227507714086", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507714097", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714107", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507714116", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507714126", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714135", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507714146", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507714155", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714165", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507801672", + "member": "lab02.glab.lol", + "message": "ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507801725", + "member": "lab02.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227507808580", + "member": "lab02.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507808688", + "member": "lab02.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18" + }, + { + "at": "1789227508539423", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler204)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508539562", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler204)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227508539591", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508539621", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508539643", + "member": "lab02.glab.lol", + "message": " my_disc:0xdc9ba2fe your_disc:0xca515c77" + }, + { + "at": "1789227508539665", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508539686", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508539703", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508539724", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539743", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539767", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539792", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539818", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763538ms" + }, + { + "at": "1789227508539839", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +38ms" + }, + { + "at": "1789227508539860", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -732ms" + }, + { + "at": "1789227508539880", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539902", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539922", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539942", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227508539959", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539977", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540004", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508540022", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508540045", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540063", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508540084", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508540103", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540123", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508540145", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler204)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508540165", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508540183", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508540200", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508540218", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508540235", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508540253", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508540277", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +38ms" + }, + { + "at": "1789227508540296", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -732ms" + }, + { + "at": "1789227508540314", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508540333", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508540357", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540376", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227508540459", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508540478", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540494", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508540512", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508540529", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540548", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508540566", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508540587", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540603", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508584221", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler204)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508584298", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler204)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227508584327", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508584350", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508584374", + "member": "lab02.glab.lol", + "message": " my_disc:0x497f288e your_disc:0x40a41aa9" + }, + { + "at": "1789227508584414", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508584437", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508584463", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508584484", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508584505", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508584525", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508584544", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508584565", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763583ms" + }, + { + "at": "1789227508584586", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227508584608", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789227508584631", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508584651", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508584672", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508584694", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227508584716", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508584735", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508584756", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508584775", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508584793", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508584813", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x497f288e" + }, + { + "at": "1789227508584836", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508584856", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508584877", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508584902", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler204)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508584926", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508584947", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508584967", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508584987", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508585008", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508585029", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508585051", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227508585072", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789227508585092", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508585116", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508585136", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508585189", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227508585211", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508585230", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508585250", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508585268", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508585290", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508585310", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x497f288e" + }, + { + "at": "1789227508585331", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508585351", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508585370", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508593421", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler204)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508593458", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler204)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508593474", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508593484", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508593494", + "member": "lab02.glab.lol", + "message": " my_disc:0x81e3b173 your_disc:0xda265f98" + }, + { + "at": "1789227508593504", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508593514", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508593523", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508593534", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508593544", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508593553", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508593563", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508593572", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763592ms" + }, + { + "at": "1789227508593585", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +54ms" + }, + { + "at": "1789227508593595", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -786ms" + }, + { + "at": "1789227508593612", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508593621", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508593630", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593640", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227508593651", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593661", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593670", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508593679", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508593688", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593697", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x81e3b173" + }, + { + "at": "1789227508593711", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508593721", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593730", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508593741", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler204)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508593758", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508593768", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508593778", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508593789", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508593798", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508593808", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508593819", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +54ms" + }, + { + "at": "1789227508593833", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -786ms" + }, + { + "at": "1789227508593843", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508593852", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508593864", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593873", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227508593884", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593894", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593907", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508593917", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508593926", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593935", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x81e3b173" + }, + { + "at": "1789227508593944", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593954", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593965", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227517709422", + "member": "lab02.glab.lol", + "message": "ovs|00193|connmgr|INFO|br-int<->unix#7: 903 flow_mods in the 6 s starting 10 s ago (836 adds, 59 deletes, 8 modifications)" + }, + { + "at": "1789227533262962", + "member": "lab02.glab.lol", + "message": "ovs|00194|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227533263174", + "member": "lab02.glab.lol", + "message": "ovs|00195|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227533263198", + "member": "lab02.glab.lol", + "message": "ovs|00196|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227533279240", + "member": "lab02.glab.lol", + "message": "ovs|00197|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18" + }, + { + "at": "1789227533279374", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507707789", + "member": "lab03.glab.lol", + "message": "ovs|00201|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507707984", + "member": "lab03.glab.lol", + "message": "ovs|00202|bridge|INFO|bridge incusovn16: using datapath ID 000072a4e283cf43" + }, + { + "at": "1789227507708012", + "member": "lab03.glab.lol", + "message": "ovs|00203|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507710639", + "member": "lab03.glab.lol", + "message": "ovs|00204|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507710681", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507710698", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507710712", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507710726", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507710737", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507710749", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662708ms" + }, + { + "at": "1789227507710790", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662708ms" + }, + { + "at": "1789227507710803", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662708ms" + }, + { + "at": "1789227507710814", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507710826", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507710837", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507710849", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507710861", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507710872", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507710885", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507710895", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507710905", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507710917", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507710928", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507710941", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507710953", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507710966", + "member": "lab03.glab.lol", + "message": "ovs|00205|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507710980", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507710993", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507711004", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507711015", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507711025", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507711036", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662708ms" + }, + { + "at": "1789227507711048", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662708ms" + }, + { + "at": "1789227507711063", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662708ms" + }, + { + "at": "1789227507711075", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507711086", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507711096", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507711108", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507711120", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507711131", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507711142", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507711152", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507711162", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507711173", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507711185", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507711196", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507711206", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507711216", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507717597", + "member": "lab03.glab.lol", + "message": "ovs|00206|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507717644", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507717657", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507717667", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507717678", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507717691", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507717702", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662715ms" + }, + { + "at": "1789227507717713", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662715ms" + }, + { + "at": "1789227507717724", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662715ms" + }, + { + "at": "1789227507717741", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507717752", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507717768", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507717778", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227507717789", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507717800", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507717812", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507717823", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507717833", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507717843", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507717855", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507717866", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507717875", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507804643", + "member": "lab03.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507804692", + "member": "lab03.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227507806329", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler199)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507806399", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler199)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227507806433", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507806465", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507806496", + "member": "lab03.glab.lol", + "message": " my_disc:0x89809725 your_disc:0x0" + }, + { + "at": "1789227507806522", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507806549", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507806573", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507806601", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507806627", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507806651", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507806674", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507806707", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662804ms" + }, + { + "at": "1789227507806733", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662804ms" + }, + { + "at": "1789227507806758", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662804ms" + }, + { + "at": "1789227507806788", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507806811", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507806837", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507806864", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507806887", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507806911", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507806978", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507807004", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507807032", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807055", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227507807089", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507807113", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807141", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507807174", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507807200", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507807224", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507807248", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507807271", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507807297", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507807320", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507807347", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662804ms" + }, + { + "at": "1789227507807374", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662804ms" + }, + { + "at": "1789227507807397", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507807420", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507807444", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807465", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507807487", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507807513", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807536", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507807559", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507807579", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807602", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227507807625", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507807652", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807675", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507809171", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler199)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507809238", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler199)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507809274", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507809300", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507809324", + "member": "lab03.glab.lol", + "message": " my_disc:0xca515c77 your_disc:0x0" + }, + { + "at": "1789227507809350", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507809377", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507809398", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507809421", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507809450", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507809474", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507809497", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507809520", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662807ms" + }, + { + "at": "1789227507809543", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +731ms" + }, + { + "at": "1789227507809568", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227507809598", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507809620", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507809644", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507809665", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507809694", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507809720", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507809749", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507809775", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507809798", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507809824", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227507809849", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507809873", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507809898", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507809922", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507809947", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507809972", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507809995", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507810018", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507810039", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507810070", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507810095", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +731ms" + }, + { + "at": "1789227507810119", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227507810142", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507810164", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507810187", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507810217", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507810240", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507810266", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507810288", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507810311", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507810342", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507810363", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227507810386", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507810409", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507810430", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507811441", + "member": "lab03.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507811536", + "member": "lab03.glab.lol", + "message": "ovs|00210|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227508589288", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508589394", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508589425", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508589451", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508589477", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508589503", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508589534", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508589557", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227508589586", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49ms" + }, + { + "at": "1789227508589610", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508589635", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508589663", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508589685", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508589708", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508589729", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508589751", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508589773", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508589805", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508589828", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227508589850", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508589873", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508589896", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508605322", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler199)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508605367", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler199)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508605382", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508605397", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508605408", + "member": "lab03.glab.lol", + "message": " my_disc:0xe78f835 your_disc:0xec809328" + }, + { + "at": "1789227508605425", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508605438", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508605449", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508605462", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508605475", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508605486", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508605497", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508605510", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49663603ms" + }, + { + "at": "1789227508605523", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789227508605544", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -795ms" + }, + { + "at": "1789227508605557", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508605570", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508605581", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605596", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227508605609", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605621", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605633", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508605646", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508605659", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605672", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xe78f835" + }, + { + "at": "1789227508605684", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508605696", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605707", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508605719", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler199)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508605733", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508605744", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508605756", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508605768", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508605781", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508605791", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508605808", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789227508605822", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -795ms" + }, + { + "at": "1789227508605833", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508605845", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508605856", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605868", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227508605880", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605892", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605903", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508605915", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508605926", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605936", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xe78f835" + }, + { + "at": "1789227508605949", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605961", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605972", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508647285", + "member": "lab03.glab.lol", + "message": "ovs|00011|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508647375", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508647407", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508647439", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508647462", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508647485", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508647513", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508647534", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +73ms" + }, + { + "at": "1789227508647563", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -837ms" + }, + { + "at": "1789227508647588", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508647611", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508647636", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508647662", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227508647686", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508647710", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508647733", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508647755", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508647778", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508647805", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227508647826", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508647850", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508647871", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227510169696", + "member": "lab03.glab.lol", + "message": "ovs|00211|bridge|INFO|bridge br-int: added interface veth00b99e0c on port 28" + }, + { + "at": "1789227517713244", + "member": "lab03.glab.lol", + "message": "ovs|00212|connmgr|INFO|br-int<->unix#7: 892 flow_mods in the 6 s starting 10 s ago (829 adds, 55 deletes, 8 modifications)" + }, + { + "at": "1789227532085225", + "member": "lab03.glab.lol", + "message": "ovs|00213|bridge|INFO|bridge br-int: deleted interface veth00b99e0c on port 28" + }, + { + "at": "1789227533266001", + "member": "lab03.glab.lol", + "message": "ovs|00214|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227533266259", + "member": "lab03.glab.lol", + "message": "ovs|00215|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227533266452", + "member": "lab03.glab.lol", + "message": "ovs|00216|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227533282645", + "member": "lab03.glab.lol", + "message": "ovs|00217|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227533282820", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507517047", + "member": "nas01.glab.lol", + "message": "ovs|00187|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507517197", + "member": "nas01.glab.lol", + "message": "ovs|00188|bridge|INFO|bridge incusovn16: using datapath ID 00001e51c01ceb4a" + }, + { + "at": "1789227507517217", + "member": "nas01.glab.lol", + "message": "ovs|00189|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507615058", + "member": "nas01.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507615174", + "member": "nas01.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227507620318", + "member": "nas01.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507620366", + "member": "nas01.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227507708466", + "member": "nas01.glab.lol", + "message": "ovs|00194|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507708514", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507708534", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507708550", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507708561", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507708573", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507708584", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889572ms" + }, + { + "at": "1789227507708595", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889572ms" + }, + { + "at": "1789227507708605", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889572ms" + }, + { + "at": "1789227507708617", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507708628", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507708639", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507708650", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507708661", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507708679", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507708690", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507708702", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507708713", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507708724", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507708734", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507708746", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507708757", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507709128", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507713004", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler209)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507713097", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler209)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507713135", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507713166", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507713189", + "member": "nas01.glab.lol", + "message": " my_disc:0x40a41aa9 your_disc:0x0" + }, + { + "at": "1789227507713216", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507713240", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507713259", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507713280", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713298", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713317", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713336", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507713359", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889577ms" + }, + { + "at": "1789227507713383", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +876ms" + }, + { + "at": "1789227507713402", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227507713432", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713460", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507713486", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713506", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507713525", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713544", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713564", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713584", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507713605", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713624", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507713654", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507713673", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713691", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507713711", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713724", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713733", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713746", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713760", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713773", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507713788", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507713805", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +876ms" + }, + { + "at": "1789227507713824", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227507713840", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713854", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507713868", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713883", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507713896", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713906", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713919", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713934", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507713944", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713952", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507713962", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713975", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713987", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507713997", + "member": "nas01.glab.lol", + "message": "ovs|00195|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507714008", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507714018", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507714027", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507714037", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507714047", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507714057", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889577ms" + }, + { + "at": "1789227507714066", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889577ms" + }, + { + "at": "1789227507714076", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889577ms" + }, + { + "at": "1789227507714092", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507714101", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507714111", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714121", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507714132", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507714141", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714151", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507714161", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507714171", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714181", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507714190", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507714199", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714209", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507720388", + "member": "nas01.glab.lol", + "message": "ovs|00196|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507720400", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507720409", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507720420", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507720428", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507720441", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507720451", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889584ms" + }, + { + "at": "1789227507720461", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889584ms" + }, + { + "at": "1789227507720472", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889584ms" + }, + { + "at": "1789227507720482", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507720492", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507720501", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507720513", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507720524", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507720534", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507720543", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507720555", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507720566", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507720575", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507720587", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507720596", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507720606", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507815260", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler209)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507815357", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler209)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227507815379", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227507815395", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507815408", + "member": "nas01.glab.lol", + "message": " my_disc:0xb042e51c your_disc:0x89809725" + }, + { + "at": "1789227507815420", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507815436", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507815468", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507815482", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507815493", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507815505", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507815516", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507815525", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889679ms" + }, + { + "at": "1789227507815537", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +775ms" + }, + { + "at": "1789227507815552", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227507815567", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507815582", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507815596", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815612", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507815633", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815648", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815663", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507815678", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227507815696", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815712", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb042e51c" + }, + { + "at": "1789227507815726", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507815742", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815757", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507815770", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler209)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507815781", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507815791", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507815800", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507815810", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507815819", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507815830", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507815847", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +775ms" + }, + { + "at": "1789227507815858", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227507815873", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507815881", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507815891", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815901", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507815911", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815921", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815935", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507815947", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227507815958", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815968", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb042e51c" + }, + { + "at": "1789227507815977", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815986", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815996", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508538879", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler209)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508539181", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler209)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508539204", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508539220", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508539236", + "member": "nas01.glab.lol", + "message": " my_disc:0x3eb441ca your_disc:0x4cb6d301" + }, + { + "at": "1789227508539250", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508539264", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508539279", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508539288", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539299", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539309", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539318", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539327", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590890402ms" + }, + { + "at": "1789227508539340", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +72ms" + }, + { + "at": "1789227508539351", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -728ms" + }, + { + "at": "1789227508539363", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539373", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539383", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539398", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508539408", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539421", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539435", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508539448", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508539462", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539480", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508539496", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508539505", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539514", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508539524", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler209)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508539539", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508539552", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539562", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539571", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539580", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539590", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508539600", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +72ms" + }, + { + "at": "1789227508539609", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -728ms" + }, + { + "at": "1789227508539625", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539635", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539646", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539654", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508539664", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539674", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539683", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508539694", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508539704", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539714", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508539723", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539733", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539742", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227509463186", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227509463362", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227509463389", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227509463410", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227509463436", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227509463464", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227509463492", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227509463530", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +856ms" + }, + { + "at": "1789227509463561", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -64ms" + }, + { + "at": "1789227509463589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227509463616", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227509463651", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227509463667", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227509463683", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227509463699", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227509463714", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227509463729", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227509463746", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227509463765", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227509463782", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227509463795", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227509463817", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227517521324", + "member": "nas01.glab.lol", + "message": "ovs|00197|connmgr|INFO|br-int<->unix#7: 972 flow_mods in the 6 s starting 10 s ago (866 adds, 104 deletes, 2 modifications)" + }, + { + "at": "1789227533274234", + "member": "nas01.glab.lol", + "message": "ovs|00198|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227533274627", + "member": "nas01.glab.lol", + "message": "ovs|00199|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227533274905", + "member": "nas01.glab.lol", + "message": "ovs|00200|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227533302355", + "member": "nas01.glab.lol", + "message": "ovs|00201|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227533302455", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor225)|INFO|monitor thread terminated" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-before-probe.txt new file mode 100644 index 0000000..aee85b1 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/diagnostics-before-probe.txt @@ -0,0 +1,5471 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:c1:3a:bb | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:23:36:e5 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 9c7fd63d-02e5-4725-89d8-20a93b5b4c22 (incus-net33-ls-int) + port incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0 + addresses: ["10:66:6a:23:36:e5 dynamic"] + port incus-net33-ls-int-lsp-router + type: router + router-port: incus-net33-lr-lrp-int + port incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0 + addresses: ["10:66:6a:c1:3a:bb dynamic"] +switch c00fa569-4968-411f-ac26-a8e96a3fc785 (incus-net33-ls-ext) + port incus-net33-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net33-ls-ext-lsp-router + type: router + router-port: incus-net33-lr-lrp-ext +router 23008478-d6de-4cf9-9c72-49b77c3c9e77 (incus-net33-lr) + port incus-net33-lr-lrp-ext + mac: "10:66:6a:74:95:5e" + ipv6-lla: "fe80::1266:6aff:fe74:955e" + networks: ["10.10.40.64/24"] + port incus-net33-lr-lrp-int + mac: "10:66:6a:74:95:5e" + ipv6-lla: "fe80::1266:6aff:fe74:955e" + networks: ["10.253.73.1/24"] + nat 927155e2-a0a4-4858-9bff-3ed132cfbb8c + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net33-instance-8cf93694-88d2-492c-82b2-f4268a9bce48-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net33-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net33-instance-90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 213ce4ec-49aa-4056-ab31-2753ba6265ea +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f5542e8a-f5b9-47ed-bf7e-79796b6cac96 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:74:95:5e" +name : incus-net33-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} + +_uuid : 24f02c6b-fdff-4373-956e-0d2c02b266d4 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:74:95:5e" +name : incus-net33-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : c3a4712b-0df6-4eee-b28e-298666393faf +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : a68ceb67-150e-485e-9708-75c40ff8fa4d +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f35549ad-87de-45c6-a476-95d37d94d468 +logical_port : cr-incus-net33-lr-lrp-ext +mac : ["10:66:6a:74:95:5e 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net33-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:74:95:5e STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:74:95:5e DELAY +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507722372", + "member": "lab01.glab.lol", + "message": "ovs|84130|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507722696", + "member": "lab01.glab.lol", + "message": "ovs|84131|bridge|INFO|bridge incusovn16: using datapath ID 0000dad0828f3c4b" + }, + { + "at": "1789227507722724", + "member": "lab01.glab.lol", + "message": "ovs|84132|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507724746", + "member": "lab01.glab.lol", + "message": "ovs|84133|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507724810", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507724836", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507724854", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507724873", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507724886", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507724899", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507724929", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507724945", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507724969", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507724987", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725003", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725013", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507725028", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725048", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725062", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725071", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725087", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725100", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725111", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725128", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725137", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725148", + "member": "lab01.glab.lol", + "message": "ovs|84134|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507725161", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507725172", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507725181", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507725199", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507725214", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507725230", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507725240", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507725254", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507725270", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507725282", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725298", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725314", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507725330", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725338", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725352", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725362", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725374", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725382", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725395", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725405", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725414", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725422", + "member": "lab01.glab.lol", + "message": "ovs|84135|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507725441", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507725456", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507725472", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507725491", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507725505", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507725515", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785725ms" + }, + { + "at": "1789227507725528", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541785725ms" + }, + { + "at": "1789227507725537", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541785725ms" + }, + { + "at": "1789227507725553", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507725562", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507725570", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725580", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507725593", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507725608", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725617", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507725632", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507725643", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507725658", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507725674", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507725683", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507725692", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507725702", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507816983", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler196)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507817142", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler196)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227507817193", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507817234", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507817270", + "member": "lab01.glab.lol", + "message": " my_disc:0x4cb6d301 your_disc:0x0" + }, + { + "at": "1789227507817309", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507817340", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507817373", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507817403", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507817434", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507817474", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507817530", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507817561", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785817ms" + }, + { + "at": "1789227507817608", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +728ms" + }, + { + "at": "1789227507817655", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -92ms" + }, + { + "at": "1789227507817700", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507817730", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507817760", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507817790", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507817817", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507817845", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507817877", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507817914", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507817956", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507817995", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507818034", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507818065", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818104", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507818136", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507818180", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507818210", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507818247", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507818280", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507818317", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507818354", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507818397", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +728ms" + }, + { + "at": "1789227507818433", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -92ms" + }, + { + "at": "1789227507818471", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507818518", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507818549", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507818579", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227507818609", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507818641", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818678", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507818708", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507818736", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507818765", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507818797", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507818841", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507818878", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507818914", + "member": "lab01.glab.lol", + "message": "ovs|84136|dpif|WARN|Dropped 333 log messages in last 142 seconds (most recently, 142 seconds ago) due to excessive rate" + }, + { + "at": "1789227507818965", + "member": "lab01.glab.lol", + "message": "ovs|84137|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507819006", + "member": "lab01.glab.lol", + "message": "ovs|84138|bridge|WARN|Dropped 55709 log messages in last 169 seconds (most recently, 142 seconds ago) due to excessive rate" + }, + { + "at": "1789227507819038", + "member": "lab01.glab.lol", + "message": "ovs|84139|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227507819357", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler196)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507819413", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler196)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507819461", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507819500", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507819536", + "member": "lab01.glab.lol", + "message": " my_disc:0xda265f98 your_disc:0x0" + }, + { + "at": "1789227507819584", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507819617", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507819650", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507819688", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507819716", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507819757", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507819789", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507819822", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785819ms" + }, + { + "at": "1789227507819868", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +786ms" + }, + { + "at": "1789227507820245", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227507820348", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507820389", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507820426", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507820458", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507820671", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507820709", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507820741", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507820773", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507820810", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507820850", + "member": "lab01.glab.lol", + "message": "ovs|84140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507820888", + "member": "lab01.glab.lol", + "message": "ovs|84141|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227507820924", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227507820954", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507820990", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821021", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507821051", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507821091", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507821122", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507821151", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507821180", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507821218", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507821248", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507821279", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +786ms" + }, + { + "at": "1789227507821315", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -94ms" + }, + { + "at": "1789227507821346", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507821375", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507821411", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507821451", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227507821477", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507821519", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821550", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507821584", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507821612", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507821641", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227507821673", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507821702", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507821734", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507821771", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler196)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507821801", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler196)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227507821841", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507821880", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507821919", + "member": "lab01.glab.lol", + "message": " my_disc:0xec809328 your_disc:0x0" + }, + { + "at": "1789227507821961", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507821987", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507822016", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507822048", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507822087", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507822114", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507822153", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507822183", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541785821ms" + }, + { + "at": "1789227507822224", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +794ms" + }, + { + "at": "1789227507822263", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227507822295", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507822324", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507822353", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507822390", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507822429", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507822460", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507822500", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507822530", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507822559", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507822585", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227507822615", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507822655", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507822690", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507822729", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507822766", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507822797", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507822832", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507822862", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507822887", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507822915", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507822944", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +794ms" + }, + { + "at": "1789227507822970", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227507823006", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507823034", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507823068", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507823100", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227507823133", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507823167", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507823192", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507823221", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507823247", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507823282", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227507823317", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507823346", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507823384", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507823416", + "member": "lab01.glab.lol", + "message": "ovs|84142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507823883", + "member": "lab01.glab.lol", + "message": "ovs|84143|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507825889", + "member": "lab01.glab.lol", + "message": "ovs|84144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227507830590", + "member": "lab01.glab.lol", + "message": "ovs|84145|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227507830635", + "member": "lab01.glab.lol", + "message": "ovs|84146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227508617643", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler196)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508617751", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508617770", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508617786", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508617796", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508617805", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508617826", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508617836", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +697ms" + }, + { + "at": "1789227508617856", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -73ms" + }, + { + "at": "1789227508617886", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508617897", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508617923", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508617935", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508617951", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508617967", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508617978", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508617991", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508618013", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508618026", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508618043", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508618061", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508618080", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508690035", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler196)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508690132", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508690157", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508690171", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508690187", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508690205", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508690224", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508690239", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +785ms" + }, + { + "at": "1789227508690254", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -85ms" + }, + { + "at": "1789227508690277", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508690291", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508690309", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508690319", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x81e3b173" + }, + { + "at": "1789227508690331", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508690352", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508690364", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508690385", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508690399", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508690410", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xda265f98" + }, + { + "at": "1789227508690420", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508690430", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508690448", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508761179", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler196)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508761366", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508761386", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508761400", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508761410", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508761431", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508761448", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508761464", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789227508761491", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -146ms" + }, + { + "at": "1789227508761515", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508761529", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508761543", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508761553", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xe78f835" + }, + { + "at": "1789227508761570", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508761581", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508761592", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508761612", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508761623", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508761637", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xec809328" + }, + { + "at": "1789227508761653", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508761668", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508761678", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508818644", + "member": "lab01.glab.lol", + "message": "ovs|84147|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227508818688", + "member": "lab01.glab.lol", + "message": "ovs|84148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227509144720", + "member": "lab01.glab.lol", + "message": "ovs|84149|bridge|INFO|bridge br-int: added interface veth1af313e3 on port 30" + }, + { + "at": "1789227509818712", + "member": "lab01.glab.lol", + "message": "ovs|84150|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227509818860", + "member": "lab01.glab.lol", + "message": "ovs|84151|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227510818725", + "member": "lab01.glab.lol", + "message": "ovs|84152|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227510818914", + "member": "lab01.glab.lol", + "message": "ovs|84153|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227511818892", + "member": "lab01.glab.lol", + "message": "ovs|84154|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227511819080", + "member": "lab01.glab.lol", + "message": "ovs|84155|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227512267846", + "member": "lab01.glab.lol", + "message": "ovs|84156|poll_loop|INFO|Dropped 1710 log messages in last 148 seconds (most recently, 145 seconds ago) due to excessive rate" + }, + { + "at": "1789227512267929", + "member": "lab01.glab.lol", + "message": "ovs|84157|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512268373", + "member": "lab01.glab.lol", + "message": "ovs|84158|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512268897", + "member": "lab01.glab.lol", + "message": "ovs|84159|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512269413", + "member": "lab01.glab.lol", + "message": "ovs|84160|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512269926", + "member": "lab01.glab.lol", + "message": "ovs|84161|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512270439", + "member": "lab01.glab.lol", + "message": "ovs|84162|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512270954", + "member": "lab01.glab.lol", + "message": "ovs|84163|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512271469", + "member": "lab01.glab.lol", + "message": "ovs|84164|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512271983", + "member": "lab01.glab.lol", + "message": "ovs|84165|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512272489", + "member": "lab01.glab.lol", + "message": "ovs|84166|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227512818925", + "member": "lab01.glab.lol", + "message": "ovs|84167|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227512819138", + "member": "lab01.glab.lol", + "message": "ovs|84168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227513818804", + "member": "lab01.glab.lol", + "message": "ovs|84169|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227513818956", + "member": "lab01.glab.lol", + "message": "ovs|84170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227514139554", + "member": "lab01.glab.lol", + "message": "ovs|84171|bridge|WARN|Dropped 12682 log messages in last 7 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227514139650", + "member": "lab01.glab.lol", + "message": "ovs|84172|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507704380", + "member": "lab02.glab.lol", + "message": "ovs|00183|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507704705", + "member": "lab02.glab.lol", + "message": "ovs|00184|bridge|INFO|bridge incusovn16: using datapath ID 00004259e0da4248" + }, + { + "at": "1789227507704737", + "member": "lab02.glab.lol", + "message": "ovs|00185|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507706897", + "member": "lab02.glab.lol", + "message": "ovs|00186|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507706957", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507706981", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507706994", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507707006", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507707022", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507707035", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762706ms" + }, + { + "at": "1789227507707047", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762706ms" + }, + { + "at": "1789227507707059", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762706ms" + }, + { + "at": "1789227507707071", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507707082", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507707098", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507707110", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507707122", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507707131", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507707142", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507707153", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507707164", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507707177", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507707187", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507707198", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507707211", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507707222", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507713650", + "member": "lab02.glab.lol", + "message": "ovs|00187|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713712", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713723", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713732", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713744", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507713754", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762713ms" + }, + { + "at": "1789227507713776", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762713ms" + }, + { + "at": "1789227507713786", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762713ms" + }, + { + "at": "1789227507713798", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713809", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507713819", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713828", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227507713840", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713850", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507713860", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713870", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507713880", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713891", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507713902", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507713913", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507713923", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507713937", + "member": "lab02.glab.lol", + "message": "ovs|00188|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713950", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713960", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713969", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713984", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713996", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507714006", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590762713ms" + }, + { + "at": "1789227507714015", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590762713ms" + }, + { + "at": "1789227507714029", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590762713ms" + }, + { + "at": "1789227507714042", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507714051", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507714063", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714076", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227507714086", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507714097", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714107", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507714116", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507714126", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714135", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507714146", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507714155", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714165", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507801672", + "member": "lab02.glab.lol", + "message": "ovs|00189|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507801725", + "member": "lab02.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227507808580", + "member": "lab02.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507808688", + "member": "lab02.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 18" + }, + { + "at": "1789227508539423", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler204)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508539562", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler204)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227508539591", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508539621", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508539643", + "member": "lab02.glab.lol", + "message": " my_disc:0xdc9ba2fe your_disc:0xca515c77" + }, + { + "at": "1789227508539665", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508539686", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508539703", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508539724", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539743", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539767", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539792", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539818", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763538ms" + }, + { + "at": "1789227508539839", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +38ms" + }, + { + "at": "1789227508539860", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -732ms" + }, + { + "at": "1789227508539880", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539902", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539922", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539942", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227508539959", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539977", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540004", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508540022", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508540045", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540063", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508540084", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508540103", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540123", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508540145", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler204)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508540165", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508540183", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508540200", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508540218", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508540235", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508540253", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508540277", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +38ms" + }, + { + "at": "1789227508540296", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -732ms" + }, + { + "at": "1789227508540314", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508540333", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508540357", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540376", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xca515c77" + }, + { + "at": "1789227508540459", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508540478", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540494", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508540512", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508540529", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508540548", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508540566", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508540587", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508540603", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508584221", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler204)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508584298", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler204)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227508584327", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508584350", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508584374", + "member": "lab02.glab.lol", + "message": " my_disc:0x497f288e your_disc:0x40a41aa9" + }, + { + "at": "1789227508584414", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508584437", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508584463", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508584484", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508584505", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508584525", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508584544", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508584565", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763583ms" + }, + { + "at": "1789227508584586", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227508584608", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789227508584631", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508584651", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508584672", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508584694", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227508584716", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508584735", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508584756", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508584775", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508584793", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508584813", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x497f288e" + }, + { + "at": "1789227508584836", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508584856", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508584877", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508584902", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler204)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508584926", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508584947", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508584967", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508584987", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508585008", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508585029", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508585051", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227508585072", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -77ms" + }, + { + "at": "1789227508585092", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508585116", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508585136", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508585189", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x40a41aa9" + }, + { + "at": "1789227508585211", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508585230", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508585250", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508585268", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508585290", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508585310", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x497f288e" + }, + { + "at": "1789227508585331", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508585351", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508585370", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508593421", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler204)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508593458", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler204)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508593474", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508593484", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508593494", + "member": "lab02.glab.lol", + "message": " my_disc:0x81e3b173 your_disc:0xda265f98" + }, + { + "at": "1789227508593504", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508593514", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508593523", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508593534", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508593544", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508593553", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508593563", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508593572", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590763592ms" + }, + { + "at": "1789227508593585", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +54ms" + }, + { + "at": "1789227508593595", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -786ms" + }, + { + "at": "1789227508593612", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508593621", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508593630", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593640", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227508593651", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593661", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593670", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508593679", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508593688", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593697", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x81e3b173" + }, + { + "at": "1789227508593711", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508593721", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593730", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508593741", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler204)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508593758", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508593768", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508593778", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508593789", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508593798", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508593808", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508593819", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +54ms" + }, + { + "at": "1789227508593833", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -786ms" + }, + { + "at": "1789227508593843", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508593852", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508593864", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593873", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xda265f98" + }, + { + "at": "1789227508593884", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593894", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593907", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508593917", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508593926", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508593935", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x81e3b173" + }, + { + "at": "1789227508593944", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508593954", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508593965", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507707789", + "member": "lab03.glab.lol", + "message": "ovs|00201|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507707984", + "member": "lab03.glab.lol", + "message": "ovs|00202|bridge|INFO|bridge incusovn16: using datapath ID 000072a4e283cf43" + }, + { + "at": "1789227507708012", + "member": "lab03.glab.lol", + "message": "ovs|00203|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507710639", + "member": "lab03.glab.lol", + "message": "ovs|00204|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507710681", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507710698", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507710712", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507710726", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507710737", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507710749", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662708ms" + }, + { + "at": "1789227507710790", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662708ms" + }, + { + "at": "1789227507710803", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662708ms" + }, + { + "at": "1789227507710814", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507710826", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507710837", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507710849", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507710861", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507710872", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507710885", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507710895", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507710905", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507710917", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507710928", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507710941", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507710953", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507710966", + "member": "lab03.glab.lol", + "message": "ovs|00205|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507710980", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507710993", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507711004", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507711015", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507711025", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507711036", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662708ms" + }, + { + "at": "1789227507711048", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662708ms" + }, + { + "at": "1789227507711063", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662708ms" + }, + { + "at": "1789227507711075", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507711086", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507711096", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507711108", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507711120", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507711131", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507711142", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507711152", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507711162", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507711173", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507711185", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507711196", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507711206", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507711216", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507717597", + "member": "lab03.glab.lol", + "message": "ovs|00206|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507717644", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507717657", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507717667", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507717678", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507717691", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507717702", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662715ms" + }, + { + "at": "1789227507717713", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662715ms" + }, + { + "at": "1789227507717724", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662715ms" + }, + { + "at": "1789227507717741", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507717752", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507717768", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507717778", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227507717789", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507717800", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507717812", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507717823", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507717833", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507717843", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507717855", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507717866", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507717875", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507804643", + "member": "lab03.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507804692", + "member": "lab03.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227507806329", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler199)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507806399", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler199)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227507806433", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507806465", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507806496", + "member": "lab03.glab.lol", + "message": " my_disc:0x89809725 your_disc:0x0" + }, + { + "at": "1789227507806522", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507806549", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507806573", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507806601", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507806627", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507806651", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507806674", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507806707", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662804ms" + }, + { + "at": "1789227507806733", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662804ms" + }, + { + "at": "1789227507806758", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662804ms" + }, + { + "at": "1789227507806788", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507806811", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507806837", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507806864", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507806887", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507806911", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507806978", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507807004", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507807032", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807055", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227507807089", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507807113", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807141", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507807174", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507807200", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507807224", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507807248", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507807271", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507807297", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507807320", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507807347", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49662804ms" + }, + { + "at": "1789227507807374", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49662804ms" + }, + { + "at": "1789227507807397", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507807420", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507807444", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807465", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227507807487", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507807513", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807536", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507807559", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507807579", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507807602", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227507807625", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507807652", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507807675", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507809171", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler199)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507809238", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler199)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507809274", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507809300", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507809324", + "member": "lab03.glab.lol", + "message": " my_disc:0xca515c77 your_disc:0x0" + }, + { + "at": "1789227507809350", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507809377", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507809398", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507809421", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507809450", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507809474", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507809497", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507809520", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49662807ms" + }, + { + "at": "1789227507809543", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +731ms" + }, + { + "at": "1789227507809568", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227507809598", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507809620", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507809644", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507809665", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507809694", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507809720", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507809749", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507809775", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507809798", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507809824", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227507809849", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507809873", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507809898", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507809922", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507809947", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507809972", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507809995", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507810018", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507810039", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507810070", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507810095", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +731ms" + }, + { + "at": "1789227507810119", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227507810142", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507810164", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507810187", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507810217", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227507810240", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507810266", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507810288", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507810311", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507810342", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507810363", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227507810386", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507810409", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507810430", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507811441", + "member": "lab03.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507811536", + "member": "lab03.glab.lol", + "message": "ovs|00210|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 27" + }, + { + "at": "1789227508589288", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler199)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508589394", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508589425", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508589451", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508589477", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508589503", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508589534", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508589557", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +891ms" + }, + { + "at": "1789227508589586", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49ms" + }, + { + "at": "1789227508589610", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508589635", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508589663", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508589685", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xdc9ba2fe" + }, + { + "at": "1789227508589708", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508589729", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508589751", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508589773", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508589805", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508589828", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xca515c77" + }, + { + "at": "1789227508589850", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508589873", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508589896", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508605322", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler199)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508605367", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler199)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508605382", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508605397", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508605408", + "member": "lab03.glab.lol", + "message": " my_disc:0xe78f835 your_disc:0xec809328" + }, + { + "at": "1789227508605425", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508605438", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508605449", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508605462", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508605475", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508605486", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508605497", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508605510", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49663603ms" + }, + { + "at": "1789227508605523", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789227508605544", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -795ms" + }, + { + "at": "1789227508605557", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508605570", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508605581", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605596", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227508605609", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605621", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605633", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508605646", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508605659", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605672", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xe78f835" + }, + { + "at": "1789227508605684", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508605696", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605707", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508605719", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler199)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508605733", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508605744", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508605756", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508605768", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508605781", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508605791", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508605808", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789227508605822", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -795ms" + }, + { + "at": "1789227508605833", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508605845", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508605856", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605868", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xec809328" + }, + { + "at": "1789227508605880", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605892", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605903", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508605915", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508605926", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508605936", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xe78f835" + }, + { + "at": "1789227508605949", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508605961", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508605972", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508647285", + "member": "lab03.glab.lol", + "message": "ovs|00011|bfd(handler199)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508647375", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508647407", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508647439", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508647462", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508647485", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508647513", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508647534", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +73ms" + }, + { + "at": "1789227508647563", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -837ms" + }, + { + "at": "1789227508647588", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508647611", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227508647636", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508647662", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb042e51c" + }, + { + "at": "1789227508647686", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508647710", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508647733", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508647755", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227508647778", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508647805", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x89809725" + }, + { + "at": "1789227508647826", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227508647850", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508647871", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227510169696", + "member": "lab03.glab.lol", + "message": "ovs|00211|bridge|INFO|bridge br-int: added interface veth00b99e0c on port 28" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227507517047", + "member": "nas01.glab.lol", + "message": "ovs|00187|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227507517197", + "member": "nas01.glab.lol", + "message": "ovs|00188|bridge|INFO|bridge incusovn16: using datapath ID 00001e51c01ceb4a" + }, + { + "at": "1789227507517217", + "member": "nas01.glab.lol", + "message": "ovs|00189|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227507615058", + "member": "nas01.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227507615174", + "member": "nas01.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227507620318", + "member": "nas01.glab.lol", + "message": "ovs|00192|bridge|INFO|bridge incusovn16: added interface patch-incus-net33-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227507620366", + "member": "nas01.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net33-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227507708466", + "member": "nas01.glab.lol", + "message": "ovs|00194|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507708514", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507708534", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507708550", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507708561", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507708573", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507708584", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889572ms" + }, + { + "at": "1789227507708595", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889572ms" + }, + { + "at": "1789227507708605", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889572ms" + }, + { + "at": "1789227507708617", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507708628", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507708639", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507708650", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507708661", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507708679", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507708690", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507708702", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507708713", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507708724", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507708734", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507708746", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507708757", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507709128", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor225)|INFO|monitor thread created" + }, + { + "at": "1789227507713004", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler209)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507713097", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler209)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227507713135", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227507713166", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507713189", + "member": "nas01.glab.lol", + "message": " my_disc:0x40a41aa9 your_disc:0x0" + }, + { + "at": "1789227507713216", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507713240", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507713259", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507713280", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713298", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713317", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713336", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507713359", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889577ms" + }, + { + "at": "1789227507713383", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +876ms" + }, + { + "at": "1789227507713402", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227507713432", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713460", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507713486", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713506", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507713525", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713544", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713564", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713584", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507713605", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713624", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507713654", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507713673", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713691", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507713711", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507713724", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507713733", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507713746", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507713760", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507713773", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507713788", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507713805", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +876ms" + }, + { + "at": "1789227507713824", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227507713840", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507713854", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507713868", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713883", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227507713896", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713906", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713919", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507713934", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227507713944", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507713952", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227507713962", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507713975", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507713987", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507713997", + "member": "nas01.glab.lol", + "message": "ovs|00195|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507714008", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507714018", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507714027", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507714037", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507714047", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507714057", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889577ms" + }, + { + "at": "1789227507714066", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889577ms" + }, + { + "at": "1789227507714076", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889577ms" + }, + { + "at": "1789227507714092", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507714101", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507714111", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714121", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507714132", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507714141", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714151", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507714161", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507714171", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507714181", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507714190", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507714199", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507714209", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507720388", + "member": "nas01.glab.lol", + "message": "ovs|00196|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507720400", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507720409", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507720420", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507720428", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507720441", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227507720451", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889584ms" + }, + { + "at": "1789227507720461", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590889584ms" + }, + { + "at": "1789227507720472", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590889584ms" + }, + { + "at": "1789227507720482", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507720492", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227507720501", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507720513", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227507720524", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507720534", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227507720543", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507720555", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227507720566", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507720575", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227507720587", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507720596", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227507720606", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227507815260", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler209)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227507815357", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler209)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227507815379", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227507815395", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227507815408", + "member": "nas01.glab.lol", + "message": " my_disc:0xb042e51c your_disc:0x89809725" + }, + { + "at": "1789227507815420", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227507815436", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227507815468", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227507815482", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507815493", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507815505", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507815516", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507815525", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590889679ms" + }, + { + "at": "1789227507815537", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +775ms" + }, + { + "at": "1789227507815552", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227507815567", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507815582", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507815596", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815612", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507815633", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815648", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815663", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507815678", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227507815696", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815712", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb042e51c" + }, + { + "at": "1789227507815726", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227507815742", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815757", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227507815770", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler209)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227507815781", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227507815791", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227507815800", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227507815810", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227507815819", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227507815830", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227507815847", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +775ms" + }, + { + "at": "1789227507815858", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227507815873", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227507815881", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227507815891", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815901", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x89809725" + }, + { + "at": "1789227507815911", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815921", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815935", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227507815947", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227507815958", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227507815968", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb042e51c" + }, + { + "at": "1789227507815977", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227507815986", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227507815996", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508538879", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler209)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227508539181", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler209)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227508539204", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227508539220", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227508539236", + "member": "nas01.glab.lol", + "message": " my_disc:0x3eb441ca your_disc:0x4cb6d301" + }, + { + "at": "1789227508539250", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227508539264", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227508539279", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227508539288", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539299", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539309", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539318", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539327", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590890402ms" + }, + { + "at": "1789227508539340", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +72ms" + }, + { + "at": "1789227508539351", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -728ms" + }, + { + "at": "1789227508539363", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539373", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539383", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539398", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508539408", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539421", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539435", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508539448", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508539462", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539480", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508539496", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227508539505", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539514", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227508539524", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler209)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227508539539", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227508539552", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227508539562", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227508539571", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227508539580", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227508539590", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227508539600", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +72ms" + }, + { + "at": "1789227508539609", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -728ms" + }, + { + "at": "1789227508539625", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227508539635", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227508539646", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539654", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cb6d301" + }, + { + "at": "1789227508539664", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539674", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539683", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227508539694", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227508539704", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227508539714", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x3eb441ca" + }, + { + "at": "1789227508539723", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227508539733", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227508539742", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227509463186", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler209)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227509463362", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227509463389", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227509463410", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227509463436", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227509463464", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227509463492", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227509463530", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +856ms" + }, + { + "at": "1789227509463561", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -64ms" + }, + { + "at": "1789227509463589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227509463616", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227509463651", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227509463667", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x497f288e" + }, + { + "at": "1789227509463683", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227509463699", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227509463714", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227509463729", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227509463746", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227509463765", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x40a41aa9" + }, + { + "at": "1789227509463782", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227509463795", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227509463817", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.debug.log new file mode 100644 index 0000000..e74aa35 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:38:25-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.log new file mode 100644 index 0000000..ba575a1 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-create.log @@ -0,0 +1,537 @@ +time="2026-09-12T15:38:25Z" level=debug msg="[nas01] Event listener server handler started" id=ff3825d7-29b8-4421-ac0b-950013a96557 local="10.10.10.14:8443" remote="100.122.142.76:54145" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54163" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54164" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54165" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54166" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54167" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54168" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54169" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54170" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54171" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54172" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:74:95:5e" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.33 +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net33 driver=ovn memberID=1 network=default priority=13042 project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T15:38:27Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54174" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54175" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54176" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54177" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54178" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54179" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54180" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54181" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54182" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Event listener server handler started" id=e0dc1806-795c-4d5c-bf4d-5854d1eb783b local="10.10.10.14:8443" remote="100.122.142.76:54182" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54183" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=47f399e2-654d-4020-855b-f8156dd78d64 project=image-build +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=47f399e2-654d-4020-855b-f8156dd78d64 project=image-build +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54184" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Event listener server handler started" id=39f40f4a-7dd6-49c2-955e-1cd356be593b local="10.10.10.14:8443" remote="100.122.142.76:54184" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54185" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=bfc8ecea-e09a-4edd-8937-037d2292d9da project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=bfc8ecea-e09a-4edd-8937-037d2292d9da project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54186" method=GET protocol=tls url="/1.0/operations/bfc8ecea-e09a-4edd-8937-037d2292d9da?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=bfc8ecea-e09a-4edd-8937-037d2292d9da project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T15:38:28Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=bfc8ecea-e09a-4edd-8937-037d2292d9da project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e0dc1806-795c-4d5c-bf4d-5854d1eb783b local="10.10.10.14:8443" remote="100.122.142.76:54182" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Event listener server handler stopped" listener=39f40f4a-7dd6-49c2-955e-1cd356be593b local="10.10.10.14:8443" remote="100.122.142.76:54184" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54187" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54188" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"c9ab7c84-e9e2-47b0-b49a-f3473b126f52\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:38:28.491031468Z\",\n\t\t\"updated_at\": \"2026-09-12T15:38:28.491031468Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54189" method=GET protocol=tls url="/1.0/operations/c9ab7c84-e9e2-47b0-b49a-f3473b126f52/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54190" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54191" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54192" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Event listener server handler started" id=05490e19-18a4-4504-aae4-11d25f8d4242 local="10.10.10.14:8443" remote="100.122.142.76:54192" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54193" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 15:38:28.512881335 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54194" method=GET protocol=tls url="/1.0/operations/9e042af9-8f65-4b81-b907-a8b65d78edee?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:29Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 15:38:28.512881335 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Event listener server handler stopped" listener=05490e19-18a4-4504-aae4-11d25f8d4242 local="10.10.10.14:8443" remote="100.122.142.76:54192" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54195" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54196" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"72f0b347-00b7-4928-a17f-afe771ea0be0\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:38:29.573445512Z\",\n\t\t\"updated_at\": \"2026-09-12T15:38:29.573445512Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.64 network=default project=ac-ovn-spike +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54197" method=GET protocol=tls url="/1.0/operations/72f0b347-00b7-4928-a17f-afe771ea0be0/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:29Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:29Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:38:29Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54198" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54199" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54200" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Event listener server handler started" id=0b9a97ac-4874-434b-a3fb-00ca73b64616 local="10.10.10.14:8443" remote="100.122.142.76:54200" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54201" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:30Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 15:38:29.623502575 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54202" method=GET protocol=tls url="/1.0/operations/58367688-f02e-459a-a4c6-d636c900b7d7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 15:38:29.623502575 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Event listener server handler stopped" listener=0b9a97ac-4874-434b-a3fb-00ca73b64616 local="10.10.10.14:8443" remote="100.122.142.76:54200" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54203" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54204" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54205" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54206" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54207" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54208" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54209" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54210" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54211" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Event listener server handler started" id=61a325c3-d5cb-4975-8974-0c42ec0cff94 local="10.10.10.14:8443" remote="100.122.142.76:54212" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54212" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54213" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54214" method=GET protocol=tls url="/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=4c20a8b75c11d53143ce8819829f3cc58aa6985e0d423fd684d78d88a4658d53" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54214" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=4c20a8b75c11d53143ce8819829f3cc58aa6985e0d423fd684d78d88a4658d53" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54215" method=GET protocol=tls url="/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=21dc23cfce5e0060d3088c1848fd38fc43ea3ba6b5d76d955a73dc7f9df023de" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54215" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=21dc23cfce5e0060d3088c1848fd38fc43ea3ba6b5d76d955a73dc7f9df023de" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54216" method=GET protocol=tls url="/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=66e1085ed37971e4794913bc3b3ee964b2b1f22c2381f3d1150a9013596486f2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54216" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=66e1085ed37971e4794913bc3b3ee964b2b1f22c2381f3d1150a9013596486f2" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54217" method=GET protocol=tls url="/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=9e6511a79b6bd9703bc8a86aefe779c29612e444472ac899bf88df92b1ad0f5a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54217" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7/websocket?secret=9e6511a79b6bd9703bc8a86aefe779c29612e444472ac899bf88df92b1ad0f5a" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54215" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54218" method=GET protocol=tls url="/1.0/operations/95899e23-596e-40dd-8b63-b6914f00a8f7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54214" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54217" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54216" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Event listener server handler stopped" listener=61a325c3-d5cb-4975-8974-0c42ec0cff94 local="10.10.10.14:8443" remote="100.122.142.76:54212" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54219" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54220" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54221" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54222" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Event listener server handler started" id=d862f838-8eb0-4a2f-9b93-1a190d04b016 local="10.10.10.14:8443" remote="100.122.142.76:54222" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54223" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54224" method=GET protocol=tls url="/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=2a949e84764fceda047e473a8898a78bf0f3c0f27e91a1eb94b499a9bbe218d1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54224" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=2a949e84764fceda047e473a8898a78bf0f3c0f27e91a1eb94b499a9bbe218d1" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54225" method=GET protocol=tls url="/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=28410e5201eeb03428ae97a56e5b2dff08d838d777895a6bc968de67181e8d74" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54225" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=28410e5201eeb03428ae97a56e5b2dff08d838d777895a6bc968de67181e8d74" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54226" method=GET protocol=tls url="/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=dadc72cc8a8640124311c91fe09831ee1d371096f32441b3c1d8a7da60d35cd2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=dadc72cc8a8640124311c91fe09831ee1d371096f32441b3c1d8a7da60d35cd2" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54226" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54227" method=GET protocol=tls url="/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=8c1ec6fb8b03ad8de182f4eba37fb62d04ccac269964b80fc55b73b71c7fa1a1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e/websocket?secret=8c1ec6fb8b03ad8de182f4eba37fb62d04ccac269964b80fc55b73b71c7fa1a1" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54227" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54225" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54228" method=GET protocol=tls url="/1.0/operations/64245292-5746-4507-b2f4-07344651cd6e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54224" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54226" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54227" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d862f838-8eb0-4a2f-9b93-1a190d04b016 local="10.10.10.14:8443" remote="100.122.142.76:54222" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54229" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54230" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Event listener server handler started" id=60eb3fd2-91e5-415e-a6bf-302cd637094a local="10.10.10.14:8443" remote="100.122.142.76:54230" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54231" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54232" method=GET protocol=tls url="/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=3aecbda5fe5c63d580a6bbb2fe9a6dfd76da9a8eb6c9fead15ec2e710daca1b0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54232" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=3aecbda5fe5c63d580a6bbb2fe9a6dfd76da9a8eb6c9fead15ec2e710daca1b0" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54233" method=GET protocol=tls url="/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=c69364621ceef1ee8038dd3d8e2e406641d2f868edaab0d52f73f9f4a2938c61" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54233" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=c69364621ceef1ee8038dd3d8e2e406641d2f868edaab0d52f73f9f4a2938c61" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54234" method=GET protocol=tls url="/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=f128ca4210e939e409342733a16da205210ab3b4944108c0436c02a401ec0b71" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=f128ca4210e939e409342733a16da205210ab3b4944108c0436c02a401ec0b71" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54234" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54235" method=GET protocol=tls url="/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=6c2dfb5c24c7d5611fbd28d70068bd9c7d1305f15421304aeb65edc9bf70ce6b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54235" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50/websocket?secret=6c2dfb5c24c7d5611fbd28d70068bd9c7d1305f15421304aeb65edc9bf70ce6b" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54233" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54236" method=GET protocol=tls url="/1.0/operations/a36b59fb-126a-41b9-b2f6-09216d89ef50?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54232" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54234" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54235" +time="2026-09-12T15:38:31Z" level=debug msg="[nas01] Event listener server handler stopped" listener=60eb3fd2-91e5-415e-a6bf-302cd637094a local="10.10.10.14:8443" remote="100.122.142.76:54230" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54237" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54238" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54239" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54240" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Event listener server handler started" id=0b32a5f0-671f-45cd-9743-0375c16cf3ce local="10.10.10.14:8443" remote="100.122.142.76:54240" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54241" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54242" method=GET protocol=tls url="/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=dc0816889a8c39f2bb671bcb83025030a0594824bdf57d06f11413d586e2cf83" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54242" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=dc0816889a8c39f2bb671bcb83025030a0594824bdf57d06f11413d586e2cf83" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54243" method=GET protocol=tls url="/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=ac239d6cc5304bd4d3153a0ea7b8e650bfdd31e14e5c21420eef673cb7824992" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54243" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=ac239d6cc5304bd4d3153a0ea7b8e650bfdd31e14e5c21420eef673cb7824992" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54244" method=GET protocol=tls url="/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=8ab6454367fa5c619d582a9c4a387051c04f5a3019ade133b66102956e913627" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54244" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=8ab6454367fa5c619d582a9c4a387051c04f5a3019ade133b66102956e913627" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54245" method=GET protocol=tls url="/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=3648172d168df0473c7247dc3e1882a41f1991715d2d1f58a8e7dd8d468571db" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54245" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce/websocket?secret=3648172d168df0473c7247dc3e1882a41f1991715d2d1f58a8e7dd8d468571db" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54243" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54246" method=GET protocol=tls url="/1.0/operations/8fba792d-4c98-45a0-b395-884d6bd7b2ce?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54245" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54244" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54242" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Event listener server handler stopped" listener=0b32a5f0-671f-45cd-9743-0375c16cf3ce local="10.10.10.14:8443" remote="100.122.142.76:54240" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54247" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54248" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Event listener server handler started" id=7d189624-957a-4424-8d8b-282e4ebb4517 local="10.10.10.14:8443" remote="100.122.142.76:54248" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54249" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54250" method=GET protocol=tls url="/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=50b2b46e578c44f481ac188432740650b7cd4ab8d787e4d8d49a7da6f84bd752" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=50b2b46e578c44f481ac188432740650b7cd4ab8d787e4d8d49a7da6f84bd752" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54250" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54251" method=GET protocol=tls url="/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=632562d897690ebe28214add71417b4e532e314109353924ece474422f85ea3b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54251" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=632562d897690ebe28214add71417b4e532e314109353924ece474422f85ea3b" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54252" method=GET protocol=tls url="/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=506b79545ba30e94f671e5e4cea9afa720cdbfb1a8e50361afd0d5bc97c1cbd6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=506b79545ba30e94f671e5e4cea9afa720cdbfb1a8e50361afd0d5bc97c1cbd6" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54252" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54253" method=GET protocol=tls url="/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=3cdb0de05678c47dd3fbb3c82c437c70785ab55a955d2b0d51abfaca4f7a1976" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54253" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab/websocket?secret=3cdb0de05678c47dd3fbb3c82c437c70785ab55a955d2b0d51abfaca4f7a1976" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54251" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54254" method=GET protocol=tls url="/1.0/operations/5a7badfd-e431-4b73-8100-ffc0f238b9ab?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54250" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54252" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54253" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Event listener server handler stopped" listener=7d189624-957a-4424-8d8b-282e4ebb4517 local="10.10.10.14:8443" remote="100.122.142.76:54248" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54255" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54256" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Event listener server handler started" id=00d2243d-75e4-4c3f-866f-9303ff84e2fd local="10.10.10.14:8443" remote="100.122.142.76:54256" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54257" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54258" method=GET protocol=tls url="/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=6afb3f084053b17770cb4ce9969ac0524113f6b8ad7bcf58508cec19aa07f5b1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54258" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=6afb3f084053b17770cb4ce9969ac0524113f6b8ad7bcf58508cec19aa07f5b1" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54259" method=GET protocol=tls url="/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=b57f51da9fd62495f569ff103eceac4fd0831b389ea1788ad968a72d8c55688b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54259" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=b57f51da9fd62495f569ff103eceac4fd0831b389ea1788ad968a72d8c55688b" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54260" method=GET protocol=tls url="/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=f1c013d29862788274514193babd3d790cd878ef55a9970c5d539c1d0ffa2655" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54260" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=f1c013d29862788274514193babd3d790cd878ef55a9970c5d539c1d0ffa2655" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54261" method=GET protocol=tls url="/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=5c9f0dee2376ab8790582c543f3f245c477cde64860f63deae7a5ad3a3b043de" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd/websocket?secret=5c9f0dee2376ab8790582c543f3f245c477cde64860f63deae7a5ad3a3b043de" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54261" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54259" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54262" method=GET protocol=tls url="/1.0/operations/26763e0c-7eca-4e9a-96ad-340b9d8461cd?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54261" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54258" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54260" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Event listener server handler stopped" listener=00d2243d-75e4-4c3f-866f-9303ff84e2fd local="10.10.10.14:8443" remote="100.122.142.76:54256" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54263" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54264" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Event listener server handler started" id=ba61d777-7328-439b-84f9-ea7155d6ed41 local="10.10.10.14:8443" remote="100.122.142.76:54264" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54265" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54266" method=GET protocol=tls url="/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=1808f994498cf26b478b22d3c7e001cbbcc99e4ac654382cfc453f0ecb5856ce" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=1808f994498cf26b478b22d3c7e001cbbcc99e4ac654382cfc453f0ecb5856ce" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54266" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54267" method=GET protocol=tls url="/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=98b646787f8d59d85c901fe939e8b7ed44b464a6821f7e1539ec65ac23534136" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54267" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=98b646787f8d59d85c901fe939e8b7ed44b464a6821f7e1539ec65ac23534136" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54268" method=GET protocol=tls url="/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=b4b4a7437682fb44c5b17421a457113ea55d38090457c55775dfdafa54d72979" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54268" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=b4b4a7437682fb44c5b17421a457113ea55d38090457c55775dfdafa54d72979" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54269" method=GET protocol=tls url="/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=a0831bb48b5bbddbcd8e335a32c6f362eb3d7d76a2ab7a2b66366f95298fea20" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54269" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f/websocket?secret=a0831bb48b5bbddbcd8e335a32c6f362eb3d7d76a2ab7a2b66366f95298fea20" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54267" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54270" method=GET protocol=tls url="/1.0/operations/bdbc8898-e091-467b-ac35-2922c028cf7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54266" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54269" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54268" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ba61d777-7328-439b-84f9-ea7155d6ed41 local="10.10.10.14:8443" remote="100.122.142.76:54264" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54271" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54272" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:38:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.debug.log new file mode 100644 index 0000000..d1b145c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:38:50-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.log new file mode 100644 index 0000000..cf7d59f --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/monitor-delete.log @@ -0,0 +1,171 @@ +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Event listener server handler started" id=264f058d-9703-41b4-bc9f-61322c043609 local="10.10.10.14:8443" remote="100.122.142.76:54453" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54454" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54455" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54457" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54458" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:38:28.512881335Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:38:29.367733407Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:38:29.623502575Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:38:30.251599733Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54459" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54460" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54461" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:50Z" level=debug msg="[nas01] Event listener server handler started" id=e6b6ba0a-27a4-42ec-b2c7-285479ec0eae local="10.10.10.14:8443" remote="100.122.142.76:54461" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54462" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:51Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 15:38:28.512881335 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:38:29.367733407 +0000 UTC" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54463" method=GET protocol=tls url="/1.0/operations/5fb3abdd-a278-4dab-9f56-60aa1e3710e6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54464" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:51Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 15:38:28.512881335 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:38:29.367733407 +0000 UTC" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54465" method=GET protocol=tls url="/1.0/operations/490c81c2-704d-426d-8de8-551289750df3?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 15:38:28.512881335 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:38:29.367733407 +0000 UTC" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e6b6ba0a-27a4-42ec-b2c7-285479ec0eae local="10.10.10.14:8443" remote="100.122.142.76:54461" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54466" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54467" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Event listener server handler started" id=35beb405-ed0d-4556-80ee-9951044ad565 local="10.10.10.14:8443" remote="100.122.142.76:54468" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54468" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54469" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 15:38:29.623502575 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:38:30.251599733 +0000 UTC" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54470" method=GET protocol=tls url="/1.0/operations/b1e4e9a9-d7a4-47da-bb02-110d302f5969?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54474" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 15:38:29.623502575 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:38:30.251599733 +0000 UTC" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54475" method=GET protocol=tls url="/1.0/operations/e7ffd71d-ad58-4ca6-93ea-81bfcdd2f160?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:52Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 15:38:29.623502575 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:38:30.251599733 +0000 UTC" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Event listener server handler stopped" listener=35beb405-ed0d-4556-80ee-9951044ad565 local="10.10.10.14:8443" remote="100.122.142.76:54468" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54477" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54478" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54479" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54480" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54481" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54482" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed updating heartbeat time for member \"10.10.10.13:8443\": database is locked" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54483" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54484" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Completed heartbeat round" duration=4.706869264s +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54485" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54486" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54487" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54488" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54489" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54490" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54491" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54492" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54493" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Event listener server handler started" id=81eaffbd-9d87-47ff-9dac-7117157abe44 local="10.10.10.14:8443" remote="100.122.142.76:54493" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54494" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=f03898dd-5582-4030-9d7a-e85493a84eb2 project=ac-ovn-spike +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=f03898dd-5582-4030-9d7a-e85493a84eb2 project=ac-ovn-spike +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=f03898dd-5582-4030-9d7a-e85493a84eb2 project=ac-ovn-spike +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54495" method=GET protocol=tls url="/1.0/operations/f03898dd-5582-4030-9d7a-e85493a84eb2?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Event listener server handler stopped" listener=81eaffbd-9d87-47ff-9dac-7117157abe44 local="10.10.10.14:8443" remote="100.122.142.76:54493" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54496" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54497" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:38:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/probe.stdout.txt new file mode 100644 index 0000000..4d5a6bc --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/probe.stdout.txt @@ -0,0 +1,135 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.110 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab02 + - lab03 + - nas01 + - lab01 +project: ac-ovn-spike +elapsed_seconds=0.086 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"c71cb648-f999-4c0d-9b33-333a5829fc16","volatile.eth0.host_name":"veth1af313e3","volatile.eth0.hwaddr":"10:66:6a:c1:3a:bb","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4","volatile.uuid.generation":"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:38:28.512881335Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"c71cb648-f999-4c0d-9b33-333a5829fc16","volatile.eth0.host_name":"veth1af313e3","volatile.eth0.hwaddr":"10:66:6a:c1:3a:bb","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4","volatile.uuid.generation":"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:38:29.367733407Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9461760,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fec1:3abb","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:c1:3a:bb","host_name":"veth1af313e3","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4175526,"processes":4,"cpu":{"usage":477770000,"allocated_time":24000000000},"started_at":"2026-09-12T15:38:28.390000104Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"c9cacea9-efce-42bb-9627-7d89f1d3c39c","volatile.eth0.host_name":"veth00b99e0c","volatile.eth0.hwaddr":"10:66:6a:23:36:e5","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"8cf93694-88d2-492c-82b2-f4268a9bce48","volatile.uuid.generation":"8cf93694-88d2-492c-82b2-f4268a9bce48"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:38:29.623502575Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"c9cacea9-efce-42bb-9627-7d89f1d3c39c","volatile.eth0.host_name":"veth00b99e0c","volatile.eth0.hwaddr":"10:66:6a:23:36:e5","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"8cf93694-88d2-492c-82b2-f4268a9bce48","volatile.uuid.generation":"8cf93694-88d2-492c-82b2-f4268a9bce48"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:38:30.251599733Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11243520,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe23:36e5","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:23:36:e5","host_name":"veth00b99e0c","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":33927,"processes":4,"cpu":{"usage":499957000,"allocated_time":24000000000},"started_at":"2026-09-12T15:38:30.25999999Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.096 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.217 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.233 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=0.977 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.667 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.391 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.391/0.678/0.977 ms +elapsed_seconds=2.237 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.254 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.884 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.378 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.378/0.838/1.254 ms +elapsed_seconds=2.198 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.165 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.603 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.891 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.891/1.553/2.165 ms +elapsed_seconds=2.350 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.300 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.553 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.846 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.846/1.566/2.300 ms +elapsed_seconds=2.487 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.184 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.225 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.294 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.323 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.028 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.115235 bytes_per_second=867791903 +elapsed_seconds=0.368 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.480 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.144505 bytes_per_second=692017577 +elapsed_seconds=0.404 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.474 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/tcpdump-arp.log new file mode 100644 index 0000000..028df6d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +15:38:36.549262 10:66:6a:74:95:5e > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +15:38:44.550274 10:66:6a:74:95:5e > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/topology.jsonl new file mode 100644 index 0000000..6ae83f2 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-2/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.082, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.124, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.602, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.094, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.226, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.456, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:38:28.491031468Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"c9ab7c84-e9e2-47b0-b49a-f3473b126f52\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:38:28.491031468Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.632, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.454, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:38:29.573445512Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"72f0b347-00b7-4928-a17f-afe771ea0be0\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:38:29.573445512Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.387, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.257, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 142192000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 6225920,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fec1:3abb\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth1af313e3\",\n\t\t\t\"hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4175526,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:38:28.390000104Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.207, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 129643000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 7020544,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe23:36e5\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 758,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 3,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"veth00b99e0c\",\n\t\t\t\"hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 33927,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:38:30.25999999Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.087, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t},\n\t\"created_at\": \"2026-09-12T15:38:28.512881335Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:38:29.367733407Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t},\n\t\"created_at\": \"2026-09-12T15:38:29.623502575Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:38:30.251599733Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.228, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.778 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.778/1.778/1.778 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.305, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.189, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.267, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.322, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-029xxltq/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.212, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.265, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.624, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.024701 seconds, 3.8GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.492, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.026000 seconds, 3.6GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.102, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.278, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:38:28.512881335Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c71cb648-f999-4c0d-9b33-333a5829fc16\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1af313e3\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c1:3a:bb\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\",\n\t\t\t\"volatile.uuid.generation\": \"90bf0511-1a3a-4a7a-88bd-3fcd3e5a44e4\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:38:29.367733407Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:38:29.623502575Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"c9cacea9-efce-42bb-9627-7d89f1d3c39c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth00b99e0c\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:23:36:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\",\n\t\t\t\"volatile.uuid.generation\": \"8cf93694-88d2-492c-82b2-f4268a9bce48\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:38:30.251599733Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.977, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.975, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.084, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.146, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.188, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T15:38:29.668534686Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T15:38:28.37482516Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.188, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.089, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/commands.jsonl new file mode 100644 index 0000000..cd7b37b --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.086, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:39:57.566944+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.301, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:39:57.868154+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.086, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T15:39:57.954922+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 90034, "ready": true, "ready_signal": "time=\"2026-09-12T08:39:58-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:39:58.041717+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/topology.jsonl", "create"], "seconds": 8.302, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.633,\n \"first_cross_member_ping_seconds\": 2.886,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:06.343884+00:00"} +{"capture": "monitor-create", "pid": 90034, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.log", "ready_signal": "time=\"2026-09-12T08:39:58-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:40:06.349221+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.09, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:06.439893+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.088, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:1b:1a:b9 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8c:72:d6 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:06.528412+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.112, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 04323d40-8eb1-4c65-9c34-3eb382295967 (incus-net34-ls-int)\n port incus-net34-ls-int-lsp-router\n type: router\n router-port: incus-net34-lr-lrp-int\n port incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0\n addresses: [\"10:66:6a:8c:72:d6 dynamic\"]\n port incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0\n addresses: [\"10:66:6a:1b:1a:b9 dynamic\"]\nswitch 7cd84ea4-8717-469c-8a9f-78955f4144c2 (incus-net34-ls-ext)\n port incus-net34-ls-ext-lsp-router\n type: router\n router-port: incus-net34-lr-lrp-ext\n port incus-net34-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter ca7f835d-4d26-4657-8b8b-5ee13034d3dc (incus-net34-lr)\n port incus-net34-lr-lrp-int\n mac: \"10:66:6a:1f:21:eb\"\n ipv6-lla: \"fe80::1266:6aff:fe1f:21eb\"\n networks: [\"10.253.73.1/24\"]\n port incus-net34-lr-lrp-ext\n mac: \"10:66:6a:1f:21:eb\"\n ipv6-lla: \"fe80::1266:6aff:fe1f:21eb\"\n networks: [\"10.10.40.64/24\"]\n nat 72851b93-c069-486d-b9b3-a43662ddf78a\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net34-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 98c85b2a-a4c9-4669-989f-4ca96e12bb43\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : b849a7aa-daf1-4d31-970d-d8b5b85fea81\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:1f:21:eb\"\nname : incus-net34-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n\n_uuid : 09e71232-9004-4c34-96f4-3518ffd3acc5\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:1f:21:eb\"\nname : incus-net34-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 992d367c-6088-4643-80dd-1c4bd0ef409f\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : e93106aa-f3ee-4afc-accf-288c64ce59e7\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : b4f895d1-e30e-4df5-b237-e614307f3691\nlogical_port : cr-incus-net34-lr-lrp-ext\nmac : [\"10:66:6a:1f:21:eb 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net34-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:1f:21:eb STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:40:06.641519+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.369, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:1f:21:eb DELAY \n", "stderr": "", "error": null, "at": "2026-09-12T15:40:07.010781+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.272, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600323154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84223|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600323361\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84224|bridge|INFO|bridge incusovn16: using datapath ID 0000029060073245\"\n },\n {\n \"at\": \"1789227600323393\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84225|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600326702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600326803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600326854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600326886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600326917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600326946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600326969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600326994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600327069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600327157\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600327182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600327224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600327284\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600327363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84227|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600327390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600327413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600327437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600327457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600327481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600327513\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327557\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600327598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600327668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600327692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600327739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600327805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600327868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600327902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84228|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600327938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600327963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600327979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600327997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600328018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600328031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600328105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600328118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600328131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600328148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600328165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600328190\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600328205\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600328217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600328230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328243\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600419629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler232)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600419735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler232)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600419788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600419834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600419875\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xb6d77bf3 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600419917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600419958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600419990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600420031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600420098\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420198\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420272\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600420312\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600420344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600420381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600420409\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420438\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600420526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600420561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600420594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600420643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600420673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600420789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600420827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600420894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600420993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600421024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600421059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600421732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84229|dpif|WARN|Dropped 964 log messages in last 68 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227600422000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84231|bridge|WARN|Dropped 38994 log messages in last 86 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227600422082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84232|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227600422117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84233|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422272\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler232)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600422439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler232)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600422480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600422527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600422568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xf72bdb48 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600422606\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600422636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600422662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600422691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600422728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600422760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600422785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600422809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878422ms\"\n },\n {\n \"at\": \"1789227600422839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +715ms\"\n },\n {\n \"at\": \"1789227600422871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -95ms\"\n },\n {\n \"at\": \"1789227600422912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600422947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600422976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600423042\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600423136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600423166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600423231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600423266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600423326\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600423370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600423403\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600423430\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600423459\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600423495\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600423525\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600423554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +715ms\"\n },\n {\n \"at\": \"1789227600423582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -95ms\"\n },\n {\n \"at\": \"1789227600423611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600423644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600423672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600423743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600423833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600423864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600423922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler233)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600424052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler233)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600424096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600424126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600424153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xcb07ad63 your_disc:0x212d2dc2\"\n },\n {\n \"at\": \"1789227600424187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600424223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600424251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600424283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600424351\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600424384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600424413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878423ms\"\n },\n {\n \"at\": \"1789227600424454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +864ms\"\n },\n {\n \"at\": \"1789227600424495\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227600424525\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600424561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600424599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600424628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600424657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600424742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600424778\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600424802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600424845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600424872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler233)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600424967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600424995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600425026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600425059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600425093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600425125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600425155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +864ms\"\n },\n {\n \"at\": \"1789227600425183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227600425217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600425245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600425269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600425296\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600425323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600425456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600425491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600425526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600425561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425586\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600425659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84235|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600426321\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600429602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84237|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227600429696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84238|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227601368756\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601368982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601368999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601369020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601369036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601369052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601369067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601369088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +688ms\"\n },\n {\n \"at\": \"1789227601369107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -182ms\"\n },\n {\n \"at\": \"1789227601369128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601369138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601369158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601369168\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227601369182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601369224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601369245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601369257\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227601369273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601369283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369292\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601372512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601372574\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601372614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601372652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601372666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601372675\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601372689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +2999ms\"\n },\n {\n \"at\": \"1789227601372699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +604ms\"\n },\n {\n \"at\": \"1789227601372713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -236ms\"\n },\n {\n \"at\": \"1789227601372732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601372746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601372758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601372774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601372784\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601372829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601372839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601372854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601372867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601372878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601419519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84239|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227601419598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227601759107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84241|bridge|INFO|bridge br-int: added interface veth87094e38 on port 32\"\n },\n {\n \"at\": \"1789227602390787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84242|poll_loop|INFO|Dropped 6237 log messages in last 72 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227602391010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84243|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602391261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84244|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602391734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84245|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602392203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84246|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602392684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84247|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602393155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602393686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84249|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602394160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84250|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602394631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84251|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602395096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84252|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602419754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84253|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227602419803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227603419564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84255|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227603419759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227604419547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84257|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227604419648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227605419575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84259|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227605419680\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227606419941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84261|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227606420165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84262|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:07.285466+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.166, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600308828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00199|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600308997\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00200|bridge|INFO|bridge incusovn16: using datapath ID 0000da03ba4e5146\"\n },\n {\n \"at\": \"1789227600309016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00201|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600310955\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00202|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600310998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311028\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311062\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311075\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311133\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600311147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311168\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00203|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311267\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311306\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600311329\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311353\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311392\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311410\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311423\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600311437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311481\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311492\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311502\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311513\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00204|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311578\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311588\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311599\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311620\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600311693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311704\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311714\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311735\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311757\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600314985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler234)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600315026\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler234)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600315042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600315054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600315069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x212d2dc2 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600315082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600315094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600315113\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600315126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315137\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600315147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315191\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315207\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600315229\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600315241\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315252\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600315262\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600315296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600315308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600315331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600315342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315355\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600315378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600315389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315409\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600315419\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315440\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600315453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315473\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600315483\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600315494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600315526\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315537\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315549\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600315559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600315570\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600315591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315604\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600406792\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00205|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600406866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227600407302\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler234)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600407561\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler234)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600407825\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600407881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600407907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xad7dc31c your_disc:0x0\"\n },\n {\n \"at\": \"1789227600407931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600407956\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600407975\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600407995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600408042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408085\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600408183\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600408204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408225\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600408244\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600408308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600408330\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600408374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600408401\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408425\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408445\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600408468\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600408489\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600408531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408550\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408571\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600408592\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408611\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600408652\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600408672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600408710\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408749\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600408767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600408788\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408810\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600408837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408858\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600410387\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler234)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600410459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler234)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600410490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600410514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600410535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x51112844 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600410557\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600410581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600410603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600410624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600410644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600410664\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600410684\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600410703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855409ms\"\n },\n {\n \"at\": \"1789227600410730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +671ms\"\n },\n {\n \"at\": \"1789227600410753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227600410778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600410797\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600410818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600410840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600410859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600410884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600410903\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600410924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600410943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600410963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600410989\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600411014\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600411056\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600411116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600411138\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600411161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600411185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600411206\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600411229\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600411249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227600411271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227600411296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600411317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600411341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600411362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600411382\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411407\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600411450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600411470\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600411491\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600411512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411532\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600414228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600414278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227601275179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601275317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601275350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601275377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601275416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601275437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601275459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601275479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789227601275507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227601275531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601275555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601275580\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601275602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227601275624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601275694\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601275725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601275747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227601275766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601275794\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275816\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601310379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601310547\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601310569\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601310585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601310598\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601310613\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601310633\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601310643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227601310656\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -228ms\"\n },\n {\n \"at\": \"1789227601310669\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601310681\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601310691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601310703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601310716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601310748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601310759\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601310770\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601310780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601310791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601387273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601387344\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601387372\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601387399\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601387430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601387450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601387471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601387493\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +904ms\"\n },\n {\n \"at\": \"1789227601387518\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -66ms\"\n },\n {\n \"at\": \"1789227601387542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601387562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601387581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601387600\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227601387620\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387638\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387665\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601387686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601387705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601387727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227601387748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601387768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387789\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:07.451884+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.167, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600308826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600309184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: using datapath ID 00006e15b6d09e4a\"\n },\n {\n \"at\": \"1789227600309210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00221|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600311215\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00222|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311337\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311442\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600311453\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311464\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311524\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311548\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600318656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00223|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600318716\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600318734\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600318749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600318766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600318782\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600318799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318842\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318858\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600318873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600318888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600318902\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600318916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600318930\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600318946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600318960\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600318972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600318993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600319007\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319024\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600319053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00224|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600319071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600319092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600319106\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600319119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600319136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600319148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319159\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319169\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600319194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600319205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600319217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600319231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600319241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600319265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600319276\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600319288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600319299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319309\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600406904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00225|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600406948\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00226|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227600414131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00227|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600414191\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00228|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227601083289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler238)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601083374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler238)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601083411\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601083440\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601083463\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xf95a54e0 your_disc:0x51112844\"\n },\n {\n \"at\": \"1789227601083487\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601083516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601083538\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601083561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601083588\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601083614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601083634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601083671\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756081ms\"\n },\n {\n \"at\": \"1789227601083701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +228ms\"\n },\n {\n \"at\": \"1789227601083774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -672ms\"\n },\n {\n \"at\": \"1789227601083805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601083826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601083856\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601083878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601083900\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601083922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601083946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601083971\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601083994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601084041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601084071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601084134\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler238)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601084158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601084180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601084200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601084221\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601084242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601084266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601084291\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +228ms\"\n },\n {\n \"at\": \"1789227601084312\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -672ms\"\n },\n {\n \"at\": \"1789227601084334\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601084355\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601084381\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084402\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601084422\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084467\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601084489\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601084510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084537\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601084558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084604\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler227)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601127220\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler227)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601127253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601127277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601127300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x1630de88 your_disc:0xf72bdb48\"\n },\n {\n \"at\": \"1789227601127326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601127351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601127373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601127397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601127445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127470\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756125ms\"\n },\n {\n \"at\": \"1789227601127518\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +174ms\"\n },\n {\n \"at\": \"1789227601127544\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789227601127568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601127591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601127620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601127649\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601127679\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127726\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601127749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601127769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601127792\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601127814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601127837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127857\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127879\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler227)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601127906\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601127932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601127975\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127998\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601128018\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601128040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +174ms\"\n },\n {\n \"at\": \"1789227601128077\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789227601128099\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601128121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601128144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601128167\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601128189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128214\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601128258\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601128279\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601128300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601128320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128339\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601278873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler238)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601278965\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler238)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601278999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601279023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601279045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xb11b3398 your_disc:0xff225141\"\n },\n {\n \"at\": \"1789227601279078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601279105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601279130\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601279154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601279208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279230\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756276ms\"\n },\n {\n \"at\": \"1789227601279286\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +603ms\"\n },\n {\n \"at\": \"1789227601279320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -157ms\"\n },\n {\n \"at\": \"1789227601279356\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601279382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601279404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227601279452\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279482\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279511\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601279533\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601279558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227601279606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601279630\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279653\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279676\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler238)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601279702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601279723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601279772\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279793\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601279836\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +603ms\"\n },\n {\n \"at\": \"1789227601279866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -157ms\"\n },\n {\n \"at\": \"1789227601279887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601279908\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601279929\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279952\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227601279977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280024\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601280047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601280078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601280102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227601280123\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602535628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00229|bridge|INFO|bridge br-int: added interface veth1f9ee21d on port 30\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:07.619634+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.175, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600118307\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00203|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600118502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00204|bridge|INFO|bridge incusovn16: using datapath ID 00003618ee9ea341\"\n },\n {\n \"at\": \"1789227600118547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00205|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600216246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600216361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227600224873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600225007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789227600311963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00210|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600312016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600312034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600312046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600312057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600312069\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600312123\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600312140\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600312152\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600312163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600312175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312185\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600312198\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600312208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600312219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600312229\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600312266\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600315844\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler241)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600315998\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler241)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600316020\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600316050\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600316068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xff225141 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600316093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600316114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600316129\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600316143\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316173\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316188\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316207\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982179ms\"\n },\n {\n \"at\": \"1789227600316225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +967ms\"\n },\n {\n \"at\": \"1789227600316243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227600316260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600316276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600316303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316319\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600316335\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316350\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316367\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600316384\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600316402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316417\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600316434\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600316452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600316514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600316534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316615\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600316642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +967ms\"\n },\n {\n \"at\": \"1789227600316660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227600316683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600316704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600316719\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600316749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316763\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316777\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600316792\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600316807\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316826\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600316843\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316862\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316890\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00211|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600316906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600316926\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316961\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600316995\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317045\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600317059\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317074\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317088\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600317105\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600317119\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600317148\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600317195\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317210\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600317239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00212|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600317255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600317270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600317285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600317299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600317317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600317331\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600317392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600317439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600317452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600317482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317495\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600317524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600417197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler241)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600417323\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler241)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600417358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600417381\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600417397\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xebd194f6 your_disc:0xad7dc31c\"\n },\n {\n \"at\": \"1789227600417420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600417436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600417457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600417472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417486\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600417500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982281ms\"\n },\n {\n \"at\": \"1789227600417548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +975ms\"\n },\n {\n \"at\": \"1789227600417563\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227600417585\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600417600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600417615\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600417630\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600417645\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600417690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600417713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600417733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600417763\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600417778\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler241)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600417847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600417869\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600417911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417954\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600418001\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +975ms\"\n },\n {\n \"at\": \"1789227600418018\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227600418033\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600418048\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600418062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600418076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600418090\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418120\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600418134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600418148\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600418162\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600418177\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418207\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler241)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600420906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler241)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600420933\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600420948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600420963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb1dad778 your_disc:0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600420980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600420994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600421009\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600421024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600421053\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421067\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982284ms\"\n },\n {\n \"at\": \"1789227600421096\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +772ms\"\n },\n {\n \"at\": \"1789227600421111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227600421131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600421252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421266\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421281\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600421295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421324\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler241)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600421346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600421360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600421393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600421436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +771ms\"\n },\n {\n \"at\": \"1789227600421450\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789227600421465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421507\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421522\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421536\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600421581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421597\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421613\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602068508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227602068908\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227602068952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602068981\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227602069015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227602069036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227602069062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227602069090\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +804ms\"\n },\n {\n \"at\": \"1789227602069121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -26ms\"\n },\n {\n \"at\": \"1789227602069156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227602069185\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227602069225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227602069253\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227602069282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227602069373\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227602069401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227602069429\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227602069458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227602069485\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069520\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:07.794997+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-before-probe.txt", "router_mac": "10:66:6a:1f:21:eb", "at": "2026-09-12T15:40:07.796379+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.091, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:40:01.27122137Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:40:01.848300453Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:40:02.076644578Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:40:02.613021579Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:07.887613+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 90570, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T15:40:08.062405+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.476, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.106 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.094 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\"volatile.eth0.host_name\":\"veth87094e38\",\"volatile.eth0.hwaddr\":\"10:66:6a:1b:1a:b9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"cd170a60-a186-4715-8e91-927e2fd2163d\",\"volatile.uuid.generation\":\"cd170a60-a186-4715-8e91-927e2fd2163d\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:40:01.27122137Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\"volatile.eth0.host_name\":\"veth87094e38\",\"volatile.eth0.hwaddr\":\"10:66:6a:1b:1a:b9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"cd170a60-a186-4715-8e91-927e2fd2163d\",\"volatile.uuid.generation\":\"cd170a60-a186-4715-8e91-927e2fd2163d\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:40:01.848300453Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9433088,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe1b:1ab9\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:1b:1a:b9\",\"host_name\":\"veth87094e38\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4176513,\"processes\":4,\"cpu\":{\"usage\":488736000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:40:00.859999895Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\"volatile.eth0.host_name\":\"veth1f9ee21d\",\"volatile.eth0.hwaddr\":\"10:66:6a:8c:72:d6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\",\"volatile.uuid.generation\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:40:02.076644578Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\"volatile.eth0.host_name\":\"veth1f9ee21d\",\"volatile.eth0.hwaddr\":\"10:66:6a:8c:72:d6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\",\"volatile.uuid.generation\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:40:02.613021579Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11571200,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe8c:72d6\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:8c:72:d6\",\"host_name\":\"veth1f9ee21d\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":34640,\"processes\":4,\"cpu\":{\"usage\":488719000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:40:02.619999885Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.523 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.244 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.249 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.308 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=1.078 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.475 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.475/0.953/1.308 ms\nelapsed_seconds=2.236 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.950 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.693 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.285 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.285/0.642/0.950 ms\nelapsed_seconds=2.659 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.296 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.218 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.619 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.619/1.377/2.296 ms\nelapsed_seconds=2.192 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.176 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.155 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.089 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.089/1.473/2.176 ms\nelapsed_seconds=2.275 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.310 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.267 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.324 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.279 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.029 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.128441 bytes_per_second=778567591\nelapsed_seconds=0.375 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.500 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.109174 bytes_per_second=915969003\nelapsed_seconds=0.347 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.506 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:22.539284+00:00"} +{"capture": "tcpdump-arp", "pid": 90570, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T15:40:22.541939+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:22.627792+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.094, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:1b:1a:b9 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8c:72:d6 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:22.721921+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.116, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 04323d40-8eb1-4c65-9c34-3eb382295967 (incus-net34-ls-int)\n port incus-net34-ls-int-lsp-router\n type: router\n router-port: incus-net34-lr-lrp-int\n port incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0\n addresses: [\"10:66:6a:8c:72:d6 dynamic\"]\n port incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0\n addresses: [\"10:66:6a:1b:1a:b9 dynamic\"]\nswitch 7cd84ea4-8717-469c-8a9f-78955f4144c2 (incus-net34-ls-ext)\n port incus-net34-ls-ext-lsp-router\n type: router\n router-port: incus-net34-lr-lrp-ext\n port incus-net34-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter ca7f835d-4d26-4657-8b8b-5ee13034d3dc (incus-net34-lr)\n port incus-net34-lr-lrp-int\n mac: \"10:66:6a:1f:21:eb\"\n ipv6-lla: \"fe80::1266:6aff:fe1f:21eb\"\n networks: [\"10.253.73.1/24\"]\n port incus-net34-lr-lrp-ext\n mac: \"10:66:6a:1f:21:eb\"\n ipv6-lla: \"fe80::1266:6aff:fe1f:21eb\"\n networks: [\"10.10.40.64/24\"]\n nat 72851b93-c069-486d-b9b3-a43662ddf78a\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net34-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 98c85b2a-a4c9-4669-989f-4ca96e12bb43\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : b849a7aa-daf1-4d31-970d-d8b5b85fea81\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:1f:21:eb\"\nname : incus-net34-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n\n_uuid : 09e71232-9004-4c34-96f4-3518ffd3acc5\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:1f:21:eb\"\nname : incus-net34-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 992d367c-6088-4643-80dd-1c4bd0ef409f\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : e93106aa-f3ee-4afc-accf-288c64ce59e7\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : b4f895d1-e30e-4df5-b237-e614307f3691\nlogical_port : cr-incus-net34-lr-lrp-ext\nmac : [\"10:66:6a:1f:21:eb 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net34-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:1f:21:eb STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:40:22.837917+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.321, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:1f:21:eb REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:40:23.159766+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.255, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600323154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84223|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600323361\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84224|bridge|INFO|bridge incusovn16: using datapath ID 0000029060073245\"\n },\n {\n \"at\": \"1789227600323393\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84225|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600326702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600326803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600326854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600326886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600326917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600326946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600326969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600326994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600327069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600327157\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600327182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600327224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600327284\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600327363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84227|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600327390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600327413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600327437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600327457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600327481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600327513\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327557\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600327598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600327668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600327692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600327739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600327805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600327868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600327902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84228|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600327938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600327963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600327979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600327997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600328018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600328031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600328105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600328118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600328131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600328148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600328165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600328190\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600328205\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600328217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600328230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328243\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600419629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler232)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600419735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler232)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600419788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600419834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600419875\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xb6d77bf3 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600419917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600419958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600419990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600420031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600420098\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420198\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420272\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600420312\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600420344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600420381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600420409\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420438\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600420526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600420561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600420594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600420643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600420673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600420789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600420827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600420894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600420993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600421024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600421059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600421732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84229|dpif|WARN|Dropped 964 log messages in last 68 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227600422000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84231|bridge|WARN|Dropped 38994 log messages in last 86 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227600422082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84232|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227600422117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84233|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422272\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler232)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600422439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler232)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600422480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600422527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600422568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xf72bdb48 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600422606\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600422636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600422662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600422691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600422728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600422760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600422785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600422809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878422ms\"\n },\n {\n \"at\": \"1789227600422839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +715ms\"\n },\n {\n \"at\": \"1789227600422871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -95ms\"\n },\n {\n \"at\": \"1789227600422912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600422947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600422976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600423042\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600423136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600423166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600423231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600423266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600423326\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600423370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600423403\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600423430\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600423459\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600423495\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600423525\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600423554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +715ms\"\n },\n {\n \"at\": \"1789227600423582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -95ms\"\n },\n {\n \"at\": \"1789227600423611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600423644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600423672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600423743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600423833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600423864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600423922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler233)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600424052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler233)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600424096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600424126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600424153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xcb07ad63 your_disc:0x212d2dc2\"\n },\n {\n \"at\": \"1789227600424187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600424223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600424251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600424283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600424351\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600424384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600424413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878423ms\"\n },\n {\n \"at\": \"1789227600424454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +864ms\"\n },\n {\n \"at\": \"1789227600424495\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227600424525\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600424561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600424599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600424628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600424657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600424742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600424778\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600424802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600424845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600424872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler233)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600424967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600424995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600425026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600425059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600425093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600425125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600425155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +864ms\"\n },\n {\n \"at\": \"1789227600425183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227600425217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600425245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600425269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600425296\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600425323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600425456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600425491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600425526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600425561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425586\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600425659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84235|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600426321\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600429602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84237|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227600429696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84238|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227601368756\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601368982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601368999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601369020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601369036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601369052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601369067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601369088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +688ms\"\n },\n {\n \"at\": \"1789227601369107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -182ms\"\n },\n {\n \"at\": \"1789227601369128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601369138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601369158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601369168\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227601369182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601369224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601369245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601369257\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227601369273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601369283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369292\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601372512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601372574\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601372614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601372652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601372666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601372675\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601372689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +2999ms\"\n },\n {\n \"at\": \"1789227601372699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +604ms\"\n },\n {\n \"at\": \"1789227601372713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -236ms\"\n },\n {\n \"at\": \"1789227601372732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601372746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601372758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601372774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601372784\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601372829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601372839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601372854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601372867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601372878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601419519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84239|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227601419598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227601759107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84241|bridge|INFO|bridge br-int: added interface veth87094e38 on port 32\"\n },\n {\n \"at\": \"1789227602390787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84242|poll_loop|INFO|Dropped 6237 log messages in last 72 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227602391010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84243|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602391261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84244|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602391734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84245|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602392203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84246|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602392684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84247|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602393155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602393686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84249|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602394160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84250|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602394631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84251|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602395096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84252|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602419754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84253|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227602419803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227603419564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84255|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227603419759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227604419547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84257|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227604419648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227605419575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84259|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227605419680\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227606419941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84261|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227606420165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84262|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227607419608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84263|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227607419723\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84264|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227608390692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84265|poll_loop|INFO|Dropped 12473 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227608390909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84266|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227608419497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84267|dpif|WARN|Dropped 2103 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227608419549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227609419790\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84269|dpif|WARN|Dropped 2115 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227609420007\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227610419920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84271|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227610420174\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84272|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227611419606\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84273|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227611419718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227612419866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84275|dpif|WARN|Dropped 2119 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227612420068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227613419677\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84277|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227613419789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227614390591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84279|poll_loop|INFO|Dropped 12515 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227614390802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84280|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227614419603\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84281|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227614419663\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227615419631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84283|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227615419836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227616419769\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84285|dpif|WARN|Dropped 2092 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227616419973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84286|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227617419812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84287|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227617420125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227618419872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84289|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227618420193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227619419817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84291|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227619419935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227620390901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84293|poll_loop|INFO|Dropped 12374 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227620391009\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227620419643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84295|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227620419728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227621419912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84297|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227621420116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227622419713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84299|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227622419819\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84300|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227623419586\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84301|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227623419766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:23.420763+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.199, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600308828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00199|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600308997\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00200|bridge|INFO|bridge incusovn16: using datapath ID 0000da03ba4e5146\"\n },\n {\n \"at\": \"1789227600309016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00201|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600310955\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00202|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600310998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311028\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311062\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311075\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311133\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600311147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311168\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00203|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311267\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311306\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600311329\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311353\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311392\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311410\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311423\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600311437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311481\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311492\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311502\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311513\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00204|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311578\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311588\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311599\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311620\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600311693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311704\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311714\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311735\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311757\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600314985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler234)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600315026\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler234)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600315042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600315054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600315069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x212d2dc2 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600315082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600315094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600315113\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600315126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315137\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600315147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315191\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315207\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600315229\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600315241\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315252\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600315262\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600315296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600315308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600315331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600315342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315355\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600315378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600315389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315409\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600315419\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315440\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600315453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315473\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600315483\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600315494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600315526\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315537\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315549\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600315559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600315570\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600315591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315604\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600406792\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00205|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600406866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227600407302\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler234)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600407561\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler234)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600407825\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600407881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600407907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xad7dc31c your_disc:0x0\"\n },\n {\n \"at\": \"1789227600407931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600407956\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600407975\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600407995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600408042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408085\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600408183\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600408204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408225\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600408244\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600408308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600408330\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600408374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600408401\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408425\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408445\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600408468\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600408489\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600408531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408550\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408571\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600408592\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408611\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600408652\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600408672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600408710\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408749\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600408767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600408788\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408810\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600408837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408858\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600410387\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler234)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600410459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler234)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600410490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600410514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600410535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x51112844 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600410557\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600410581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600410603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600410624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600410644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600410664\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600410684\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600410703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855409ms\"\n },\n {\n \"at\": \"1789227600410730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +671ms\"\n },\n {\n \"at\": \"1789227600410753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227600410778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600410797\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600410818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600410840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600410859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600410884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600410903\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600410924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600410943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600410963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600410989\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600411014\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600411056\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600411116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600411138\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600411161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600411185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600411206\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600411229\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600411249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227600411271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227600411296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600411317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600411341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600411362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600411382\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411407\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600411450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600411470\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600411491\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600411512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411532\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600414228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600414278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227601275179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601275317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601275350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601275377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601275416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601275437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601275459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601275479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789227601275507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227601275531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601275555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601275580\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601275602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227601275624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601275694\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601275725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601275747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227601275766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601275794\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275816\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601310379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601310547\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601310569\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601310585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601310598\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601310613\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601310633\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601310643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227601310656\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -228ms\"\n },\n {\n \"at\": \"1789227601310669\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601310681\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601310691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601310703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601310716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601310748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601310759\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601310770\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601310780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601310791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601387273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601387344\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601387372\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601387399\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601387430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601387450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601387471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601387493\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +904ms\"\n },\n {\n \"at\": \"1789227601387518\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -66ms\"\n },\n {\n \"at\": \"1789227601387542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601387562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601387581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601387600\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227601387620\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387638\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387665\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601387686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601387705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601387727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227601387748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601387768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387789\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:23.620822+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.165, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600308826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600309184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: using datapath ID 00006e15b6d09e4a\"\n },\n {\n \"at\": \"1789227600309210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00221|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600311215\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00222|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311337\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311442\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600311453\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311464\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311524\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311548\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600318656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00223|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600318716\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600318734\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600318749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600318766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600318782\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600318799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318842\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318858\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600318873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600318888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600318902\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600318916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600318930\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600318946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600318960\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600318972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600318993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600319007\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319024\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600319053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00224|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600319071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600319092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600319106\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600319119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600319136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600319148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319159\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319169\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600319194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600319205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600319217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600319231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600319241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600319265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600319276\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600319288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600319299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319309\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600406904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00225|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600406948\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00226|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227600414131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00227|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600414191\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00228|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227601083289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler238)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601083374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler238)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601083411\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601083440\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601083463\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xf95a54e0 your_disc:0x51112844\"\n },\n {\n \"at\": \"1789227601083487\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601083516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601083538\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601083561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601083588\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601083614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601083634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601083671\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756081ms\"\n },\n {\n \"at\": \"1789227601083701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +228ms\"\n },\n {\n \"at\": \"1789227601083774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -672ms\"\n },\n {\n \"at\": \"1789227601083805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601083826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601083856\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601083878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601083900\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601083922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601083946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601083971\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601083994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601084041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601084071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601084134\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler238)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601084158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601084180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601084200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601084221\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601084242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601084266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601084291\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +228ms\"\n },\n {\n \"at\": \"1789227601084312\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -672ms\"\n },\n {\n \"at\": \"1789227601084334\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601084355\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601084381\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084402\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601084422\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084467\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601084489\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601084510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084537\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601084558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084604\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler227)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601127220\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler227)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601127253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601127277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601127300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x1630de88 your_disc:0xf72bdb48\"\n },\n {\n \"at\": \"1789227601127326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601127351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601127373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601127397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601127445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127470\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756125ms\"\n },\n {\n \"at\": \"1789227601127518\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +174ms\"\n },\n {\n \"at\": \"1789227601127544\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789227601127568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601127591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601127620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601127649\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601127679\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127726\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601127749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601127769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601127792\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601127814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601127837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127857\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127879\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler227)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601127906\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601127932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601127975\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127998\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601128018\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601128040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +174ms\"\n },\n {\n \"at\": \"1789227601128077\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789227601128099\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601128121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601128144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601128167\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601128189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128214\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601128258\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601128279\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601128300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601128320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128339\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601278873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler238)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601278965\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler238)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601278999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601279023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601279045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xb11b3398 your_disc:0xff225141\"\n },\n {\n \"at\": \"1789227601279078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601279105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601279130\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601279154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601279208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279230\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756276ms\"\n },\n {\n \"at\": \"1789227601279286\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +603ms\"\n },\n {\n \"at\": \"1789227601279320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -157ms\"\n },\n {\n \"at\": \"1789227601279356\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601279382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601279404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227601279452\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279482\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279511\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601279533\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601279558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227601279606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601279630\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279653\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279676\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler238)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601279702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601279723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601279772\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279793\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601279836\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +603ms\"\n },\n {\n \"at\": \"1789227601279866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -157ms\"\n },\n {\n \"at\": \"1789227601279887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601279908\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601279929\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279952\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227601279977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280024\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601280047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601280078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601280102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227601280123\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602535628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00229|bridge|INFO|bridge br-int: added interface veth1f9ee21d on port 30\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:23.786947+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.171, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600118307\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00203|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600118502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00204|bridge|INFO|bridge incusovn16: using datapath ID 00003618ee9ea341\"\n },\n {\n \"at\": \"1789227600118547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00205|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600216246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600216361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227600224873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600225007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789227600311963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00210|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600312016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600312034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600312046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600312057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600312069\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600312123\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600312140\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600312152\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600312163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600312175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312185\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600312198\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600312208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600312219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600312229\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600312266\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600315844\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler241)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600315998\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler241)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600316020\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600316050\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600316068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xff225141 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600316093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600316114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600316129\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600316143\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316173\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316188\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316207\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982179ms\"\n },\n {\n \"at\": \"1789227600316225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +967ms\"\n },\n {\n \"at\": \"1789227600316243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227600316260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600316276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600316303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316319\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600316335\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316350\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316367\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600316384\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600316402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316417\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600316434\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600316452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600316514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600316534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316615\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600316642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +967ms\"\n },\n {\n \"at\": \"1789227600316660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227600316683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600316704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600316719\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600316749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316763\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316777\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600316792\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600316807\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316826\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600316843\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316862\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316890\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00211|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600316906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600316926\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316961\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600316995\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317045\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600317059\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317074\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317088\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600317105\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600317119\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600317148\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600317195\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317210\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600317239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00212|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600317255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600317270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600317285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600317299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600317317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600317331\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600317392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600317439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600317452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600317482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317495\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600317524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600417197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler241)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600417323\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler241)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600417358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600417381\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600417397\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xebd194f6 your_disc:0xad7dc31c\"\n },\n {\n \"at\": \"1789227600417420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600417436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600417457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600417472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417486\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600417500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982281ms\"\n },\n {\n \"at\": \"1789227600417548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +975ms\"\n },\n {\n \"at\": \"1789227600417563\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227600417585\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600417600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600417615\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600417630\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600417645\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600417690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600417713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600417733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600417763\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600417778\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler241)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600417847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600417869\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600417911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417954\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600418001\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +975ms\"\n },\n {\n \"at\": \"1789227600418018\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227600418033\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600418048\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600418062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600418076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600418090\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418120\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600418134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600418148\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600418162\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600418177\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418207\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler241)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600420906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler241)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600420933\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600420948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600420963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb1dad778 your_disc:0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600420980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600420994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600421009\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600421024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600421053\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421067\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982284ms\"\n },\n {\n \"at\": \"1789227600421096\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +772ms\"\n },\n {\n \"at\": \"1789227600421111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227600421131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600421252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421266\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421281\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600421295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421324\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler241)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600421346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600421360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600421393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600421436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +771ms\"\n },\n {\n \"at\": \"1789227600421450\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789227600421465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421507\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421522\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421536\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600421581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421597\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421613\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602068508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227602068908\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227602068952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602068981\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227602069015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227602069036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227602069062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227602069090\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +804ms\"\n },\n {\n \"at\": \"1789227602069121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -26ms\"\n },\n {\n \"at\": \"1789227602069156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227602069185\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227602069225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227602069253\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227602069282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227602069373\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227602069401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227602069429\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227602069458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227602069485\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069520\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:23.958469+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-probe.txt", "router_mac": "10:66:6a:1f:21:eb", "at": "2026-09-12T15:40:23.959497+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 91378, "ready": true, "ready_signal": "time=\"2026-09-12T08:40:24-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:40:24.043791+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/topology.jsonl", "destroy"], "seconds": 3.182, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:27.225726+00:00"} +{"capture": "monitor-delete", "pid": 91378, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.log", "ready_signal": "time=\"2026-09-12T08:40:24-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:40:27.230958+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.087, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:40:27.318181+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.1, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:40:27.417944+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.149, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:1f:21:eb STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:40:27.567554+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.323, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:1f:21:eb REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:40:27.890865+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.192, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600323154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84223|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600323361\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84224|bridge|INFO|bridge incusovn16: using datapath ID 0000029060073245\"\n },\n {\n \"at\": \"1789227600323393\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84225|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600326702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600326803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600326854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600326886\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600326917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600326946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600326969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600326994\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600327069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327095\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600327157\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600327182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600327224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600327284\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600327363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84227|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600327390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600327413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600327437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600327457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600327481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600327513\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327557\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600327581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600327598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600327668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600327692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600327739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600327763\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600327786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600327805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600327851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600327868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600327902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84228|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600327938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600327963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600327979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600327997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600328018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600328031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878327ms\"\n },\n {\n \"at\": \"1789227600328086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600328105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600328118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600328131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600328148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600328165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600328190\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600328205\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600328217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600328230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328243\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600328255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600419629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler232)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600419735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler232)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600419788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600419834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600419875\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xb6d77bf3 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600419917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600419958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600419990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600420031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600420098\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420198\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600420272\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600420312\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600420344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600420381\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600420409\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420438\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600420526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600420561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600420594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600420643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600420673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600420714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600420789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600420827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600420894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420928\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600420955\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600420993\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600421024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1541878420ms\"\n },\n {\n \"at\": \"1789227600421059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421086\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421142\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600421732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84229|dpif|WARN|Dropped 964 log messages in last 68 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227600422000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422043\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84231|bridge|WARN|Dropped 38994 log messages in last 86 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227600422082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84232|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227600422117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84233|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422272\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600422388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler232)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600422439\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler232)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600422480\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600422527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600422568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xf72bdb48 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600422606\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600422636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600422662\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600422691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600422728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600422760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600422785\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600422809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878422ms\"\n },\n {\n \"at\": \"1789227600422839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +715ms\"\n },\n {\n \"at\": \"1789227600422871\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -95ms\"\n },\n {\n \"at\": \"1789227600422912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600422947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600422976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600423042\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600423136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600423166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600423231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600423266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600423326\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600423370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600423403\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600423430\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600423459\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600423495\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600423525\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600423554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +715ms\"\n },\n {\n \"at\": \"1789227600423582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -95ms\"\n },\n {\n \"at\": \"1789227600423611\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600423644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600423672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227600423743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423806\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600423833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600423864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600423897\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600423922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600423978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler233)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600424052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler233)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600424096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600424126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600424153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xcb07ad63 your_disc:0x212d2dc2\"\n },\n {\n \"at\": \"1789227600424187\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600424223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600424251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600424283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600424351\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600424384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600424413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1541878423ms\"\n },\n {\n \"at\": \"1789227600424454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +864ms\"\n },\n {\n \"at\": \"1789227600424495\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227600424525\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600424561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600424599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600424628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600424657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424688\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600424742\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600424778\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600424802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600424845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600424872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600424896\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600424932\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler233)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600424967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600424995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600425026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600425059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600425093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600425125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600425155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +864ms\"\n },\n {\n \"at\": \"1789227600425183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789227600425217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600425245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600425269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600425296\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600425323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425431\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600425456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600425491\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600425526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600425561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425586\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600425624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600425659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84235|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600426321\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227600429602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84237|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227600429696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84238|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227601368756\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601368982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601368999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601369020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601369036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601369052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601369067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601369088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +688ms\"\n },\n {\n \"at\": \"1789227601369107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -182ms\"\n },\n {\n \"at\": \"1789227601369128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601369138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601369158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601369168\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227601369182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369209\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601369224\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601369245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601369257\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227601369273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601369283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601369292\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601372512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601372574\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601372614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601372652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601372666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601372675\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601372689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +2999ms\"\n },\n {\n \"at\": \"1789227601372699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +604ms\"\n },\n {\n \"at\": \"1789227601372713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -236ms\"\n },\n {\n \"at\": \"1789227601372732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601372746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601372758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601372774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601372784\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601372829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601372839\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601372854\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601372867\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601372878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601372893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601419519\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84239|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227601419598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227601759107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84241|bridge|INFO|bridge br-int: added interface veth87094e38 on port 32\"\n },\n {\n \"at\": \"1789227602390787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84242|poll_loop|INFO|Dropped 6237 log messages in last 72 seconds (most recently, 67 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227602391010\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84243|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602391261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84244|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602391734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84245|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602392203\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84246|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602392684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84247|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602393155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602393686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84249|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602394160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84250|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602394631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84251|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602395096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84252|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)\"\n },\n {\n \"at\": \"1789227602419754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84253|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227602419803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227603419564\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84255|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227603419759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227604419547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84257|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227604419648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227605419575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84259|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227605419680\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227606419941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84261|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227606420165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84262|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227607419608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84263|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227607419723\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84264|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227608390692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84265|poll_loop|INFO|Dropped 12473 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227608390909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84266|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227608419497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84267|dpif|WARN|Dropped 2103 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227608419549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227609419790\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84269|dpif|WARN|Dropped 2115 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227609420007\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227610419920\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84271|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227610420174\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84272|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227611419606\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84273|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227611419718\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227612419866\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84275|dpif|WARN|Dropped 2119 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227612420068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227613419677\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84277|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227613419789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227614390591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84279|poll_loop|INFO|Dropped 12515 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227614390802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84280|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227614419603\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84281|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227614419663\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227615419631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84283|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227615419836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227616419769\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84285|dpif|WARN|Dropped 2092 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227616419973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84286|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227617419812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84287|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227617420125\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227618419872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84289|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227618420193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227619419817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84291|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227619419935\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227620390901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84293|poll_loop|INFO|Dropped 12374 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227620391009\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227620419643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84295|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227620419728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227621419912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84297|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227621420116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227622419713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84299|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227622419819\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84300|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227623419586\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84301|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227623419766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227624419738\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84303|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227624419936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84304|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227624606052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84305|bridge|INFO|bridge br-int: deleted interface veth87094e38 on port 32\"\n },\n {\n \"at\": \"1789227625419640\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84306|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227625419771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227626390926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84308|poll_loop|INFO|Dropped 12417 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227626391032\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84309|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227626419902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84310|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227626420063\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227626722299\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84312|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227626722360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84313|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227626744738\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84314|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227626744910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:28.083408+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.185, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600308828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00199|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600308997\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00200|bridge|INFO|bridge incusovn16: using datapath ID 0000da03ba4e5146\"\n },\n {\n \"at\": \"1789227600309016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00201|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600310955\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00202|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600310998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311028\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311062\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311075\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311133\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600311147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311168\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00203|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311267\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311306\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600311329\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311353\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311392\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311410\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311423\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600311437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311448\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311481\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311492\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311502\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311513\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00204|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311578\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311588\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311599\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311620\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855310ms\"\n },\n {\n \"at\": \"1789227600311651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600311693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311704\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311714\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311735\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311757\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600314985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler234)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600315026\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler234)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600315042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600315054\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600315069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x212d2dc2 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600315082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600315094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600315113\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600315126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315137\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600315147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315191\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315207\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600315229\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600315241\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315252\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600315262\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600315296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600315308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600315331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600315342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315355\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600315378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600315389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600315409\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600315419\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600315440\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600315453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855314ms\"\n },\n {\n \"at\": \"1789227600315473\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600315483\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600315494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227600315526\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315537\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315549\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600315559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600315570\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600315581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227600315591\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315604\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600315614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600406792\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00205|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600406866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227600407302\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler234)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600407561\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler234)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600407825\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600407881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600407907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xad7dc31c your_disc:0x0\"\n },\n {\n \"at\": \"1789227600407931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600407956\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600407975\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600407995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600408042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408085\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408154\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600408183\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600408204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408225\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600408244\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600408308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600408330\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408351\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600408374\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600408401\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408425\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408445\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600408468\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600408489\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600408510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600408531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408550\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600408571\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600408592\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408611\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1590855406ms\"\n },\n {\n \"at\": \"1789227600408631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600408652\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600408672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600408710\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408749\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600408767\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600408788\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600408810\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600408837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408858\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600408879\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600410387\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler234)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600410459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler234)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600410490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600410514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600410535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x51112844 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600410557\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600410581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600410603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600410624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600410644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600410664\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600410684\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600410703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1590855409ms\"\n },\n {\n \"at\": \"1789227600410730\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +671ms\"\n },\n {\n \"at\": \"1789227600410753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789227600410778\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600410797\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600410818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600410840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600410859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600410884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600410903\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600410924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600410943\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600410963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600410989\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600411014\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600411056\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600411116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600411138\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600411161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600411185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600411206\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600411229\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600411249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227600411271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227600411296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600411317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600411341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600411362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227600411382\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411407\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600411450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600411470\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600411491\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600411512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411532\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600411555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600414228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600414278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227601275179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601275317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601275350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601275377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601275416\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601275437\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601275459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601275479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +866ms\"\n },\n {\n \"at\": \"1789227601275507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227601275531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601275555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601275580\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601275602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xcb07ad63\"\n },\n {\n \"at\": \"1789227601275624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275672\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601275694\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601275725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601275747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x212d2dc2\"\n },\n {\n \"at\": \"1789227601275766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601275794\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601275816\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601310379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601310547\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601310569\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601310585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601310598\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601310613\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601310633\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601310643\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789227601310656\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -228ms\"\n },\n {\n \"at\": \"1789227601310669\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601310681\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601310691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601310703\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601310716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601310748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601310759\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601310770\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601310780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601310791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601310803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601387273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601387344\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601387372\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601387399\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601387430\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601387450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601387471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601387493\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +904ms\"\n },\n {\n \"at\": \"1789227601387518\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -66ms\"\n },\n {\n \"at\": \"1789227601387542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601387562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227601387581\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601387600\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227601387620\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387638\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387665\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601387686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227601387705\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601387727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227601387748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227601387768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601387789\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227626708167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227626708426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00210|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227626708449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00211|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227626724875\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00212|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789227626725049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:28.268525+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.171, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600308826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600309184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: using datapath ID 00006e15b6d09e4a\"\n },\n {\n \"at\": \"1789227600309210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00221|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600311215\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00222|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600311311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600311326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600311337\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600311349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600311364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755309ms\"\n },\n {\n \"at\": \"1789227600311403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600311417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311442\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600311453\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600311464\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600311486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600311497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600311509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600311524\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600311548\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600311559\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600318656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00223|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600318716\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600318734\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600318749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600318766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600318782\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600318799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318842\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600318858\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600318873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600318888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600318902\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227600318916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600318930\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600318946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600318960\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600318972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600318993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600319007\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319024\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600319053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00224|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600319071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600319092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600319106\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600319119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600319136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600319148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319159\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319169\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -49755316ms\"\n },\n {\n \"at\": \"1789227600319182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600319194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600319205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600319217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227600319231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600319241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600319265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600319276\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600319288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600319299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319309\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600319320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600406904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00225|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600406948\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00226|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227600414131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00227|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600414191\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00228|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227601083289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler238)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601083374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler238)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601083411\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601083440\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601083463\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xf95a54e0 your_disc:0x51112844\"\n },\n {\n \"at\": \"1789227601083487\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601083516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601083538\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601083561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601083588\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601083614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601083634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601083671\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756081ms\"\n },\n {\n \"at\": \"1789227601083701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +228ms\"\n },\n {\n \"at\": \"1789227601083774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -672ms\"\n },\n {\n \"at\": \"1789227601083805\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601083826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601083856\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601083878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601083900\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601083922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601083946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601083971\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601083994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601084041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601084071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601084134\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler238)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601084158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601084180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601084200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601084221\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601084242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601084266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601084291\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +228ms\"\n },\n {\n \"at\": \"1789227601084312\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -672ms\"\n },\n {\n \"at\": \"1789227601084334\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601084355\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601084381\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084402\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x51112844\"\n },\n {\n \"at\": \"1789227601084422\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084467\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601084489\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601084510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601084537\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf95a54e0\"\n },\n {\n \"at\": \"1789227601084558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601084604\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler227)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601127220\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler227)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601127253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601127277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601127300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x1630de88 your_disc:0xf72bdb48\"\n },\n {\n \"at\": \"1789227601127326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601127351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601127373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601127397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127421\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601127445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127470\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756125ms\"\n },\n {\n \"at\": \"1789227601127518\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +174ms\"\n },\n {\n \"at\": \"1789227601127544\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789227601127568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601127591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601127620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601127649\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601127679\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127726\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601127749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601127769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601127792\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601127814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601127837\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601127857\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127879\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler227)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601127906\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601127932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601127953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601127975\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601127998\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601128018\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601128040\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +174ms\"\n },\n {\n \"at\": \"1789227601128077\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789227601128099\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601128121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601128144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601128167\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xf72bdb48\"\n },\n {\n \"at\": \"1789227601128189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128214\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601128258\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601128279\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601128300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x1630de88\"\n },\n {\n \"at\": \"1789227601128320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128339\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601128359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601278873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler238)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227601278965\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler238)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227601278999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227601279023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227601279045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xb11b3398 your_disc:0xff225141\"\n },\n {\n \"at\": \"1789227601279078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601279105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227601279130\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227601279154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601279208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279230\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -49756276ms\"\n },\n {\n \"at\": \"1789227601279286\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +603ms\"\n },\n {\n \"at\": \"1789227601279320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -157ms\"\n },\n {\n \"at\": \"1789227601279356\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601279382\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601279404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227601279452\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279482\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279511\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601279533\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601279558\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227601279606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227601279630\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601279653\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279676\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler238)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227601279702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227601279723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227601279749\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227601279772\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279793\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227601279814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227601279836\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +603ms\"\n },\n {\n \"at\": \"1789227601279866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -157ms\"\n },\n {\n \"at\": \"1789227601279887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227601279908\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227601279929\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601279952\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227601279977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280024\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227601280047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227601280078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227601280102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227601280123\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227601280171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602535628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00229|bridge|INFO|bridge br-int: added interface veth1f9ee21d on port 30\"\n },\n {\n \"at\": \"1789227625569200\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00230|bridge|INFO|bridge br-int: deleted interface veth1f9ee21d on port 30\"\n },\n {\n \"at\": \"1789227626711573\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00231|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227626712253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00232|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227626712592\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00233|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227626738264\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00234|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29\"\n },\n {\n \"at\": \"1789227626738317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:28.439676+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A39%3A57.480865%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.181, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227600118307\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00203|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227600118502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00204|bridge|INFO|bridge incusovn16: using datapath ID 00003618ee9ea341\"\n },\n {\n \"at\": \"1789227600118547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00205|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227600216246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00206|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227600216361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00207|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227600224873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00208|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227600225007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00209|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789227600311963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00210|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600311996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600312016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600312034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600312046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600312057\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600312069\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982176ms\"\n },\n {\n \"at\": \"1789227600312106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600312123\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600312140\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600312152\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600312163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600312175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312185\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600312198\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600312208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600312219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600312229\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600312255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600312266\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227600315844\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler241)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600315998\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler241)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600316020\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227600316050\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600316068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xff225141 your_disc:0x0\"\n },\n {\n \"at\": \"1789227600316093\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600316114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600316129\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600316143\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316173\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316188\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316207\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982179ms\"\n },\n {\n \"at\": \"1789227600316225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +967ms\"\n },\n {\n \"at\": \"1789227600316243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227600316260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600316276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600316303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316319\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600316335\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316350\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316367\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600316384\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600316402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316417\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600316434\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600316452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600316514\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600316534\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316615\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600316642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +967ms\"\n },\n {\n \"at\": \"1789227600316660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227600316683\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600316704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600316719\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316734\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227600316749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316763\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316777\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600316792\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227600316807\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600316826\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227600316843\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316862\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600316876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316890\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00211|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600316906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600316926\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600316948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600316961\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600316975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600316995\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317045\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600317059\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317074\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317088\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600317105\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600317119\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600317148\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600317195\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317210\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600317239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00212|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600317255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600317270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600317285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600317299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600317317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227600317331\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1590982180ms\"\n },\n {\n \"at\": \"1789227600317378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600317392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600317439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600317452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600317482\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227600317495\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600317509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227600317524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600317551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227600417197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler241)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600417323\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler241)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600417358\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600417381\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600417397\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xebd194f6 your_disc:0xad7dc31c\"\n },\n {\n \"at\": \"1789227600417420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600417436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600417457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600417472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417486\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600417500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982281ms\"\n },\n {\n \"at\": \"1789227600417548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +975ms\"\n },\n {\n \"at\": \"1789227600417563\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227600417585\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600417600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600417615\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600417630\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600417645\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600417690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600417713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600417733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600417763\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600417778\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600417794\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler241)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600417847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600417869\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600417891\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600417911\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417954\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600417979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600418001\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +975ms\"\n },\n {\n \"at\": \"1789227600418018\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227600418033\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600418048\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600418062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600418076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xad7dc31c\"\n },\n {\n \"at\": \"1789227600418090\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418120\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600418134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600418148\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600418162\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xebd194f6\"\n },\n {\n \"at\": \"1789227600418177\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600418207\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600420884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler241)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227600420906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler241)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227600420933\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227600420948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227600420963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb1dad778 your_disc:0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600420980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600420994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227600421009\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227600421024\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600421053\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421067\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1590982284ms\"\n },\n {\n \"at\": \"1789227600421096\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +772ms\"\n },\n {\n \"at\": \"1789227600421111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -8ms\"\n },\n {\n \"at\": \"1789227600421131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600421252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421266\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421281\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227600421295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421324\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler241)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227600421346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227600421360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227600421375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227600421393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227600421422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227600421436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +771ms\"\n },\n {\n \"at\": \"1789227600421450\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789227600421465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227600421479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227600421494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421507\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb6d77bf3\"\n },\n {\n \"at\": \"1789227600421522\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421536\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227600421567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227600421581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227600421597\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb1dad778\"\n },\n {\n \"at\": \"1789227600421613\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227600421642\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602068508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227602068908\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227602068952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227602068981\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227602069015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227602069036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227602069062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227602069090\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +804ms\"\n },\n {\n \"at\": \"1789227602069121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -26ms\"\n },\n {\n \"at\": \"1789227602069156\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227602069185\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227602069225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227602069253\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xb11b3398\"\n },\n {\n \"at\": \"1789227602069282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227602069373\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227602069401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227602069429\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff225141\"\n },\n {\n \"at\": \"1789227602069458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227602069485\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227602069520\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227626721180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00213|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227626721317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00214|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227626721341\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00215|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227626743347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789227626750656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00216|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:40:28.621108+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T15:40:28.622606+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/create.stdout.json new file mode 100644 index 0000000..62b878e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.633, + "first_cross_member_ping_seconds": 2.886, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/cycle.json new file mode 100644 index 0000000..603cb95 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T15:39:57.480865+00:00", + "ended_at": "2026-09-12T15:40:28.622716+00:00", + "seconds": 31.142, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:1f:21:eb", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.633, + "first_cross_member_ping_seconds": 2.886, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.106 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.094 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\"volatile.eth0.host_name\":\"veth87094e38\",\"volatile.eth0.hwaddr\":\"10:66:6a:1b:1a:b9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"cd170a60-a186-4715-8e91-927e2fd2163d\",\"volatile.uuid.generation\":\"cd170a60-a186-4715-8e91-927e2fd2163d\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:40:01.27122137Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\"volatile.eth0.host_name\":\"veth87094e38\",\"volatile.eth0.hwaddr\":\"10:66:6a:1b:1a:b9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"cd170a60-a186-4715-8e91-927e2fd2163d\",\"volatile.uuid.generation\":\"cd170a60-a186-4715-8e91-927e2fd2163d\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:40:01.848300453Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9433088,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe1b:1ab9\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:1b:1a:b9\",\"host_name\":\"veth87094e38\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4176513,\"processes\":4,\"cpu\":{\"usage\":488736000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:40:00.859999895Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\"volatile.eth0.host_name\":\"veth1f9ee21d\",\"volatile.eth0.hwaddr\":\"10:66:6a:8c:72:d6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\",\"volatile.uuid.generation\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:40:02.076644578Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\"volatile.eth0.host_name\":\"veth1f9ee21d\",\"volatile.eth0.hwaddr\":\"10:66:6a:8c:72:d6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\",\"volatile.uuid.generation\":\"484c0081-0f47-4f02-901e-461f79d4f2dc\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:40:02.613021579Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11571200,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe8c:72d6\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:8c:72:d6\",\"host_name\":\"veth1f9ee21d\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":34640,\"processes\":4,\"cpu\":{\"usage\":488719000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:40:02.619999885Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.523 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.244 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.249 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.308 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=1.078 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.475 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.475/0.953/1.308 ms\nelapsed_seconds=2.236 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.950 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.693 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.285 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.285/0.642/0.950 ms\nelapsed_seconds=2.659 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.296 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.218 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.619 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.619/1.377/2.296 ms\nelapsed_seconds=2.192 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.176 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.155 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.089 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.089/1.473/2.176 ms\nelapsed_seconds=2.275 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.310 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.267 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.324 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.279 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.029 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.128441 bytes_per_second=778567591\nelapsed_seconds=0.375 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.500 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.109174 bytes_per_second=915969003\nelapsed_seconds=0.347 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.506 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 90034, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.log", + "bytes": 175872, + "ready_signal": "time=\"2026-09-12T08:39:58-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:39:57.955736+00:00", + "stopped_at": "2026-09-12T15:40:06.349057+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 90570, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T15:40:07.888404+00:00", + "stopped_at": "2026-09-12T15:40:22.541803+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 91378, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.log", + "bytes": 40107, + "ready_signal": "time=\"2026-09-12T08:40:24-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:40:23.959685+00:00", + "stopped_at": "2026-09-12T15:40:27.230774+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-probe.txt new file mode 100644 index 0000000..f35f758 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-probe.txt @@ -0,0 +1,5656 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:1b:1a:b9 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8c:72:d6 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 04323d40-8eb1-4c65-9c34-3eb382295967 (incus-net34-ls-int) + port incus-net34-ls-int-lsp-router + type: router + router-port: incus-net34-lr-lrp-int + port incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0 + addresses: ["10:66:6a:8c:72:d6 dynamic"] + port incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0 + addresses: ["10:66:6a:1b:1a:b9 dynamic"] +switch 7cd84ea4-8717-469c-8a9f-78955f4144c2 (incus-net34-ls-ext) + port incus-net34-ls-ext-lsp-router + type: router + router-port: incus-net34-lr-lrp-ext + port incus-net34-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router ca7f835d-4d26-4657-8b8b-5ee13034d3dc (incus-net34-lr) + port incus-net34-lr-lrp-int + mac: "10:66:6a:1f:21:eb" + ipv6-lla: "fe80::1266:6aff:fe1f:21eb" + networks: ["10.253.73.1/24"] + port incus-net34-lr-lrp-ext + mac: "10:66:6a:1f:21:eb" + ipv6-lla: "fe80::1266:6aff:fe1f:21eb" + networks: ["10.10.40.64/24"] + nat 72851b93-c069-486d-b9b3-a43662ddf78a + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net34-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 98c85b2a-a4c9-4669-989f-4ca96e12bb43 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : b849a7aa-daf1-4d31-970d-d8b5b85fea81 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:1f:21:eb" +name : incus-net34-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} + +_uuid : 09e71232-9004-4c34-96f4-3518ffd3acc5 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:1f:21:eb" +name : incus-net34-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 992d367c-6088-4643-80dd-1c4bd0ef409f +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : e93106aa-f3ee-4afc-accf-288c64ce59e7 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : b4f895d1-e30e-4df5-b237-e614307f3691 +logical_port : cr-incus-net34-lr-lrp-ext +mac : ["10:66:6a:1f:21:eb 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net34-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:1f:21:eb STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:1f:21:eb REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600323154", + "member": "lab01.glab.lol", + "message": "ovs|84223|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600323361", + "member": "lab01.glab.lol", + "message": "ovs|84224|bridge|INFO|bridge incusovn16: using datapath ID 0000029060073245" + }, + { + "at": "1789227600323393", + "member": "lab01.glab.lol", + "message": "ovs|84225|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600326702", + "member": "lab01.glab.lol", + "message": "ovs|84226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600326803", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600326854", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600326886", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600326917", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600326946", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600326969", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600326994", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600327014", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600327048", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600327069", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600327095", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327125", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600327157", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600327182", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327203", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600327224", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600327245", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327262", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600327284", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600327314", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327341", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600327363", + "member": "lab01.glab.lol", + "message": "ovs|84227|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600327390", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600327413", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600327437", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600327457", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600327481", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600327513", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600327540", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600327557", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600327581", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600327598", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600327615", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327639", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600327668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600327692", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327715", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600327739", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600327763", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327786", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600327805", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600327826", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327851", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600327868", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600327902", + "member": "lab01.glab.lol", + "message": "ovs|84228|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600327938", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600327963", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600327979", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600327997", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600328018", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600328031", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600328048", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600328065", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600328086", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600328105", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600328118", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600328131", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600328148", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600328165", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600328178", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600328190", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600328205", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600328217", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600328230", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600328243", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600328255", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600419629", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler232)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600419735", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler232)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227600419788", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600419834", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600419875", + "member": "lab01.glab.lol", + "message": " my_disc:0xb6d77bf3 your_disc:0x0" + }, + { + "at": "1789227600419917", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600419958", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600419990", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600420031", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600420065", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600420098", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600420123", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600420155", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878420ms" + }, + { + "at": "1789227600420198", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878420ms" + }, + { + "at": "1789227600420235", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878420ms" + }, + { + "at": "1789227600420272", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600420312", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600420344", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600420381", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600420409", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600420438", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600420478", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600420526", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600420561", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600420594", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600420643", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600420673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600420714", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600420742", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600420789", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600420827", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600420864", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600420894", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600420928", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600420955", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600420993", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878420ms" + }, + { + "at": "1789227600421024", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878420ms" + }, + { + "at": "1789227600421059", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421086", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421115", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421142", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421169", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421196", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421231", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421266", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600421732", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421833", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421868", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421903", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421938", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600421966", + "member": "lab01.glab.lol", + "message": "ovs|84229|dpif|WARN|Dropped 964 log messages in last 68 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227600422000", + "member": "lab01.glab.lol", + "message": "ovs|84230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422043", + "member": "lab01.glab.lol", + "message": "ovs|84231|bridge|WARN|Dropped 38994 log messages in last 86 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227600422082", + "member": "lab01.glab.lol", + "message": "ovs|84232|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227600422117", + "member": "lab01.glab.lol", + "message": "ovs|84233|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422272", + "member": "lab01.glab.lol", + "message": "ovs|84234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422388", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler232)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600422439", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler232)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600422480", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600422527", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600422568", + "member": "lab01.glab.lol", + "message": " my_disc:0xf72bdb48 your_disc:0x0" + }, + { + "at": "1789227600422606", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600422636", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600422662", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600422691", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600422728", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600422760", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600422785", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600422809", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878422ms" + }, + { + "at": "1789227600422839", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +715ms" + }, + { + "at": "1789227600422871", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -95ms" + }, + { + "at": "1789227600422912", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600422947", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600422976", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423003", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600423042", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423079", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423111", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600423136", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600423166", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423195", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600423231", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600423266", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423298", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600423326", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600423370", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600423403", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600423430", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600423459", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600423495", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600423525", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600423554", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +715ms" + }, + { + "at": "1789227600423582", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -95ms" + }, + { + "at": "1789227600423611", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600423644", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600423672", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423710", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600423743", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423771", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423806", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600423833", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600423864", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423897", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600423922", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423949", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423978", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600424012", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler233)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600424052", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler233)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227600424096", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600424126", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600424153", + "member": "lab01.glab.lol", + "message": " my_disc:0xcb07ad63 your_disc:0x212d2dc2" + }, + { + "at": "1789227600424187", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600424223", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600424251", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600424283", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600424316", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600424351", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600424384", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600424413", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878423ms" + }, + { + "at": "1789227600424454", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +864ms" + }, + { + "at": "1789227600424495", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227600424525", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600424561", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600424599", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600424628", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600424657", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600424688", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600424718", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600424742", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600424778", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600424802", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600424845", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600424872", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600424896", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600424932", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler233)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600424967", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600424995", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600425026", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600425059", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600425093", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600425125", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600425155", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +864ms" + }, + { + "at": "1789227600425183", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227600425217", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600425245", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600425269", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600425296", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600425323", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600425347", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600425431", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600425456", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600425491", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600425526", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600425561", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600425586", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600425624", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600425659", + "member": "lab01.glab.lol", + "message": "ovs|84235|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600426321", + "member": "lab01.glab.lol", + "message": "ovs|84236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600429602", + "member": "lab01.glab.lol", + "message": "ovs|84237|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227600429696", + "member": "lab01.glab.lol", + "message": "ovs|84238|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227601368756", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601368982", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601368999", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601369020", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601369036", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601369052", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601369067", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601369088", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +688ms" + }, + { + "at": "1789227601369107", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -182ms" + }, + { + "at": "1789227601369128", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601369138", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601369158", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601369168", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227601369182", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601369192", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601369209", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601369224", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601369245", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601369257", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227601369273", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601369283", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601369292", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601372512", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601372574", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601372614", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601372652", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601372666", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601372675", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601372689", + "member": "lab01.glab.lol", + "message": " Detect Time: now +2999ms" + }, + { + "at": "1789227601372699", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +604ms" + }, + { + "at": "1789227601372713", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -236ms" + }, + { + "at": "1789227601372732", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601372746", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601372758", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601372774", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227601372784", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601372799", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601372810", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601372829", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601372839", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601372854", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601372867", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601372878", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601372893", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601419519", + "member": "lab01.glab.lol", + "message": "ovs|84239|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227601419598", + "member": "lab01.glab.lol", + "message": "ovs|84240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227601759107", + "member": "lab01.glab.lol", + "message": "ovs|84241|bridge|INFO|bridge br-int: added interface veth87094e38 on port 32" + }, + { + "at": "1789227602390787", + "member": "lab01.glab.lol", + "message": "ovs|84242|poll_loop|INFO|Dropped 6237 log messages in last 72 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227602391010", + "member": "lab01.glab.lol", + "message": "ovs|84243|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602391261", + "member": "lab01.glab.lol", + "message": "ovs|84244|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602391734", + "member": "lab01.glab.lol", + "message": "ovs|84245|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602392203", + "member": "lab01.glab.lol", + "message": "ovs|84246|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602392684", + "member": "lab01.glab.lol", + "message": "ovs|84247|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602393155", + "member": "lab01.glab.lol", + "message": "ovs|84248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602393686", + "member": "lab01.glab.lol", + "message": "ovs|84249|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602394160", + "member": "lab01.glab.lol", + "message": "ovs|84250|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602394631", + "member": "lab01.glab.lol", + "message": "ovs|84251|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602395096", + "member": "lab01.glab.lol", + "message": "ovs|84252|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602419754", + "member": "lab01.glab.lol", + "message": "ovs|84253|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227602419803", + "member": "lab01.glab.lol", + "message": "ovs|84254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227603419564", + "member": "lab01.glab.lol", + "message": "ovs|84255|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227603419759", + "member": "lab01.glab.lol", + "message": "ovs|84256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227604419547", + "member": "lab01.glab.lol", + "message": "ovs|84257|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227604419648", + "member": "lab01.glab.lol", + "message": "ovs|84258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227605419575", + "member": "lab01.glab.lol", + "message": "ovs|84259|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227605419680", + "member": "lab01.glab.lol", + "message": "ovs|84260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227606419941", + "member": "lab01.glab.lol", + "message": "ovs|84261|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227606420165", + "member": "lab01.glab.lol", + "message": "ovs|84262|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227607419608", + "member": "lab01.glab.lol", + "message": "ovs|84263|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227607419723", + "member": "lab01.glab.lol", + "message": "ovs|84264|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227608390692", + "member": "lab01.glab.lol", + "message": "ovs|84265|poll_loop|INFO|Dropped 12473 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227608390909", + "member": "lab01.glab.lol", + "message": "ovs|84266|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227608419497", + "member": "lab01.glab.lol", + "message": "ovs|84267|dpif|WARN|Dropped 2103 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227608419549", + "member": "lab01.glab.lol", + "message": "ovs|84268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227609419790", + "member": "lab01.glab.lol", + "message": "ovs|84269|dpif|WARN|Dropped 2115 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227609420007", + "member": "lab01.glab.lol", + "message": "ovs|84270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227610419920", + "member": "lab01.glab.lol", + "message": "ovs|84271|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227610420174", + "member": "lab01.glab.lol", + "message": "ovs|84272|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227611419606", + "member": "lab01.glab.lol", + "message": "ovs|84273|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227611419718", + "member": "lab01.glab.lol", + "message": "ovs|84274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227612419866", + "member": "lab01.glab.lol", + "message": "ovs|84275|dpif|WARN|Dropped 2119 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227612420068", + "member": "lab01.glab.lol", + "message": "ovs|84276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227613419677", + "member": "lab01.glab.lol", + "message": "ovs|84277|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227613419789", + "member": "lab01.glab.lol", + "message": "ovs|84278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227614390591", + "member": "lab01.glab.lol", + "message": "ovs|84279|poll_loop|INFO|Dropped 12515 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227614390802", + "member": "lab01.glab.lol", + "message": "ovs|84280|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227614419603", + "member": "lab01.glab.lol", + "message": "ovs|84281|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227614419663", + "member": "lab01.glab.lol", + "message": "ovs|84282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227615419631", + "member": "lab01.glab.lol", + "message": "ovs|84283|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227615419836", + "member": "lab01.glab.lol", + "message": "ovs|84284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227616419769", + "member": "lab01.glab.lol", + "message": "ovs|84285|dpif|WARN|Dropped 2092 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227616419973", + "member": "lab01.glab.lol", + "message": "ovs|84286|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227617419812", + "member": "lab01.glab.lol", + "message": "ovs|84287|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227617420125", + "member": "lab01.glab.lol", + "message": "ovs|84288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227618419872", + "member": "lab01.glab.lol", + "message": "ovs|84289|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227618420193", + "member": "lab01.glab.lol", + "message": "ovs|84290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227619419817", + "member": "lab01.glab.lol", + "message": "ovs|84291|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227619419935", + "member": "lab01.glab.lol", + "message": "ovs|84292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227620390901", + "member": "lab01.glab.lol", + "message": "ovs|84293|poll_loop|INFO|Dropped 12374 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227620391009", + "member": "lab01.glab.lol", + "message": "ovs|84294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227620419643", + "member": "lab01.glab.lol", + "message": "ovs|84295|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227620419728", + "member": "lab01.glab.lol", + "message": "ovs|84296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227621419912", + "member": "lab01.glab.lol", + "message": "ovs|84297|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227621420116", + "member": "lab01.glab.lol", + "message": "ovs|84298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227622419713", + "member": "lab01.glab.lol", + "message": "ovs|84299|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227622419819", + "member": "lab01.glab.lol", + "message": "ovs|84300|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227623419586", + "member": "lab01.glab.lol", + "message": "ovs|84301|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227623419766", + "member": "lab01.glab.lol", + "message": "ovs|84302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600308828", + "member": "lab02.glab.lol", + "message": "ovs|00199|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600308997", + "member": "lab02.glab.lol", + "message": "ovs|00200|bridge|INFO|bridge incusovn16: using datapath ID 0000da03ba4e5146" + }, + { + "at": "1789227600309016", + "member": "lab02.glab.lol", + "message": "ovs|00201|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600310955", + "member": "lab02.glab.lol", + "message": "ovs|00202|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600310998", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311016", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311028", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311040", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311050", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311062", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311075", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311086", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311099", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311111", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311123", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311133", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600311147", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311157", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311168", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311179", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311197", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311209", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311219", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311231", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311243", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311254", + "member": "lab02.glab.lol", + "message": "ovs|00203|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311267", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311278", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311296", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311306", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311317", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600311329", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311341", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311353", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311368", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311379", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311392", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311410", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311423", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600311437", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311448", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311481", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311492", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311502", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311513", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311524", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311535", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311545", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311555", + "member": "lab02.glab.lol", + "message": "ovs|00204|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311567", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311578", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311588", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311599", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311609", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311620", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311630", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311640", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311651", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311662", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311673", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311683", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600311693", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311704", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311714", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311725", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311735", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311745", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311757", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311767", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311778", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600314985", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler234)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600315026", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler234)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227600315042", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600315054", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600315069", + "member": "lab02.glab.lol", + "message": " my_disc:0x212d2dc2 your_disc:0x0" + }, + { + "at": "1789227600315082", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600315094", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600315113", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600315126", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600315137", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600315147", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600315157", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600315174", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855314ms" + }, + { + "at": "1789227600315191", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855314ms" + }, + { + "at": "1789227600315207", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855314ms" + }, + { + "at": "1789227600315218", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600315229", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600315241", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315252", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600315262", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315273", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315285", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600315296", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600315308", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315320", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600315331", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600315342", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315355", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600315365", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600315378", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600315389", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600315409", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600315419", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600315430", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600315440", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600315453", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855314ms" + }, + { + "at": "1789227600315463", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855314ms" + }, + { + "at": "1789227600315473", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600315483", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600315494", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315515", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600315526", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315537", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315549", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600315559", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600315570", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315581", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600315591", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315604", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315614", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600406792", + "member": "lab02.glab.lol", + "message": "ovs|00205|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600406866", + "member": "lab02.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227600407302", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler234)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600407561", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler234)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227600407825", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600407881", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600407907", + "member": "lab02.glab.lol", + "message": " my_disc:0xad7dc31c your_disc:0x0" + }, + { + "at": "1789227600407931", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600407956", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600407975", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600407995", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600408016", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600408042", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600408063", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600408085", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855406ms" + }, + { + "at": "1789227600408106", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855406ms" + }, + { + "at": "1789227600408132", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855406ms" + }, + { + "at": "1789227600408154", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600408183", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600408204", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408225", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600408244", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408266", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408287", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600408308", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600408330", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408351", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600408374", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600408401", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408425", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600408445", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600408468", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600408489", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600408510", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600408531", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600408550", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600408571", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600408592", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855406ms" + }, + { + "at": "1789227600408611", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855406ms" + }, + { + "at": "1789227600408631", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600408652", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600408672", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408691", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600408710", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408730", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408749", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600408767", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600408788", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408810", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600408837", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408858", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408879", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600410387", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler234)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600410459", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler234)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600410490", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600410514", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600410535", + "member": "lab02.glab.lol", + "message": " my_disc:0x51112844 your_disc:0x0" + }, + { + "at": "1789227600410557", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600410581", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600410603", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600410624", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600410644", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600410664", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600410684", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600410703", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855409ms" + }, + { + "at": "1789227600410730", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +671ms" + }, + { + "at": "1789227600410753", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227600410778", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600410797", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600410818", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600410840", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600410859", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600410884", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600410903", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600410924", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600410943", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600410963", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227600410989", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600411014", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411035", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600411056", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600411116", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600411138", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600411161", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600411185", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600411206", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600411229", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600411249", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227600411271", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227600411296", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600411317", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600411341", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600411362", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600411382", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600411407", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411429", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600411450", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600411470", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600411491", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227600411512", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600411532", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411555", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600414228", + "member": "lab02.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600414278", + "member": "lab02.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227601275179", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601275317", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601275350", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601275377", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601275416", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601275437", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601275459", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601275479", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789227601275507", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227601275531", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601275555", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601275580", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601275602", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227601275624", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601275650", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601275672", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601275694", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601275725", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601275747", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227601275766", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601275794", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601275816", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601310379", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601310547", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601310569", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601310585", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601310598", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601310613", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601310633", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601310643", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227601310656", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -228ms" + }, + { + "at": "1789227601310669", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601310681", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601310691", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601310703", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601310716", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601310725", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601310737", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601310748", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601310759", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601310770", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227601310780", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601310791", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601310803", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601387273", + "member": "lab02.glab.lol", + "message": "ovs|00012|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601387344", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601387372", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601387399", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601387430", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601387450", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601387471", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601387493", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +904ms" + }, + { + "at": "1789227601387518", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -66ms" + }, + { + "at": "1789227601387542", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601387562", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601387581", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601387600", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227601387620", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601387638", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601387665", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601387686", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601387705", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601387727", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227601387748", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601387768", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601387789", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600308826", + "member": "lab03.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600309184", + "member": "lab03.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: using datapath ID 00006e15b6d09e4a" + }, + { + "at": "1789227600309210", + "member": "lab03.glab.lol", + "message": "ovs|00221|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600311215", + "member": "lab03.glab.lol", + "message": "ovs|00222|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311288", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311311", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311326", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311337", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311349", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311364", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755309ms" + }, + { + "at": "1789227600311378", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755309ms" + }, + { + "at": "1789227600311389", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755309ms" + }, + { + "at": "1789227600311403", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311417", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311428", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311442", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227600311453", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311464", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311476", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311486", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311497", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311509", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311524", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311536", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311548", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311559", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600318656", + "member": "lab03.glab.lol", + "message": "ovs|00223|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600318716", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600318734", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600318749", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600318766", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600318782", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600318799", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755316ms" + }, + { + "at": "1789227600318816", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755316ms" + }, + { + "at": "1789227600318842", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755316ms" + }, + { + "at": "1789227600318858", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600318873", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600318888", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600318902", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227600318916", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600318930", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600318946", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600318960", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600318972", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600318993", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600319007", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600319024", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319040", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600319053", + "member": "lab03.glab.lol", + "message": "ovs|00224|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600319071", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600319092", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600319106", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600319119", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600319136", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600319148", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755316ms" + }, + { + "at": "1789227600319159", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755316ms" + }, + { + "at": "1789227600319169", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755316ms" + }, + { + "at": "1789227600319182", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600319194", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600319205", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600319217", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600319231", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600319241", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319252", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600319265", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600319276", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600319288", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600319299", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600319309", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319320", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600406904", + "member": "lab03.glab.lol", + "message": "ovs|00225|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600406948", + "member": "lab03.glab.lol", + "message": "ovs|00226|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227600414131", + "member": "lab03.glab.lol", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600414191", + "member": "lab03.glab.lol", + "message": "ovs|00228|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227601083289", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler238)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601083374", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler238)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227601083411", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601083440", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601083463", + "member": "lab03.glab.lol", + "message": " my_disc:0xf95a54e0 your_disc:0x51112844" + }, + { + "at": "1789227601083487", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601083516", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601083538", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601083561", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601083588", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601083614", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601083634", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601083671", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756081ms" + }, + { + "at": "1789227601083701", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +228ms" + }, + { + "at": "1789227601083774", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -672ms" + }, + { + "at": "1789227601083805", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601083826", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601083856", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601083878", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227601083900", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601083922", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601083946", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601083971", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601083994", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084017", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601084041", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601084071", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084102", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601084134", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler238)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601084158", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601084180", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601084200", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601084221", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601084242", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601084266", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601084291", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +228ms" + }, + { + "at": "1789227601084312", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -672ms" + }, + { + "at": "1789227601084334", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601084355", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601084381", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084402", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227601084422", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601084443", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084467", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601084489", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601084510", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084537", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601084558", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601084582", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084604", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601127122", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler227)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601127220", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler227)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227601127253", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601127277", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601127300", + "member": "lab03.glab.lol", + "message": " my_disc:0x1630de88 your_disc:0xf72bdb48" + }, + { + "at": "1789227601127326", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601127351", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601127373", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601127397", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601127421", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601127445", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601127470", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601127493", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756125ms" + }, + { + "at": "1789227601127518", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +174ms" + }, + { + "at": "1789227601127544", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789227601127568", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601127591", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601127620", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601127649", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601127679", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601127704", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601127726", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601127749", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601127769", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601127792", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1630de88" + }, + { + "at": "1789227601127814", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601127837", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601127857", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601127879", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler227)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601127906", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601127932", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601127953", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601127975", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601127998", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601128018", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601128040", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +174ms" + }, + { + "at": "1789227601128077", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789227601128099", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601128121", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601128144", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601128167", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601128189", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601128214", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601128236", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601128258", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601128279", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601128300", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1630de88" + }, + { + "at": "1789227601128320", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601128339", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601128359", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601278873", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler238)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601278965", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler238)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227601278999", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601279023", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601279045", + "member": "lab03.glab.lol", + "message": " my_disc:0xb11b3398 your_disc:0xff225141" + }, + { + "at": "1789227601279078", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601279105", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601279130", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601279154", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601279179", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601279208", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601279230", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601279260", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756276ms" + }, + { + "at": "1789227601279286", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +603ms" + }, + { + "at": "1789227601279320", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -157ms" + }, + { + "at": "1789227601279356", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601279382", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601279404", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279428", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227601279452", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601279482", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601279511", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601279533", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601279558", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279582", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xb11b3398" + }, + { + "at": "1789227601279606", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601279630", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601279653", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601279676", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler238)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601279702", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601279723", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601279749", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601279772", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601279793", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601279814", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601279836", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +603ms" + }, + { + "at": "1789227601279866", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -157ms" + }, + { + "at": "1789227601279887", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601279908", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601279929", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279952", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227601279977", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601280001", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601280024", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601280047", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601280078", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601280102", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xb11b3398" + }, + { + "at": "1789227601280123", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601280144", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601280171", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227602535628", + "member": "lab03.glab.lol", + "message": "ovs|00229|bridge|INFO|bridge br-int: added interface veth1f9ee21d on port 30" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600118307", + "member": "nas01.glab.lol", + "message": "ovs|00203|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600118502", + "member": "nas01.glab.lol", + "message": "ovs|00204|bridge|INFO|bridge incusovn16: using datapath ID 00003618ee9ea341" + }, + { + "at": "1789227600118547", + "member": "nas01.glab.lol", + "message": "ovs|00205|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600216246", + "member": "nas01.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600216361", + "member": "nas01.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227600224873", + "member": "nas01.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600225007", + "member": "nas01.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789227600311963", + "member": "nas01.glab.lol", + "message": "ovs|00210|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311996", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600312016", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600312034", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600312046", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600312057", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600312069", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982176ms" + }, + { + "at": "1789227600312080", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982176ms" + }, + { + "at": "1789227600312093", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982176ms" + }, + { + "at": "1789227600312106", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600312123", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600312140", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600312152", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600312163", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600312175", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600312185", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600312198", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600312208", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600312219", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600312229", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600312243", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600312255", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600312266", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600315844", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler241)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600315998", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler241)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600316020", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600316050", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600316068", + "member": "nas01.glab.lol", + "message": " my_disc:0xff225141 your_disc:0x0" + }, + { + "at": "1789227600316093", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600316114", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600316129", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600316143", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316160", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316173", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316188", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600316207", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982179ms" + }, + { + "at": "1789227600316225", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +967ms" + }, + { + "at": "1789227600316243", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227600316260", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600316276", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600316303", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316319", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600316335", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316350", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316367", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600316384", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600316402", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316417", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227600316434", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600316452", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316472", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600316493", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600316514", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600316534", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316557", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316580", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316598", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600316615", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600316642", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +967ms" + }, + { + "at": "1789227600316660", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227600316683", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600316704", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600316719", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316734", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600316749", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316763", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316777", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600316792", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600316807", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316826", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227600316843", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316862", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316876", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600316890", + "member": "nas01.glab.lol", + "message": "ovs|00211|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600316906", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600316926", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316948", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316961", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316975", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600316995", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982180ms" + }, + { + "at": "1789227600317011", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982180ms" + }, + { + "at": "1789227600317027", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982180ms" + }, + { + "at": "1789227600317045", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600317059", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600317074", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317088", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600317105", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600317119", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317134", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600317148", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600317163", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317180", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600317195", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600317210", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317225", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600317239", + "member": "nas01.glab.lol", + "message": "ovs|00212|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600317255", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600317270", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600317285", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600317299", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600317317", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600317331", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982180ms" + }, + { + "at": "1789227600317345", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982180ms" + }, + { + "at": "1789227600317360", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982180ms" + }, + { + "at": "1789227600317378", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600317392", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600317408", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317422", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600317439", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600317452", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317467", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600317482", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600317495", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317509", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600317524", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600317537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317551", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600417197", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler241)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600417323", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler241)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227600417358", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600417381", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600417397", + "member": "nas01.glab.lol", + "message": " my_disc:0xebd194f6 your_disc:0xad7dc31c" + }, + { + "at": "1789227600417420", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600417436", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600417457", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600417472", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600417486", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600417500", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600417515", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600417531", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982281ms" + }, + { + "at": "1789227600417548", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +975ms" + }, + { + "at": "1789227600417563", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227600417585", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600417600", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600417615", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600417630", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600417645", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600417661", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600417675", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600417690", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600417713", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600417733", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xebd194f6" + }, + { + "at": "1789227600417763", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600417778", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600417794", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600417809", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler241)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600417847", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600417869", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600417891", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600417911", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600417954", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600417979", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600418001", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +975ms" + }, + { + "at": "1789227600418018", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227600418033", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600418048", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600418062", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600418076", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600418090", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600418106", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600418120", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600418134", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600418148", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600418162", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xebd194f6" + }, + { + "at": "1789227600418177", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600418193", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600418207", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600420884", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler241)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600420906", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler241)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227600420933", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600420948", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600420963", + "member": "nas01.glab.lol", + "message": " my_disc:0xb1dad778 your_disc:0xb6d77bf3" + }, + { + "at": "1789227600420980", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600420994", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600421009", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600421024", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600421039", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600421053", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600421067", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600421080", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982284ms" + }, + { + "at": "1789227600421096", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +772ms" + }, + { + "at": "1789227600421111", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227600421131", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421146", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421160", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421175", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421190", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421204", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421224", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421237", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600421252", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421266", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421281", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600421295", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421310", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600421324", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler241)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600421346", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600421360", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600421375", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600421393", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600421408", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600421422", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600421436", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +771ms" + }, + { + "at": "1789227600421450", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789227600421465", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421479", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421494", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421507", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421522", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421536", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421550", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421567", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600421581", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421597", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421613", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421627", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421642", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227602068508", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227602068908", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227602068952", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227602068981", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227602069015", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227602069036", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227602069062", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227602069090", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +804ms" + }, + { + "at": "1789227602069121", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -26ms" + }, + { + "at": "1789227602069156", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227602069185", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227602069225", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227602069253", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227602069282", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227602069316", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227602069345", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227602069373", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227602069401", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227602069429", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227602069458", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227602069485", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227602069520", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-teardown.txt new file mode 100644 index 0000000..0620363 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-after-teardown.txt @@ -0,0 +1,5685 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:1f:21:eb STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:1f:21:eb REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600323154", + "member": "lab01.glab.lol", + "message": "ovs|84223|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600323361", + "member": "lab01.glab.lol", + "message": "ovs|84224|bridge|INFO|bridge incusovn16: using datapath ID 0000029060073245" + }, + { + "at": "1789227600323393", + "member": "lab01.glab.lol", + "message": "ovs|84225|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600326702", + "member": "lab01.glab.lol", + "message": "ovs|84226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600326803", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600326854", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600326886", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600326917", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600326946", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600326969", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600326994", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600327014", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600327048", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600327069", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600327095", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327125", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600327157", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600327182", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327203", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600327224", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600327245", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327262", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600327284", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600327314", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327341", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600327363", + "member": "lab01.glab.lol", + "message": "ovs|84227|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600327390", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600327413", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600327437", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600327457", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600327481", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600327513", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600327540", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600327557", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600327581", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600327598", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600327615", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327639", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600327668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600327692", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327715", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600327739", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600327763", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327786", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600327805", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600327826", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327851", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600327868", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600327902", + "member": "lab01.glab.lol", + "message": "ovs|84228|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600327938", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600327963", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600327979", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600327997", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600328018", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600328031", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600328048", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600328065", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600328086", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600328105", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600328118", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600328131", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600328148", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600328165", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600328178", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600328190", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600328205", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600328217", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600328230", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600328243", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600328255", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600419629", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler232)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600419735", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler232)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227600419788", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600419834", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600419875", + "member": "lab01.glab.lol", + "message": " my_disc:0xb6d77bf3 your_disc:0x0" + }, + { + "at": "1789227600419917", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600419958", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600419990", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600420031", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600420065", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600420098", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600420123", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600420155", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878420ms" + }, + { + "at": "1789227600420198", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878420ms" + }, + { + "at": "1789227600420235", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878420ms" + }, + { + "at": "1789227600420272", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600420312", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600420344", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600420381", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600420409", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600420438", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600420478", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600420526", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600420561", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600420594", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600420643", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600420673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600420714", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600420742", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600420789", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600420827", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600420864", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600420894", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600420928", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600420955", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600420993", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878420ms" + }, + { + "at": "1789227600421024", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878420ms" + }, + { + "at": "1789227600421059", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421086", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421115", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421142", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421169", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421196", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421231", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421266", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600421732", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421833", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421868", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421903", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421938", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600421966", + "member": "lab01.glab.lol", + "message": "ovs|84229|dpif|WARN|Dropped 964 log messages in last 68 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227600422000", + "member": "lab01.glab.lol", + "message": "ovs|84230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422043", + "member": "lab01.glab.lol", + "message": "ovs|84231|bridge|WARN|Dropped 38994 log messages in last 86 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227600422082", + "member": "lab01.glab.lol", + "message": "ovs|84232|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227600422117", + "member": "lab01.glab.lol", + "message": "ovs|84233|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422272", + "member": "lab01.glab.lol", + "message": "ovs|84234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422388", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler232)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600422439", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler232)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600422480", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600422527", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600422568", + "member": "lab01.glab.lol", + "message": " my_disc:0xf72bdb48 your_disc:0x0" + }, + { + "at": "1789227600422606", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600422636", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600422662", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600422691", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600422728", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600422760", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600422785", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600422809", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878422ms" + }, + { + "at": "1789227600422839", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +715ms" + }, + { + "at": "1789227600422871", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -95ms" + }, + { + "at": "1789227600422912", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600422947", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600422976", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423003", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600423042", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423079", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423111", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600423136", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600423166", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423195", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600423231", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600423266", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423298", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600423326", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600423370", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600423403", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600423430", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600423459", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600423495", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600423525", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600423554", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +715ms" + }, + { + "at": "1789227600423582", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -95ms" + }, + { + "at": "1789227600423611", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600423644", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600423672", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423710", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600423743", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423771", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423806", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600423833", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600423864", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423897", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600423922", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423949", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423978", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600424012", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler233)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600424052", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler233)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227600424096", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600424126", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600424153", + "member": "lab01.glab.lol", + "message": " my_disc:0xcb07ad63 your_disc:0x212d2dc2" + }, + { + "at": "1789227600424187", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600424223", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600424251", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600424283", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600424316", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600424351", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600424384", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600424413", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878423ms" + }, + { + "at": "1789227600424454", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +864ms" + }, + { + "at": "1789227600424495", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227600424525", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600424561", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600424599", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600424628", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600424657", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600424688", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600424718", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600424742", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600424778", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600424802", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600424845", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600424872", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600424896", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600424932", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler233)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600424967", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600424995", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600425026", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600425059", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600425093", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600425125", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600425155", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +864ms" + }, + { + "at": "1789227600425183", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227600425217", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600425245", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600425269", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600425296", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600425323", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600425347", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600425431", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600425456", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600425491", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600425526", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600425561", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600425586", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600425624", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600425659", + "member": "lab01.glab.lol", + "message": "ovs|84235|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600426321", + "member": "lab01.glab.lol", + "message": "ovs|84236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600429602", + "member": "lab01.glab.lol", + "message": "ovs|84237|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227600429696", + "member": "lab01.glab.lol", + "message": "ovs|84238|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227601368756", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601368982", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601368999", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601369020", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601369036", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601369052", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601369067", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601369088", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +688ms" + }, + { + "at": "1789227601369107", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -182ms" + }, + { + "at": "1789227601369128", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601369138", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601369158", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601369168", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227601369182", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601369192", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601369209", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601369224", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601369245", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601369257", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227601369273", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601369283", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601369292", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601372512", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601372574", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601372614", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601372652", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601372666", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601372675", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601372689", + "member": "lab01.glab.lol", + "message": " Detect Time: now +2999ms" + }, + { + "at": "1789227601372699", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +604ms" + }, + { + "at": "1789227601372713", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -236ms" + }, + { + "at": "1789227601372732", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601372746", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601372758", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601372774", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227601372784", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601372799", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601372810", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601372829", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601372839", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601372854", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601372867", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601372878", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601372893", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601419519", + "member": "lab01.glab.lol", + "message": "ovs|84239|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227601419598", + "member": "lab01.glab.lol", + "message": "ovs|84240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227601759107", + "member": "lab01.glab.lol", + "message": "ovs|84241|bridge|INFO|bridge br-int: added interface veth87094e38 on port 32" + }, + { + "at": "1789227602390787", + "member": "lab01.glab.lol", + "message": "ovs|84242|poll_loop|INFO|Dropped 6237 log messages in last 72 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227602391010", + "member": "lab01.glab.lol", + "message": "ovs|84243|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602391261", + "member": "lab01.glab.lol", + "message": "ovs|84244|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602391734", + "member": "lab01.glab.lol", + "message": "ovs|84245|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602392203", + "member": "lab01.glab.lol", + "message": "ovs|84246|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602392684", + "member": "lab01.glab.lol", + "message": "ovs|84247|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602393155", + "member": "lab01.glab.lol", + "message": "ovs|84248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602393686", + "member": "lab01.glab.lol", + "message": "ovs|84249|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602394160", + "member": "lab01.glab.lol", + "message": "ovs|84250|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602394631", + "member": "lab01.glab.lol", + "message": "ovs|84251|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602395096", + "member": "lab01.glab.lol", + "message": "ovs|84252|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602419754", + "member": "lab01.glab.lol", + "message": "ovs|84253|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227602419803", + "member": "lab01.glab.lol", + "message": "ovs|84254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227603419564", + "member": "lab01.glab.lol", + "message": "ovs|84255|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227603419759", + "member": "lab01.glab.lol", + "message": "ovs|84256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227604419547", + "member": "lab01.glab.lol", + "message": "ovs|84257|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227604419648", + "member": "lab01.glab.lol", + "message": "ovs|84258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227605419575", + "member": "lab01.glab.lol", + "message": "ovs|84259|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227605419680", + "member": "lab01.glab.lol", + "message": "ovs|84260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227606419941", + "member": "lab01.glab.lol", + "message": "ovs|84261|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227606420165", + "member": "lab01.glab.lol", + "message": "ovs|84262|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227607419608", + "member": "lab01.glab.lol", + "message": "ovs|84263|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227607419723", + "member": "lab01.glab.lol", + "message": "ovs|84264|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227608390692", + "member": "lab01.glab.lol", + "message": "ovs|84265|poll_loop|INFO|Dropped 12473 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227608390909", + "member": "lab01.glab.lol", + "message": "ovs|84266|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227608419497", + "member": "lab01.glab.lol", + "message": "ovs|84267|dpif|WARN|Dropped 2103 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227608419549", + "member": "lab01.glab.lol", + "message": "ovs|84268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227609419790", + "member": "lab01.glab.lol", + "message": "ovs|84269|dpif|WARN|Dropped 2115 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227609420007", + "member": "lab01.glab.lol", + "message": "ovs|84270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227610419920", + "member": "lab01.glab.lol", + "message": "ovs|84271|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227610420174", + "member": "lab01.glab.lol", + "message": "ovs|84272|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227611419606", + "member": "lab01.glab.lol", + "message": "ovs|84273|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227611419718", + "member": "lab01.glab.lol", + "message": "ovs|84274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227612419866", + "member": "lab01.glab.lol", + "message": "ovs|84275|dpif|WARN|Dropped 2119 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227612420068", + "member": "lab01.glab.lol", + "message": "ovs|84276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227613419677", + "member": "lab01.glab.lol", + "message": "ovs|84277|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227613419789", + "member": "lab01.glab.lol", + "message": "ovs|84278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227614390591", + "member": "lab01.glab.lol", + "message": "ovs|84279|poll_loop|INFO|Dropped 12515 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227614390802", + "member": "lab01.glab.lol", + "message": "ovs|84280|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227614419603", + "member": "lab01.glab.lol", + "message": "ovs|84281|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227614419663", + "member": "lab01.glab.lol", + "message": "ovs|84282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227615419631", + "member": "lab01.glab.lol", + "message": "ovs|84283|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227615419836", + "member": "lab01.glab.lol", + "message": "ovs|84284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227616419769", + "member": "lab01.glab.lol", + "message": "ovs|84285|dpif|WARN|Dropped 2092 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227616419973", + "member": "lab01.glab.lol", + "message": "ovs|84286|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227617419812", + "member": "lab01.glab.lol", + "message": "ovs|84287|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227617420125", + "member": "lab01.glab.lol", + "message": "ovs|84288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227618419872", + "member": "lab01.glab.lol", + "message": "ovs|84289|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227618420193", + "member": "lab01.glab.lol", + "message": "ovs|84290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227619419817", + "member": "lab01.glab.lol", + "message": "ovs|84291|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227619419935", + "member": "lab01.glab.lol", + "message": "ovs|84292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227620390901", + "member": "lab01.glab.lol", + "message": "ovs|84293|poll_loop|INFO|Dropped 12374 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227620391009", + "member": "lab01.glab.lol", + "message": "ovs|84294|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227620419643", + "member": "lab01.glab.lol", + "message": "ovs|84295|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227620419728", + "member": "lab01.glab.lol", + "message": "ovs|84296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227621419912", + "member": "lab01.glab.lol", + "message": "ovs|84297|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227621420116", + "member": "lab01.glab.lol", + "message": "ovs|84298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227622419713", + "member": "lab01.glab.lol", + "message": "ovs|84299|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227622419819", + "member": "lab01.glab.lol", + "message": "ovs|84300|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227623419586", + "member": "lab01.glab.lol", + "message": "ovs|84301|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227623419766", + "member": "lab01.glab.lol", + "message": "ovs|84302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227624419738", + "member": "lab01.glab.lol", + "message": "ovs|84303|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227624419936", + "member": "lab01.glab.lol", + "message": "ovs|84304|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227624606052", + "member": "lab01.glab.lol", + "message": "ovs|84305|bridge|INFO|bridge br-int: deleted interface veth87094e38 on port 32" + }, + { + "at": "1789227625419640", + "member": "lab01.glab.lol", + "message": "ovs|84306|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227625419771", + "member": "lab01.glab.lol", + "message": "ovs|84307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227626390926", + "member": "lab01.glab.lol", + "message": "ovs|84308|poll_loop|INFO|Dropped 12417 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227626391032", + "member": "lab01.glab.lol", + "message": "ovs|84309|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227626419902", + "member": "lab01.glab.lol", + "message": "ovs|84310|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227626420063", + "member": "lab01.glab.lol", + "message": "ovs|84311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227626722299", + "member": "lab01.glab.lol", + "message": "ovs|84312|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227626722360", + "member": "lab01.glab.lol", + "message": "ovs|84313|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227626744738", + "member": "lab01.glab.lol", + "message": "ovs|84314|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227626744910", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600308828", + "member": "lab02.glab.lol", + "message": "ovs|00199|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600308997", + "member": "lab02.glab.lol", + "message": "ovs|00200|bridge|INFO|bridge incusovn16: using datapath ID 0000da03ba4e5146" + }, + { + "at": "1789227600309016", + "member": "lab02.glab.lol", + "message": "ovs|00201|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600310955", + "member": "lab02.glab.lol", + "message": "ovs|00202|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600310998", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311016", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311028", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311040", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311050", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311062", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311075", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311086", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311099", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311111", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311123", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311133", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600311147", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311157", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311168", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311179", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311197", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311209", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311219", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311231", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311243", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311254", + "member": "lab02.glab.lol", + "message": "ovs|00203|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311267", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311278", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311296", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311306", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311317", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600311329", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311341", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311353", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311368", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311379", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311392", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311410", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311423", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600311437", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311448", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311481", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311492", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311502", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311513", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311524", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311535", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311545", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311555", + "member": "lab02.glab.lol", + "message": "ovs|00204|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311567", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311578", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311588", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311599", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311609", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311620", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311630", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311640", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311651", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311662", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311673", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311683", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600311693", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311704", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311714", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311725", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311735", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311745", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311757", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311767", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311778", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600314985", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler234)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600315026", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler234)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227600315042", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600315054", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600315069", + "member": "lab02.glab.lol", + "message": " my_disc:0x212d2dc2 your_disc:0x0" + }, + { + "at": "1789227600315082", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600315094", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600315113", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600315126", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600315137", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600315147", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600315157", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600315174", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855314ms" + }, + { + "at": "1789227600315191", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855314ms" + }, + { + "at": "1789227600315207", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855314ms" + }, + { + "at": "1789227600315218", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600315229", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600315241", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315252", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600315262", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315273", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315285", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600315296", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600315308", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315320", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600315331", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600315342", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315355", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600315365", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600315378", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600315389", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600315409", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600315419", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600315430", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600315440", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600315453", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855314ms" + }, + { + "at": "1789227600315463", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855314ms" + }, + { + "at": "1789227600315473", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600315483", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600315494", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315515", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600315526", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315537", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315549", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600315559", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600315570", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315581", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600315591", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315604", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315614", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600406792", + "member": "lab02.glab.lol", + "message": "ovs|00205|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600406866", + "member": "lab02.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227600407302", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler234)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600407561", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler234)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227600407825", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600407881", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600407907", + "member": "lab02.glab.lol", + "message": " my_disc:0xad7dc31c your_disc:0x0" + }, + { + "at": "1789227600407931", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600407956", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600407975", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600407995", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600408016", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600408042", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600408063", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600408085", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855406ms" + }, + { + "at": "1789227600408106", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855406ms" + }, + { + "at": "1789227600408132", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855406ms" + }, + { + "at": "1789227600408154", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600408183", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600408204", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408225", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600408244", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408266", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408287", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600408308", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600408330", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408351", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600408374", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600408401", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408425", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600408445", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600408468", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600408489", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600408510", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600408531", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600408550", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600408571", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600408592", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855406ms" + }, + { + "at": "1789227600408611", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855406ms" + }, + { + "at": "1789227600408631", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600408652", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600408672", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408691", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600408710", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408730", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408749", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600408767", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600408788", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408810", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600408837", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408858", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408879", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600410387", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler234)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600410459", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler234)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600410490", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600410514", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600410535", + "member": "lab02.glab.lol", + "message": " my_disc:0x51112844 your_disc:0x0" + }, + { + "at": "1789227600410557", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600410581", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600410603", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600410624", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600410644", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600410664", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600410684", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600410703", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855409ms" + }, + { + "at": "1789227600410730", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +671ms" + }, + { + "at": "1789227600410753", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227600410778", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600410797", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600410818", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600410840", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600410859", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600410884", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600410903", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600410924", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600410943", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600410963", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227600410989", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600411014", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411035", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600411056", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600411116", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600411138", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600411161", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600411185", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600411206", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600411229", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600411249", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227600411271", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227600411296", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600411317", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600411341", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600411362", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600411382", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600411407", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411429", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600411450", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600411470", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600411491", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227600411512", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600411532", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411555", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600414228", + "member": "lab02.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600414278", + "member": "lab02.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227601275179", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601275317", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601275350", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601275377", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601275416", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601275437", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601275459", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601275479", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789227601275507", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227601275531", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601275555", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601275580", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601275602", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227601275624", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601275650", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601275672", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601275694", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601275725", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601275747", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227601275766", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601275794", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601275816", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601310379", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601310547", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601310569", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601310585", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601310598", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601310613", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601310633", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601310643", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227601310656", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -228ms" + }, + { + "at": "1789227601310669", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601310681", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601310691", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601310703", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601310716", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601310725", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601310737", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601310748", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601310759", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601310770", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227601310780", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601310791", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601310803", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601387273", + "member": "lab02.glab.lol", + "message": "ovs|00012|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601387344", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601387372", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601387399", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601387430", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601387450", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601387471", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601387493", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +904ms" + }, + { + "at": "1789227601387518", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -66ms" + }, + { + "at": "1789227601387542", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601387562", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601387581", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601387600", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227601387620", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601387638", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601387665", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601387686", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601387705", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601387727", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227601387748", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601387768", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601387789", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227626708167", + "member": "lab02.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227626708426", + "member": "lab02.glab.lol", + "message": "ovs|00210|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227626708449", + "member": "lab02.glab.lol", + "message": "ovs|00211|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227626724875", + "member": "lab02.glab.lol", + "message": "ovs|00212|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227626725049", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600308826", + "member": "lab03.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600309184", + "member": "lab03.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: using datapath ID 00006e15b6d09e4a" + }, + { + "at": "1789227600309210", + "member": "lab03.glab.lol", + "message": "ovs|00221|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600311215", + "member": "lab03.glab.lol", + "message": "ovs|00222|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311288", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311311", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311326", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311337", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311349", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311364", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755309ms" + }, + { + "at": "1789227600311378", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755309ms" + }, + { + "at": "1789227600311389", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755309ms" + }, + { + "at": "1789227600311403", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311417", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311428", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311442", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227600311453", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311464", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311476", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311486", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311497", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311509", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311524", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311536", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311548", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311559", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600318656", + "member": "lab03.glab.lol", + "message": "ovs|00223|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600318716", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600318734", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600318749", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600318766", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600318782", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600318799", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755316ms" + }, + { + "at": "1789227600318816", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755316ms" + }, + { + "at": "1789227600318842", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755316ms" + }, + { + "at": "1789227600318858", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600318873", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600318888", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600318902", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227600318916", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600318930", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600318946", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600318960", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600318972", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600318993", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600319007", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600319024", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319040", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600319053", + "member": "lab03.glab.lol", + "message": "ovs|00224|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600319071", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600319092", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600319106", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600319119", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600319136", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600319148", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755316ms" + }, + { + "at": "1789227600319159", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755316ms" + }, + { + "at": "1789227600319169", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755316ms" + }, + { + "at": "1789227600319182", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600319194", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600319205", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600319217", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600319231", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600319241", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319252", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600319265", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600319276", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600319288", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600319299", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600319309", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319320", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600406904", + "member": "lab03.glab.lol", + "message": "ovs|00225|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600406948", + "member": "lab03.glab.lol", + "message": "ovs|00226|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227600414131", + "member": "lab03.glab.lol", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600414191", + "member": "lab03.glab.lol", + "message": "ovs|00228|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227601083289", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler238)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601083374", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler238)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227601083411", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601083440", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601083463", + "member": "lab03.glab.lol", + "message": " my_disc:0xf95a54e0 your_disc:0x51112844" + }, + { + "at": "1789227601083487", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601083516", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601083538", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601083561", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601083588", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601083614", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601083634", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601083671", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756081ms" + }, + { + "at": "1789227601083701", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +228ms" + }, + { + "at": "1789227601083774", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -672ms" + }, + { + "at": "1789227601083805", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601083826", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601083856", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601083878", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227601083900", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601083922", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601083946", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601083971", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601083994", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084017", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601084041", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601084071", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084102", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601084134", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler238)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601084158", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601084180", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601084200", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601084221", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601084242", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601084266", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601084291", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +228ms" + }, + { + "at": "1789227601084312", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -672ms" + }, + { + "at": "1789227601084334", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601084355", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601084381", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084402", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227601084422", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601084443", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084467", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601084489", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601084510", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084537", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601084558", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601084582", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084604", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601127122", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler227)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601127220", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler227)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227601127253", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601127277", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601127300", + "member": "lab03.glab.lol", + "message": " my_disc:0x1630de88 your_disc:0xf72bdb48" + }, + { + "at": "1789227601127326", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601127351", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601127373", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601127397", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601127421", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601127445", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601127470", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601127493", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756125ms" + }, + { + "at": "1789227601127518", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +174ms" + }, + { + "at": "1789227601127544", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789227601127568", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601127591", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601127620", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601127649", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601127679", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601127704", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601127726", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601127749", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601127769", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601127792", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1630de88" + }, + { + "at": "1789227601127814", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601127837", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601127857", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601127879", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler227)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601127906", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601127932", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601127953", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601127975", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601127998", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601128018", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601128040", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +174ms" + }, + { + "at": "1789227601128077", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789227601128099", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601128121", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601128144", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601128167", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601128189", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601128214", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601128236", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601128258", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601128279", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601128300", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1630de88" + }, + { + "at": "1789227601128320", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601128339", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601128359", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601278873", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler238)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601278965", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler238)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227601278999", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601279023", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601279045", + "member": "lab03.glab.lol", + "message": " my_disc:0xb11b3398 your_disc:0xff225141" + }, + { + "at": "1789227601279078", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601279105", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601279130", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601279154", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601279179", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601279208", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601279230", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601279260", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756276ms" + }, + { + "at": "1789227601279286", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +603ms" + }, + { + "at": "1789227601279320", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -157ms" + }, + { + "at": "1789227601279356", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601279382", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601279404", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279428", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227601279452", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601279482", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601279511", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601279533", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601279558", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279582", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xb11b3398" + }, + { + "at": "1789227601279606", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601279630", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601279653", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601279676", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler238)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601279702", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601279723", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601279749", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601279772", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601279793", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601279814", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601279836", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +603ms" + }, + { + "at": "1789227601279866", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -157ms" + }, + { + "at": "1789227601279887", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601279908", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601279929", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279952", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227601279977", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601280001", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601280024", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601280047", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601280078", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601280102", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xb11b3398" + }, + { + "at": "1789227601280123", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601280144", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601280171", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227602535628", + "member": "lab03.glab.lol", + "message": "ovs|00229|bridge|INFO|bridge br-int: added interface veth1f9ee21d on port 30" + }, + { + "at": "1789227625569200", + "member": "lab03.glab.lol", + "message": "ovs|00230|bridge|INFO|bridge br-int: deleted interface veth1f9ee21d on port 30" + }, + { + "at": "1789227626711573", + "member": "lab03.glab.lol", + "message": "ovs|00231|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227626712253", + "member": "lab03.glab.lol", + "message": "ovs|00232|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227626712592", + "member": "lab03.glab.lol", + "message": "ovs|00233|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227626738264", + "member": "lab03.glab.lol", + "message": "ovs|00234|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227626738317", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600118307", + "member": "nas01.glab.lol", + "message": "ovs|00203|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600118502", + "member": "nas01.glab.lol", + "message": "ovs|00204|bridge|INFO|bridge incusovn16: using datapath ID 00003618ee9ea341" + }, + { + "at": "1789227600118547", + "member": "nas01.glab.lol", + "message": "ovs|00205|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600216246", + "member": "nas01.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600216361", + "member": "nas01.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227600224873", + "member": "nas01.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600225007", + "member": "nas01.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789227600311963", + "member": "nas01.glab.lol", + "message": "ovs|00210|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311996", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600312016", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600312034", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600312046", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600312057", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600312069", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982176ms" + }, + { + "at": "1789227600312080", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982176ms" + }, + { + "at": "1789227600312093", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982176ms" + }, + { + "at": "1789227600312106", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600312123", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600312140", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600312152", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600312163", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600312175", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600312185", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600312198", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600312208", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600312219", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600312229", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600312243", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600312255", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600312266", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600315844", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler241)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600315998", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler241)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600316020", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600316050", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600316068", + "member": "nas01.glab.lol", + "message": " my_disc:0xff225141 your_disc:0x0" + }, + { + "at": "1789227600316093", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600316114", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600316129", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600316143", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316160", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316173", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316188", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600316207", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982179ms" + }, + { + "at": "1789227600316225", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +967ms" + }, + { + "at": "1789227600316243", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227600316260", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600316276", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600316303", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316319", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600316335", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316350", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316367", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600316384", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600316402", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316417", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227600316434", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600316452", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316472", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600316493", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600316514", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600316534", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316557", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316580", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316598", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600316615", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600316642", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +967ms" + }, + { + "at": "1789227600316660", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227600316683", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600316704", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600316719", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316734", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600316749", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316763", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316777", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600316792", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600316807", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316826", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227600316843", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316862", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316876", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600316890", + "member": "nas01.glab.lol", + "message": "ovs|00211|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600316906", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600316926", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316948", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316961", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316975", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600316995", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982180ms" + }, + { + "at": "1789227600317011", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982180ms" + }, + { + "at": "1789227600317027", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982180ms" + }, + { + "at": "1789227600317045", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600317059", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600317074", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317088", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600317105", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600317119", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317134", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600317148", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600317163", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317180", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600317195", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600317210", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317225", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600317239", + "member": "nas01.glab.lol", + "message": "ovs|00212|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600317255", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600317270", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600317285", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600317299", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600317317", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600317331", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982180ms" + }, + { + "at": "1789227600317345", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982180ms" + }, + { + "at": "1789227600317360", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982180ms" + }, + { + "at": "1789227600317378", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600317392", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600317408", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317422", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600317439", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600317452", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317467", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600317482", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600317495", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317509", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600317524", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600317537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317551", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600417197", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler241)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600417323", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler241)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227600417358", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600417381", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600417397", + "member": "nas01.glab.lol", + "message": " my_disc:0xebd194f6 your_disc:0xad7dc31c" + }, + { + "at": "1789227600417420", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600417436", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600417457", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600417472", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600417486", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600417500", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600417515", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600417531", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982281ms" + }, + { + "at": "1789227600417548", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +975ms" + }, + { + "at": "1789227600417563", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227600417585", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600417600", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600417615", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600417630", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600417645", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600417661", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600417675", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600417690", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600417713", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600417733", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xebd194f6" + }, + { + "at": "1789227600417763", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600417778", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600417794", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600417809", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler241)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600417847", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600417869", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600417891", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600417911", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600417954", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600417979", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600418001", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +975ms" + }, + { + "at": "1789227600418018", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227600418033", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600418048", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600418062", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600418076", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600418090", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600418106", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600418120", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600418134", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600418148", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600418162", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xebd194f6" + }, + { + "at": "1789227600418177", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600418193", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600418207", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600420884", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler241)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600420906", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler241)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227600420933", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600420948", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600420963", + "member": "nas01.glab.lol", + "message": " my_disc:0xb1dad778 your_disc:0xb6d77bf3" + }, + { + "at": "1789227600420980", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600420994", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600421009", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600421024", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600421039", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600421053", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600421067", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600421080", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982284ms" + }, + { + "at": "1789227600421096", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +772ms" + }, + { + "at": "1789227600421111", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227600421131", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421146", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421160", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421175", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421190", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421204", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421224", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421237", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600421252", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421266", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421281", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600421295", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421310", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600421324", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler241)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600421346", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600421360", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600421375", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600421393", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600421408", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600421422", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600421436", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +771ms" + }, + { + "at": "1789227600421450", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789227600421465", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421479", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421494", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421507", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421522", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421536", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421550", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421567", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600421581", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421597", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421613", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421627", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421642", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227602068508", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227602068908", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227602068952", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227602068981", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227602069015", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227602069036", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227602069062", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227602069090", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +804ms" + }, + { + "at": "1789227602069121", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -26ms" + }, + { + "at": "1789227602069156", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227602069185", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227602069225", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227602069253", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227602069282", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227602069316", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227602069345", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227602069373", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227602069401", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227602069429", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227602069458", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227602069485", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227602069520", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227626721180", + "member": "nas01.glab.lol", + "message": "ovs|00213|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227626721317", + "member": "nas01.glab.lol", + "message": "ovs|00214|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227626721341", + "member": "nas01.glab.lol", + "message": "ovs|00215|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227626743347", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor257)|INFO|monitor thread terminated" + }, + { + "at": "1789227626750656", + "member": "nas01.glab.lol", + "message": "ovs|00216|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-before-probe.txt new file mode 100644 index 0000000..64be670 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/diagnostics-before-probe.txt @@ -0,0 +1,5456 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:1b:1a:b9 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:8c:72:d6 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 04323d40-8eb1-4c65-9c34-3eb382295967 (incus-net34-ls-int) + port incus-net34-ls-int-lsp-router + type: router + router-port: incus-net34-lr-lrp-int + port incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0 + addresses: ["10:66:6a:8c:72:d6 dynamic"] + port incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0 + addresses: ["10:66:6a:1b:1a:b9 dynamic"] +switch 7cd84ea4-8717-469c-8a9f-78955f4144c2 (incus-net34-ls-ext) + port incus-net34-ls-ext-lsp-router + type: router + router-port: incus-net34-lr-lrp-ext + port incus-net34-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router ca7f835d-4d26-4657-8b8b-5ee13034d3dc (incus-net34-lr) + port incus-net34-lr-lrp-int + mac: "10:66:6a:1f:21:eb" + ipv6-lla: "fe80::1266:6aff:fe1f:21eb" + networks: ["10.253.73.1/24"] + port incus-net34-lr-lrp-ext + mac: "10:66:6a:1f:21:eb" + ipv6-lla: "fe80::1266:6aff:fe1f:21eb" + networks: ["10.10.40.64/24"] + nat 72851b93-c069-486d-b9b3-a43662ddf78a + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net34-instance-484c0081-0f47-4f02-901e-461f79d4f2dc-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net34-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net34-instance-cd170a60-a186-4715-8e91-927e2fd2163d-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 98c85b2a-a4c9-4669-989f-4ca96e12bb43 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : b849a7aa-daf1-4d31-970d-d8b5b85fea81 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:1f:21:eb" +name : incus-net34-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} + +_uuid : 09e71232-9004-4c34-96f4-3518ffd3acc5 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:1f:21:eb" +name : incus-net34-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 992d367c-6088-4643-80dd-1c4bd0ef409f +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : e93106aa-f3ee-4afc-accf-288c64ce59e7 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : b4f895d1-e30e-4df5-b237-e614307f3691 +logical_port : cr-incus-net34-lr-lrp-ext +mac : ["10:66:6a:1f:21:eb 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net34-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:1f:21:eb STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:1f:21:eb DELAY +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600323154", + "member": "lab01.glab.lol", + "message": "ovs|84223|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600323361", + "member": "lab01.glab.lol", + "message": "ovs|84224|bridge|INFO|bridge incusovn16: using datapath ID 0000029060073245" + }, + { + "at": "1789227600323393", + "member": "lab01.glab.lol", + "message": "ovs|84225|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600326702", + "member": "lab01.glab.lol", + "message": "ovs|84226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600326803", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600326854", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600326886", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600326917", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600326946", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600326969", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600326994", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600327014", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600327048", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600327069", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600327095", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327125", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600327157", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600327182", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327203", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600327224", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600327245", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327262", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600327284", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600327314", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327341", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600327363", + "member": "lab01.glab.lol", + "message": "ovs|84227|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600327390", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600327413", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600327437", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600327457", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600327481", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600327513", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600327540", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600327557", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600327581", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600327598", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600327615", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327639", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600327668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600327692", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327715", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600327739", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600327763", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600327786", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600327805", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600327826", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600327851", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600327868", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600327902", + "member": "lab01.glab.lol", + "message": "ovs|84228|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600327938", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600327963", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600327979", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600327997", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600328018", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600328031", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878327ms" + }, + { + "at": "1789227600328048", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878327ms" + }, + { + "at": "1789227600328065", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878327ms" + }, + { + "at": "1789227600328086", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600328105", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600328118", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600328131", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600328148", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600328165", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600328178", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600328190", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600328205", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600328217", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600328230", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600328243", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600328255", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600419629", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler232)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600419735", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler232)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227600419788", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600419834", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600419875", + "member": "lab01.glab.lol", + "message": " my_disc:0xb6d77bf3 your_disc:0x0" + }, + { + "at": "1789227600419917", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600419958", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600419990", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600420031", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600420065", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600420098", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600420123", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600420155", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878420ms" + }, + { + "at": "1789227600420198", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878420ms" + }, + { + "at": "1789227600420235", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878420ms" + }, + { + "at": "1789227600420272", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600420312", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600420344", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600420381", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600420409", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600420438", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600420478", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600420526", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600420561", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600420594", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600420643", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600420673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600420714", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600420742", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600420789", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600420827", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600420864", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600420894", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600420928", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600420955", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600420993", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1541878420ms" + }, + { + "at": "1789227600421024", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1541878420ms" + }, + { + "at": "1789227600421059", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421086", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421115", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421142", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421169", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421196", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421231", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421266", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600421732", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421833", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421868", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421903", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421938", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600421966", + "member": "lab01.glab.lol", + "message": "ovs|84229|dpif|WARN|Dropped 964 log messages in last 68 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227600422000", + "member": "lab01.glab.lol", + "message": "ovs|84230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422043", + "member": "lab01.glab.lol", + "message": "ovs|84231|bridge|WARN|Dropped 38994 log messages in last 86 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227600422082", + "member": "lab01.glab.lol", + "message": "ovs|84232|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227600422117", + "member": "lab01.glab.lol", + "message": "ovs|84233|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422272", + "member": "lab01.glab.lol", + "message": "ovs|84234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600422388", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler232)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600422439", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler232)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600422480", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600422527", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600422568", + "member": "lab01.glab.lol", + "message": " my_disc:0xf72bdb48 your_disc:0x0" + }, + { + "at": "1789227600422606", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600422636", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600422662", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600422691", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600422728", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600422760", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600422785", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600422809", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878422ms" + }, + { + "at": "1789227600422839", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +715ms" + }, + { + "at": "1789227600422871", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -95ms" + }, + { + "at": "1789227600422912", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600422947", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600422976", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423003", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600423042", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423079", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423111", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600423136", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600423166", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423195", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600423231", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600423266", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423298", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600423326", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600423370", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600423403", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600423430", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600423459", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600423495", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600423525", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600423554", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +715ms" + }, + { + "at": "1789227600423582", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -95ms" + }, + { + "at": "1789227600423611", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600423644", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600423672", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423710", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227600423743", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423771", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423806", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600423833", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600423864", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600423897", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600423922", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600423949", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600423978", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600424012", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler233)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600424052", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler233)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227600424096", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600424126", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600424153", + "member": "lab01.glab.lol", + "message": " my_disc:0xcb07ad63 your_disc:0x212d2dc2" + }, + { + "at": "1789227600424187", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600424223", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600424251", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600424283", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600424316", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600424351", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600424384", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600424413", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1541878423ms" + }, + { + "at": "1789227600424454", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +864ms" + }, + { + "at": "1789227600424495", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227600424525", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600424561", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600424599", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600424628", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600424657", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600424688", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600424718", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600424742", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600424778", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600424802", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600424845", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600424872", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600424896", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600424932", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler233)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600424967", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600424995", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600425026", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600425059", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600425093", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600425125", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600425155", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +864ms" + }, + { + "at": "1789227600425183", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789227600425217", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600425245", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600425269", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600425296", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600425323", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600425347", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600425431", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600425456", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600425491", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600425526", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600425561", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600425586", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600425624", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600425659", + "member": "lab01.glab.lol", + "message": "ovs|84235|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600426321", + "member": "lab01.glab.lol", + "message": "ovs|84236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227600429602", + "member": "lab01.glab.lol", + "message": "ovs|84237|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227600429696", + "member": "lab01.glab.lol", + "message": "ovs|84238|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227601368756", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler232)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601368982", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601368999", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601369020", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601369036", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601369052", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601369067", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601369088", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +688ms" + }, + { + "at": "1789227601369107", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -182ms" + }, + { + "at": "1789227601369128", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601369138", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601369158", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601369168", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xb1dad778" + }, + { + "at": "1789227601369182", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601369192", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601369209", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601369224", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601369245", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601369257", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227601369273", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601369283", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601369292", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601372512", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler232)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601372574", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601372614", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601372652", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601372666", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601372675", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601372689", + "member": "lab01.glab.lol", + "message": " Detect Time: now +2999ms" + }, + { + "at": "1789227601372699", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +604ms" + }, + { + "at": "1789227601372713", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -236ms" + }, + { + "at": "1789227601372732", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601372746", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601372758", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601372774", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x1630de88" + }, + { + "at": "1789227601372784", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601372799", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601372810", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601372829", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601372839", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601372854", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601372867", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601372878", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601372893", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601419519", + "member": "lab01.glab.lol", + "message": "ovs|84239|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227601419598", + "member": "lab01.glab.lol", + "message": "ovs|84240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227601759107", + "member": "lab01.glab.lol", + "message": "ovs|84241|bridge|INFO|bridge br-int: added interface veth87094e38 on port 32" + }, + { + "at": "1789227602390787", + "member": "lab01.glab.lol", + "message": "ovs|84242|poll_loop|INFO|Dropped 6237 log messages in last 72 seconds (most recently, 67 seconds ago) due to excessive rate" + }, + { + "at": "1789227602391010", + "member": "lab01.glab.lol", + "message": "ovs|84243|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602391261", + "member": "lab01.glab.lol", + "message": "ovs|84244|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602391734", + "member": "lab01.glab.lol", + "message": "ovs|84245|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602392203", + "member": "lab01.glab.lol", + "message": "ovs|84246|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602392684", + "member": "lab01.glab.lol", + "message": "ovs|84247|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602393155", + "member": "lab01.glab.lol", + "message": "ovs|84248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602393686", + "member": "lab01.glab.lol", + "message": "ovs|84249|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602394160", + "member": "lab01.glab.lol", + "message": "ovs|84250|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602394631", + "member": "lab01.glab.lol", + "message": "ovs|84251|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602395096", + "member": "lab01.glab.lol", + "message": "ovs|84252|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (64% CPU usage)" + }, + { + "at": "1789227602419754", + "member": "lab01.glab.lol", + "message": "ovs|84253|dpif|WARN|Dropped 1935 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227602419803", + "member": "lab01.glab.lol", + "message": "ovs|84254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227603419564", + "member": "lab01.glab.lol", + "message": "ovs|84255|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227603419759", + "member": "lab01.glab.lol", + "message": "ovs|84256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227604419547", + "member": "lab01.glab.lol", + "message": "ovs|84257|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227604419648", + "member": "lab01.glab.lol", + "message": "ovs|84258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227605419575", + "member": "lab01.glab.lol", + "message": "ovs|84259|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227605419680", + "member": "lab01.glab.lol", + "message": "ovs|84260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227606419941", + "member": "lab01.glab.lol", + "message": "ovs|84261|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227606420165", + "member": "lab01.glab.lol", + "message": "ovs|84262|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600308828", + "member": "lab02.glab.lol", + "message": "ovs|00199|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600308997", + "member": "lab02.glab.lol", + "message": "ovs|00200|bridge|INFO|bridge incusovn16: using datapath ID 0000da03ba4e5146" + }, + { + "at": "1789227600309016", + "member": "lab02.glab.lol", + "message": "ovs|00201|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600310955", + "member": "lab02.glab.lol", + "message": "ovs|00202|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600310998", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311016", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311028", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311040", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311050", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311062", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311075", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311086", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311099", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311111", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311123", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311133", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600311147", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311157", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311168", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311179", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311197", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311209", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311219", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311231", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311243", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311254", + "member": "lab02.glab.lol", + "message": "ovs|00203|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311267", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311278", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311296", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311306", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311317", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600311329", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311341", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311353", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311368", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311379", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311392", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311410", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311423", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600311437", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311448", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311481", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311492", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311502", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311513", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311524", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311535", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311545", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311555", + "member": "lab02.glab.lol", + "message": "ovs|00204|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311567", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311578", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311588", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311599", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311609", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311620", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855310ms" + }, + { + "at": "1789227600311630", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855310ms" + }, + { + "at": "1789227600311640", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855310ms" + }, + { + "at": "1789227600311651", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311662", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311673", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311683", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600311693", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311704", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311714", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311725", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311735", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311745", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311757", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311767", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311778", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600314985", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler234)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600315026", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler234)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227600315042", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600315054", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600315069", + "member": "lab02.glab.lol", + "message": " my_disc:0x212d2dc2 your_disc:0x0" + }, + { + "at": "1789227600315082", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600315094", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600315113", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600315126", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600315137", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600315147", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600315157", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600315174", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855314ms" + }, + { + "at": "1789227600315191", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855314ms" + }, + { + "at": "1789227600315207", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855314ms" + }, + { + "at": "1789227600315218", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600315229", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600315241", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315252", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600315262", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315273", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315285", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600315296", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600315308", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315320", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600315331", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600315342", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315355", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600315365", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600315378", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600315389", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600315409", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600315419", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600315430", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600315440", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600315453", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855314ms" + }, + { + "at": "1789227600315463", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855314ms" + }, + { + "at": "1789227600315473", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600315483", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600315494", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315515", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227600315526", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315537", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315549", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600315559", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600315570", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600315581", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227600315591", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600315604", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600315614", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600406792", + "member": "lab02.glab.lol", + "message": "ovs|00205|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600406866", + "member": "lab02.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227600407302", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler234)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600407561", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler234)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227600407825", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600407881", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600407907", + "member": "lab02.glab.lol", + "message": " my_disc:0xad7dc31c your_disc:0x0" + }, + { + "at": "1789227600407931", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600407956", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600407975", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600407995", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600408016", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600408042", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600408063", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600408085", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855406ms" + }, + { + "at": "1789227600408106", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855406ms" + }, + { + "at": "1789227600408132", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855406ms" + }, + { + "at": "1789227600408154", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600408183", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600408204", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408225", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600408244", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408266", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408287", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600408308", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600408330", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408351", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600408374", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600408401", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408425", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600408445", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600408468", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600408489", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600408510", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600408531", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600408550", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600408571", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600408592", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1590855406ms" + }, + { + "at": "1789227600408611", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1590855406ms" + }, + { + "at": "1789227600408631", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600408652", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600408672", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408691", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227600408710", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408730", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408749", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600408767", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600408788", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600408810", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600408837", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600408858", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600408879", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600410387", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler234)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600410459", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler234)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600410490", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600410514", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600410535", + "member": "lab02.glab.lol", + "message": " my_disc:0x51112844 your_disc:0x0" + }, + { + "at": "1789227600410557", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600410581", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600410603", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600410624", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600410644", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600410664", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600410684", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600410703", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1590855409ms" + }, + { + "at": "1789227600410730", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +671ms" + }, + { + "at": "1789227600410753", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789227600410778", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600410797", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600410818", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600410840", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600410859", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600410884", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600410903", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600410924", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600410943", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600410963", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227600410989", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600411014", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411035", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600411056", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600411116", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600411138", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600411161", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600411185", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600411206", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600411229", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600411249", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227600411271", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227600411296", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600411317", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600411341", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600411362", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227600411382", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600411407", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411429", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600411450", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600411470", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600411491", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227600411512", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600411532", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600411555", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600414228", + "member": "lab02.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600414278", + "member": "lab02.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789227601275179", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler234)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601275317", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601275350", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601275377", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601275416", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601275437", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601275459", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601275479", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +866ms" + }, + { + "at": "1789227601275507", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227601275531", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601275555", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601275580", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601275602", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xcb07ad63" + }, + { + "at": "1789227601275624", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601275650", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601275672", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601275694", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601275725", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601275747", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x212d2dc2" + }, + { + "at": "1789227601275766", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601275794", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601275816", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601310379", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler234)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601310547", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601310569", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601310585", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601310598", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601310613", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601310633", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601310643", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789227601310656", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -228ms" + }, + { + "at": "1789227601310669", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601310681", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601310691", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601310703", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601310716", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601310725", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601310737", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601310748", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601310759", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601310770", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x51112844" + }, + { + "at": "1789227601310780", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601310791", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601310803", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601387273", + "member": "lab02.glab.lol", + "message": "ovs|00012|bfd(handler234)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601387344", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601387372", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601387399", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601387430", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601387450", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601387471", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601387493", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +904ms" + }, + { + "at": "1789227601387518", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -66ms" + }, + { + "at": "1789227601387542", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601387562", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227601387581", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601387600", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xebd194f6" + }, + { + "at": "1789227601387620", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601387638", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601387665", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601387686", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227601387705", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601387727", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xad7dc31c" + }, + { + "at": "1789227601387748", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227601387768", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601387789", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600308826", + "member": "lab03.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600309184", + "member": "lab03.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: using datapath ID 00006e15b6d09e4a" + }, + { + "at": "1789227600309210", + "member": "lab03.glab.lol", + "message": "ovs|00221|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600311215", + "member": "lab03.glab.lol", + "message": "ovs|00222|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311288", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600311311", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600311326", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600311337", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600311349", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600311364", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755309ms" + }, + { + "at": "1789227600311378", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755309ms" + }, + { + "at": "1789227600311389", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755309ms" + }, + { + "at": "1789227600311403", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600311417", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600311428", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311442", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227600311453", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600311464", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311476", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600311486", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600311497", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600311509", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600311524", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600311536", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600311548", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600311559", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600318656", + "member": "lab03.glab.lol", + "message": "ovs|00223|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600318716", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600318734", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600318749", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600318766", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600318782", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600318799", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755316ms" + }, + { + "at": "1789227600318816", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755316ms" + }, + { + "at": "1789227600318842", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755316ms" + }, + { + "at": "1789227600318858", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600318873", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600318888", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600318902", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227600318916", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600318930", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600318946", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600318960", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600318972", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600318993", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600319007", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600319024", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319040", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600319053", + "member": "lab03.glab.lol", + "message": "ovs|00224|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600319071", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600319092", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600319106", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600319119", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600319136", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600319148", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49755316ms" + }, + { + "at": "1789227600319159", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -49755316ms" + }, + { + "at": "1789227600319169", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -49755316ms" + }, + { + "at": "1789227600319182", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600319194", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600319205", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600319217", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227600319231", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600319241", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319252", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600319265", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600319276", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600319288", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600319299", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600319309", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600319320", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600406904", + "member": "lab03.glab.lol", + "message": "ovs|00225|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600406948", + "member": "lab03.glab.lol", + "message": "ovs|00226|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227600414131", + "member": "lab03.glab.lol", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600414191", + "member": "lab03.glab.lol", + "message": "ovs|00228|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 29" + }, + { + "at": "1789227601083289", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler238)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601083374", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler238)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227601083411", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601083440", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601083463", + "member": "lab03.glab.lol", + "message": " my_disc:0xf95a54e0 your_disc:0x51112844" + }, + { + "at": "1789227601083487", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601083516", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601083538", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601083561", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601083588", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601083614", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601083634", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601083671", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756081ms" + }, + { + "at": "1789227601083701", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +228ms" + }, + { + "at": "1789227601083774", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -672ms" + }, + { + "at": "1789227601083805", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601083826", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601083856", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601083878", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227601083900", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601083922", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601083946", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601083971", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601083994", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084017", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601084041", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601084071", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084102", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601084134", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler238)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601084158", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601084180", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601084200", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601084221", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601084242", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601084266", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601084291", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +228ms" + }, + { + "at": "1789227601084312", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -672ms" + }, + { + "at": "1789227601084334", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601084355", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601084381", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084402", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x51112844" + }, + { + "at": "1789227601084422", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601084443", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084467", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601084489", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601084510", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601084537", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf95a54e0" + }, + { + "at": "1789227601084558", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601084582", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601084604", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601127122", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler227)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601127220", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler227)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227601127253", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601127277", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601127300", + "member": "lab03.glab.lol", + "message": " my_disc:0x1630de88 your_disc:0xf72bdb48" + }, + { + "at": "1789227601127326", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601127351", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601127373", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601127397", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601127421", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601127445", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601127470", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601127493", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756125ms" + }, + { + "at": "1789227601127518", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +174ms" + }, + { + "at": "1789227601127544", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789227601127568", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601127591", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601127620", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601127649", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601127679", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601127704", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601127726", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601127749", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601127769", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601127792", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1630de88" + }, + { + "at": "1789227601127814", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601127837", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601127857", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601127879", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler227)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601127906", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601127932", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601127953", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601127975", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601127998", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601128018", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601128040", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +174ms" + }, + { + "at": "1789227601128077", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789227601128099", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601128121", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601128144", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601128167", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xf72bdb48" + }, + { + "at": "1789227601128189", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601128214", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601128236", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601128258", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601128279", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601128300", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x1630de88" + }, + { + "at": "1789227601128320", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601128339", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601128359", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601278873", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler238)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227601278965", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler238)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227601278999", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227601279023", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227601279045", + "member": "lab03.glab.lol", + "message": " my_disc:0xb11b3398 your_disc:0xff225141" + }, + { + "at": "1789227601279078", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227601279105", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227601279130", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227601279154", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601279179", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601279208", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601279230", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601279260", + "member": "lab03.glab.lol", + "message": " Detect Time: now -49756276ms" + }, + { + "at": "1789227601279286", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +603ms" + }, + { + "at": "1789227601279320", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -157ms" + }, + { + "at": "1789227601279356", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601279382", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601279404", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279428", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227601279452", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601279482", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601279511", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601279533", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601279558", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279582", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xb11b3398" + }, + { + "at": "1789227601279606", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227601279630", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601279653", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227601279676", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler238)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227601279702", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227601279723", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227601279749", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227601279772", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227601279793", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227601279814", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227601279836", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +603ms" + }, + { + "at": "1789227601279866", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -157ms" + }, + { + "at": "1789227601279887", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227601279908", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227601279929", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227601279952", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xff225141" + }, + { + "at": "1789227601279977", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601280001", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601280024", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227601280047", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227601280078", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227601280102", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xb11b3398" + }, + { + "at": "1789227601280123", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227601280144", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227601280171", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227602535628", + "member": "lab03.glab.lol", + "message": "ovs|00229|bridge|INFO|bridge br-int: added interface veth1f9ee21d on port 30" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227600118307", + "member": "nas01.glab.lol", + "message": "ovs|00203|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227600118502", + "member": "nas01.glab.lol", + "message": "ovs|00204|bridge|INFO|bridge incusovn16: using datapath ID 00003618ee9ea341" + }, + { + "at": "1789227600118547", + "member": "nas01.glab.lol", + "message": "ovs|00205|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227600216246", + "member": "nas01.glab.lol", + "message": "ovs|00206|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227600216361", + "member": "nas01.glab.lol", + "message": "ovs|00207|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227600224873", + "member": "nas01.glab.lol", + "message": "ovs|00208|bridge|INFO|bridge incusovn16: added interface patch-incus-net34-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227600225007", + "member": "nas01.glab.lol", + "message": "ovs|00209|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net34-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789227600311963", + "member": "nas01.glab.lol", + "message": "ovs|00210|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600311996", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600312016", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600312034", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600312046", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600312057", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600312069", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982176ms" + }, + { + "at": "1789227600312080", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982176ms" + }, + { + "at": "1789227600312093", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982176ms" + }, + { + "at": "1789227600312106", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600312123", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600312140", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600312152", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600312163", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600312175", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600312185", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600312198", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600312208", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600312219", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600312229", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600312243", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600312255", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600312266", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor257)|INFO|monitor thread created" + }, + { + "at": "1789227600315844", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler241)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600315998", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler241)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227600316020", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227600316050", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600316068", + "member": "nas01.glab.lol", + "message": " my_disc:0xff225141 your_disc:0x0" + }, + { + "at": "1789227600316093", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600316114", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600316129", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600316143", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316160", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316173", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316188", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600316207", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982179ms" + }, + { + "at": "1789227600316225", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +967ms" + }, + { + "at": "1789227600316243", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227600316260", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600316276", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600316303", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316319", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600316335", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316350", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316367", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600316384", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600316402", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316417", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227600316434", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600316452", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316472", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600316493", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600316514", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600316534", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316557", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316580", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316598", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600316615", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600316642", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +967ms" + }, + { + "at": "1789227600316660", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227600316683", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600316704", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600316719", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316734", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227600316749", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316763", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316777", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600316792", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227600316807", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600316826", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227600316843", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600316862", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600316876", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600316890", + "member": "nas01.glab.lol", + "message": "ovs|00211|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600316906", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600316926", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600316948", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600316961", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600316975", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600316995", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982180ms" + }, + { + "at": "1789227600317011", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982180ms" + }, + { + "at": "1789227600317027", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982180ms" + }, + { + "at": "1789227600317045", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600317059", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600317074", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317088", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600317105", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600317119", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317134", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600317148", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600317163", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317180", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600317195", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600317210", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317225", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600317239", + "member": "nas01.glab.lol", + "message": "ovs|00212|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600317255", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600317270", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600317285", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600317299", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600317317", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227600317331", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982180ms" + }, + { + "at": "1789227600317345", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1590982180ms" + }, + { + "at": "1789227600317360", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1590982180ms" + }, + { + "at": "1789227600317378", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600317392", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227600317408", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317422", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600317439", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600317452", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317467", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600317482", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227600317495", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600317509", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227600317524", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600317537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227600317551", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227600417197", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler241)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600417323", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler241)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227600417358", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600417381", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600417397", + "member": "nas01.glab.lol", + "message": " my_disc:0xebd194f6 your_disc:0xad7dc31c" + }, + { + "at": "1789227600417420", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600417436", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600417457", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600417472", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600417486", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600417500", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600417515", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600417531", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982281ms" + }, + { + "at": "1789227600417548", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +975ms" + }, + { + "at": "1789227600417563", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227600417585", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600417600", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600417615", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600417630", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600417645", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600417661", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600417675", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600417690", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600417713", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600417733", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xebd194f6" + }, + { + "at": "1789227600417763", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600417778", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600417794", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600417809", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler241)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600417847", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600417869", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600417891", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600417911", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600417954", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600417979", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600418001", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +975ms" + }, + { + "at": "1789227600418018", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227600418033", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600418048", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600418062", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600418076", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xad7dc31c" + }, + { + "at": "1789227600418090", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600418106", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600418120", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600418134", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600418148", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600418162", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xebd194f6" + }, + { + "at": "1789227600418177", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600418193", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600418207", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600420884", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler241)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227600420906", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler241)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227600420933", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227600420948", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227600420963", + "member": "nas01.glab.lol", + "message": " my_disc:0xb1dad778 your_disc:0xb6d77bf3" + }, + { + "at": "1789227600420980", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227600420994", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227600421009", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227600421024", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600421039", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600421053", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600421067", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600421080", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1590982284ms" + }, + { + "at": "1789227600421096", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +772ms" + }, + { + "at": "1789227600421111", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -8ms" + }, + { + "at": "1789227600421131", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421146", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421160", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421175", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421190", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421204", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421224", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421237", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600421252", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421266", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421281", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227600421295", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421310", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227600421324", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler241)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227600421346", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227600421360", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227600421375", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227600421393", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227600421408", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227600421422", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227600421436", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +771ms" + }, + { + "at": "1789227600421450", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789227600421465", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227600421479", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227600421494", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421507", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb6d77bf3" + }, + { + "at": "1789227600421522", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421536", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421550", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227600421567", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227600421581", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227600421597", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb1dad778" + }, + { + "at": "1789227600421613", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227600421627", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227600421642", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227602068508", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler241)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227602068908", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227602068952", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227602068981", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227602069015", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227602069036", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227602069062", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227602069090", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +804ms" + }, + { + "at": "1789227602069121", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -26ms" + }, + { + "at": "1789227602069156", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227602069185", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227602069225", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227602069253", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xb11b3398" + }, + { + "at": "1789227602069282", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227602069316", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227602069345", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227602069373", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227602069401", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227602069429", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff225141" + }, + { + "at": "1789227602069458", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227602069485", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227602069520", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.debug.log new file mode 100644 index 0000000..7b49a12 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:39:58-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.log new file mode 100644 index 0000000..43a36c4 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-create.log @@ -0,0 +1,544 @@ +time="2026-09-12T15:39:58Z" level=debug msg="[nas01] Event listener server handler started" id=7e6d757f-acfc-4f20-981e-afb3546eac7c local="10.10.10.14:8443" remote="100.122.142.76:54591" +time="2026-09-12T15:39:58Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:39:58Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54614" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54615" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54616" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54617" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54618" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54619" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54620" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54621" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:39:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54622" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54623" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:1f:21:eb" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.34 +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net34 driver=ovn memberID=1 network=default priority=13150 project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54625" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54626" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54627" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54628" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54629" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54630" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54631" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54632" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54633" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Event listener server handler started" id=c7eace1e-d9d4-4ee9-9041-abc5afd7d40c local="10.10.10.14:8443" remote="100.122.142.76:54633" +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54634" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=25d8c373-1721-474a-9f98-619ab2f3765c project=image-build +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=25d8c373-1721-474a-9f98-619ab2f3765c project=image-build +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54635" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Event listener server handler started" id=fa3542e3-f3f1-410f-b468-53adbcd672fa local="10.10.10.14:8443" remote="100.122.142.76:54635" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54637" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=6de3b675-9d68-4fe1-8186-fabc71e86991 project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=6de3b675-9d68-4fe1-8186-fabc71e86991 project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54638" method=GET protocol=tls url="/1.0/operations/6de3b675-9d68-4fe1-8186-fabc71e86991?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=6de3b675-9d68-4fe1-8186-fabc71e86991 project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T15:40:01Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=6de3b675-9d68-4fe1-8186-fabc71e86991 project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=fa3542e3-f3f1-410f-b468-53adbcd672fa local="10.10.10.14:8443" remote="100.122.142.76:54635" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=c7eace1e-d9d4-4ee9-9041-abc5afd7d40c local="10.10.10.14:8443" remote="100.122.142.76:54633" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54639" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54640" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"aa5b61c5-95e6-4e79-9ab4-64f3a49730b6\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:40:01.184518696Z\",\n\t\t\"updated_at\": \"2026-09-12T15:40:01.184518696Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54641" method=GET protocol=tls url="/1.0/operations/aa5b61c5-95e6-4e79-9ab4-64f3a49730b6/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54642" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54643" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54644" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Event listener server handler started" id=7f59422e-5bed-44e0-bbc1-688175055c7a local="10.10.10.14:8443" remote="100.122.142.76:54644" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54645" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 15:40:01.27122137 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54646" method=GET protocol=tls url="/1.0/operations/e2ff2b89-f393-40e0-973f-7940e93737b7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:01Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 15:40:01.27122137 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:40:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=7f59422e-5bed-44e0-bbc1-688175055c7a local="10.10.10.14:8443" remote="100.122.142.76:54644" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54647" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54648" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"dc39bb43-7be2-4e5c-a349-13346255be24\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:40:02.033534024Z\",\n\t\t\"updated_at\": \"2026-09-12T15:40:02.033534024Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T15:40:02Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54649" method=GET protocol=tls url="/1.0/operations/dc39bb43-7be2-4e5c-a349-13346255be24/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to update warning status for warning \"519f6fb0-a631-4d61-8805-d814f3ffb22f\": database is locked" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Completed heartbeat round" duration=3.711674779s +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54650" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54651" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Event listener server handler started" id=9558709d-71ab-463f-b306-29c57ec0af0c local="10.10.10.14:8443" remote="100.122.142.76:54652" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54652" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54653" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 15:40:02.076644578 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54654" method=GET protocol=tls url="/1.0/operations/2f4bb159-d08e-4b74-89a8-b75583af2839?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 15:40:02.076644578 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Event listener server handler stopped" listener=9558709d-71ab-463f-b306-29c57ec0af0c local="10.10.10.14:8443" remote="100.122.142.76:54652" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54655" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54656" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54657" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54658" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54659" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54660" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54661" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54662" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54663" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54664" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Event listener server handler started" id=d7d72628-81a5-4fde-b72c-6ec014cb0351 local="10.10.10.14:8443" remote="100.122.142.76:54664" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54665" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54666" method=GET protocol=tls url="/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=38192ff857869b94ef68647d9635422577216e87bee34934bb091a8392923741" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=38192ff857869b94ef68647d9635422577216e87bee34934bb091a8392923741" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54666" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54667" method=GET protocol=tls url="/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=8c78ed00b28d252772a0495ab527e4d99729f53f030551638e63b757b8ab7019" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54667" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=8c78ed00b28d252772a0495ab527e4d99729f53f030551638e63b757b8ab7019" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54668" method=GET protocol=tls url="/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=6454a0b890cb7e7e8bd40fdfa66dc07ca23a54a59672f8d525617de49cb87b32" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54668" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=6454a0b890cb7e7e8bd40fdfa66dc07ca23a54a59672f8d525617de49cb87b32" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54669" method=GET protocol=tls url="/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=3e5405174dfee7db49aa866d5e912e1f1a5e427d5cbb9a5eda86130135fda8a0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b/websocket?secret=3e5405174dfee7db49aa866d5e912e1f1a5e427d5cbb9a5eda86130135fda8a0" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54669" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54667" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54670" method=GET protocol=tls url="/1.0/operations/501d6f47-ca36-4b3f-9241-cbcd4988d66b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54666" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54668" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54669" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d7d72628-81a5-4fde-b72c-6ec014cb0351 local="10.10.10.14:8443" remote="100.122.142.76:54664" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54671" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54672" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54673" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54674" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Event listener server handler started" id=9a1f95e3-ea73-423d-a22d-e62515753df6 local="10.10.10.14:8443" remote="100.122.142.76:54674" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54675" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54676" method=GET protocol=tls url="/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=29668e900257fb1f2dadaec2cf6896b95f176f5d876cc7f2ae7c81eae0206e92" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54676" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=29668e900257fb1f2dadaec2cf6896b95f176f5d876cc7f2ae7c81eae0206e92" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54677" method=GET protocol=tls url="/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=49928aaf082a36c2de217d73a50c12cbb48a4140854b19c85da9838be04c7f7f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54677" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=49928aaf082a36c2de217d73a50c12cbb48a4140854b19c85da9838be04c7f7f" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54678" method=GET protocol=tls url="/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=fad5b5b88c889af39e2265007427de9c3924c7180e8f52bafc3355a59456c16a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54678" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=fad5b5b88c889af39e2265007427de9c3924c7180e8f52bafc3355a59456c16a" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54679" method=GET protocol=tls url="/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=af694877f0ed77d772ad7325184b1eb26dc0fd31ffc6c4c4cab8cb48565614b6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54679" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9/websocket?secret=af694877f0ed77d772ad7325184b1eb26dc0fd31ffc6c4c4cab8cb48565614b6" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54677" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54680" method=GET protocol=tls url="/1.0/operations/a0121114-2add-4e98-a02e-90b21cd766d9?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54679" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54678" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54676" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=9a1f95e3-ea73-423d-a22d-e62515753df6 local="10.10.10.14:8443" remote="100.122.142.76:54674" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54681" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54685" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Event listener server handler started" id=b3db2710-87a2-4c92-b5a2-920919915eb8 local="10.10.10.14:8443" remote="100.122.142.76:54685" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54686" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54688" method=GET protocol=tls url="/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=502d5692a1e8d758255eca65e2c7001f64dcfe9088b595b462b7b9cef371de96" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54688" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=502d5692a1e8d758255eca65e2c7001f64dcfe9088b595b462b7b9cef371de96" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54689" method=GET protocol=tls url="/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=a2e644bff48c66e4e6d0cbda350cbc359ee3255d81425e668e0db629b04292dc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=a2e644bff48c66e4e6d0cbda350cbc359ee3255d81425e668e0db629b04292dc" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54689" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54690" method=GET protocol=tls url="/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=47ee868ada680b32fdb1789d6e78bb80896567cb1b3b87bcbc31c5bb37d0e760" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=47ee868ada680b32fdb1789d6e78bb80896567cb1b3b87bcbc31c5bb37d0e760" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54690" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.64 network=default project=ac-ovn-spike +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54691" method=GET protocol=tls url="/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=7ad4fc632857f93d4231626413992ca83687f0f40af545ad9141a2922ca4f9e0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25/websocket?secret=7ad4fc632857f93d4231626413992ca83687f0f40af545ad9141a2922ca4f9e0" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54691" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54689" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54692" method=GET protocol=tls url="/1.0/operations/0d019a69-1d83-472b-8469-f175e0d55a25?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54688" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54690" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54691" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b3db2710-87a2-4c92-b5a2-920919915eb8 local="10.10.10.14:8443" remote="100.122.142.76:54685" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54693" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54694" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54695" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54696" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Event listener server handler started" id=5f8da046-638a-4b87-9929-2b85eabac82a local="10.10.10.14:8443" remote="100.122.142.76:54696" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54697" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54698" method=GET protocol=tls url="/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=d37f83bdbcb96a2467fbec56d4e0eeaae43d7647a09f112b1daa623cb0241661" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54698" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=d37f83bdbcb96a2467fbec56d4e0eeaae43d7647a09f112b1daa623cb0241661" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54699" method=GET protocol=tls url="/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=316f4be8123cebf1b05d51b9b527d96d369ee7f66bf2a24b087b26f469001b28" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=316f4be8123cebf1b05d51b9b527d96d369ee7f66bf2a24b087b26f469001b28" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54699" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54700" method=GET protocol=tls url="/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=f563b0d83fd8742dea816721e0b7054434594564455aa2550840f520a3743a98" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54700" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=f563b0d83fd8742dea816721e0b7054434594564455aa2550840f520a3743a98" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54701" method=GET protocol=tls url="/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=0ef5536cba8e2d2abfc2ef2c85bbbd7183eae69a908ce404f8b1bc74dec6013e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430/websocket?secret=0ef5536cba8e2d2abfc2ef2c85bbbd7183eae69a908ce404f8b1bc74dec6013e" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54701" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54699" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54702" method=GET protocol=tls url="/1.0/operations/16ed11ee-984b-4d4e-9189-f9fe41716430?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54700" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54698" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54701" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=5f8da046-638a-4b87-9929-2b85eabac82a local="10.10.10.14:8443" remote="100.122.142.76:54696" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54703" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54704" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Event listener server handler started" id=d3515404-e458-43c6-9aae-2d701567ee54 local="10.10.10.14:8443" remote="100.122.142.76:54704" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54705" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54706" method=GET protocol=tls url="/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=0c6ad473a720baa72b9e605b64ed2162506ee619ae21cac60f68c3a3eae73ea0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=0c6ad473a720baa72b9e605b64ed2162506ee619ae21cac60f68c3a3eae73ea0" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54706" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54707" method=GET protocol=tls url="/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=afd9e59596f54e5a00fea305d85c0427f039bdb0fdaf615b37a3e4c9163eebca" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54707" +time="2026-09-12T15:40:04Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=afd9e59596f54e5a00fea305d85c0427f039bdb0fdaf615b37a3e4c9163eebca" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54708" method=GET protocol=tls url="/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=adac651eb9065517059b790774a9b2a356c25af2216805a8d0591f58f6edcd27" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54708" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=adac651eb9065517059b790774a9b2a356c25af2216805a8d0591f58f6edcd27" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54709" method=GET protocol=tls url="/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=8bdf5a403ec0acc8b0f5abc96dca7564f2ebdb07b0acd6e49c012073dec056ac" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57/websocket?secret=8bdf5a403ec0acc8b0f5abc96dca7564f2ebdb07b0acd6e49c012073dec056ac" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54709" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54707" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54710" method=GET protocol=tls url="/1.0/operations/0430874a-f0be-45b4-9e20-70f5df5afd57?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54706" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54709" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54708" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d3515404-e458-43c6-9aae-2d701567ee54 local="10.10.10.14:8443" remote="100.122.142.76:54704" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54711" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54712" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Event listener server handler started" id=525f67a4-e168-42a5-af0b-3ef4921b7d1a local="10.10.10.14:8443" remote="100.122.142.76:54712" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54713" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54714" method=GET protocol=tls url="/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=f305697fd315eaa8a9234f535f8fba2c314312515e889539f9f8326a1053b6fb" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=f305697fd315eaa8a9234f535f8fba2c314312515e889539f9f8326a1053b6fb" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54714" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54715" method=GET protocol=tls url="/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=db92231a846920c42df1bb8dbddeb5485b2236065d301d72d400208e7a56af97" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54715" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=db92231a846920c42df1bb8dbddeb5485b2236065d301d72d400208e7a56af97" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54716" method=GET protocol=tls url="/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=10ae3dde13f50f838893c095b3e5bd5e38e39dbed25d0875bdbeae5846031e34" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=10ae3dde13f50f838893c095b3e5bd5e38e39dbed25d0875bdbeae5846031e34" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54716" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54717" method=GET protocol=tls url="/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=fa508872cec1d68b15f5ae89075868d947a81ce8863950b61cc8e5dbe5974a64" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:54717" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550/websocket?secret=fa508872cec1d68b15f5ae89075868d947a81ce8863950b61cc8e5dbe5974a64" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54715" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54718" method=GET protocol=tls url="/1.0/operations/ee68d0f8-1e2a-4a4c-874b-72a2dbf09550?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54714" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54717" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:54716" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Event listener server handler stopped" listener=525f67a4-e168-42a5-af0b-3ef4921b7d1a local="10.10.10.14:8443" remote="100.122.142.76:54712" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54719" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Event listener server handler started" id=d6ff44f9-d4b4-493c-87db-ed82f8af5080 local="10.10.10.14:8443" remote="100.122.142.76:54720" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54720" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54721" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54722" method=GET protocol=tls url="/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=010c05f1393978e7a7fa7e0066a057e93779c83109446e6206f4607582e5dbdd" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54722" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=010c05f1393978e7a7fa7e0066a057e93779c83109446e6206f4607582e5dbdd" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54723" method=GET protocol=tls url="/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=b116ea1e661bc521e7c76e0c040e4717b7a2b0b4b5e09d7f4849670d2a96e68d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=b116ea1e661bc521e7c76e0c040e4717b7a2b0b4b5e09d7f4849670d2a96e68d" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54723" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54724" method=GET protocol=tls url="/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=b29fd7143a7b6a74a181551de0b9d8598720cf2bbeed333ce868ecbf6e9a3e3d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=b29fd7143a7b6a74a181551de0b9d8598720cf2bbeed333ce868ecbf6e9a3e3d" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54724" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54725" method=GET protocol=tls url="/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=193124bb182fe987969481c4a127d2dd5fc75a520d155c88fb524046caa20249" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:54725" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1/websocket?secret=193124bb182fe987969481c4a127d2dd5fc75a520d155c88fb524046caa20249" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54723" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54726" method=GET protocol=tls url="/1.0/operations/5e223de8-b729-4acc-83ea-eee06e4250a1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54724" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54722" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:54725" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d6ff44f9-d4b4-493c-87db-ed82f8af5080 local="10.10.10.14:8443" remote="100.122.142.76:54720" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54727" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54728" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:40:06Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.debug.log new file mode 100644 index 0000000..d691542 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:40:24-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.log new file mode 100644 index 0000000..bd2d5ff --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/monitor-delete.log @@ -0,0 +1,164 @@ +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Event listener server handler started" id=569ee6c2-d590-4397-afee-acb4add180e4 local="10.10.10.14:8443" remote="100.122.142.76:54892" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.462018784s +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54893" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54894" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54895" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54896" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:40:01.27122137Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:40:01.848300453Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:40:02.076644578Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:40:02.613021579Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54897" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54898" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Event listener server handler started" id=e2541b60-1a7a-4e1c-9389-3953867bdcc8 local="10.10.10.14:8443" remote="100.122.142.76:54899" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54899" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54900" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:24Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 15:40:01.27122137 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:40:01.848300453 +0000 UTC" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54901" method=GET protocol=tls url="/1.0/operations/9b944a2c-e708-4545-9198-5e01a24f9ff3?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54903" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:25Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 15:40:01.27122137 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:40:01.848300453 +0000 UTC" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54904" method=GET protocol=tls url="/1.0/operations/3085d8bf-45c2-4fe4-beb6-c97aaac8baa5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 15:40:01.27122137 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:40:01.848300453 +0000 UTC" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e2541b60-1a7a-4e1c-9389-3953867bdcc8 local="10.10.10.14:8443" remote="100.122.142.76:54899" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54906" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54907" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54908" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Event listener server handler started" id=200e9ef0-942f-42c3-8f80-397b3e3fe1af local="10.10.10.14:8443" remote="100.122.142.76:54908" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54909" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:25Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 15:40:02.076644578 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:40:02.613021579 +0000 UTC" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54910" method=GET protocol=tls url="/1.0/operations/7a05a38f-4ef4-4a1b-9873-fa625a3576a2?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:25Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54913" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:26Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 15:40:02.076644578 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:40:02.613021579 +0000 UTC" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54915" method=GET protocol=tls url="/1.0/operations/38e22bf6-b6f8-4ed8-9430-d8095703c2bb?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 15:40:02.076644578 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:40:02.613021579 +0000 UTC" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Event listener server handler stopped" listener=200e9ef0-942f-42c3-8f80-397b3e3fe1af local="10.10.10.14:8443" remote="100.122.142.76:54908" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54917" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54918" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54919" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54920" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54921" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54922" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54923" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54924" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54925" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54927" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54928" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54929" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:26Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54930" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54931" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54932" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54933" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Event listener server handler started" id=548a36f7-c211-4956-af41-acc24f53597b local="10.10.10.14:8443" remote="100.122.142.76:54934" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54934" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54935" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=3563724e-8f03-4d05-8582-cfb862f0961c project=ac-ovn-spike +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=3563724e-8f03-4d05-8582-cfb862f0961c project=ac-ovn-spike +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=3563724e-8f03-4d05-8582-cfb862f0961c project=ac-ovn-spike +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54936" method=GET protocol=tls url="/1.0/operations/3563724e-8f03-4d05-8582-cfb862f0961c?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Event listener server handler stopped" listener=548a36f7-c211-4956-af41-acc24f53597b local="10.10.10.14:8443" remote="100.122.142.76:54934" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54937" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:54938" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:40:27Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/probe.stdout.txt new file mode 100644 index 0000000..cac7947 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/probe.stdout.txt @@ -0,0 +1,136 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.106 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.094 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"996e94d7-6d15-43a2-b952-845b43c3ed3d","volatile.eth0.host_name":"veth87094e38","volatile.eth0.hwaddr":"10:66:6a:1b:1a:b9","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"cd170a60-a186-4715-8e91-927e2fd2163d","volatile.uuid.generation":"cd170a60-a186-4715-8e91-927e2fd2163d"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:40:01.27122137Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"996e94d7-6d15-43a2-b952-845b43c3ed3d","volatile.eth0.host_name":"veth87094e38","volatile.eth0.hwaddr":"10:66:6a:1b:1a:b9","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"cd170a60-a186-4715-8e91-927e2fd2163d","volatile.uuid.generation":"cd170a60-a186-4715-8e91-927e2fd2163d"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:40:01.848300453Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9433088,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe1b:1ab9","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:1b:1a:b9","host_name":"veth87094e38","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4176513,"processes":4,"cpu":{"usage":488736000,"allocated_time":24000000000},"started_at":"2026-09-12T15:40:00.859999895Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"1abfea6f-a42c-492f-be6c-1f5406a0f084","volatile.eth0.host_name":"veth1f9ee21d","volatile.eth0.hwaddr":"10:66:6a:8c:72:d6","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"484c0081-0f47-4f02-901e-461f79d4f2dc","volatile.uuid.generation":"484c0081-0f47-4f02-901e-461f79d4f2dc"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:40:02.076644578Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"1abfea6f-a42c-492f-be6c-1f5406a0f084","volatile.eth0.host_name":"veth1f9ee21d","volatile.eth0.hwaddr":"10:66:6a:8c:72:d6","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"484c0081-0f47-4f02-901e-461f79d4f2dc","volatile.uuid.generation":"484c0081-0f47-4f02-901e-461f79d4f2dc"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:40:02.613021579Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11571200,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe8c:72d6","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:8c:72:d6","host_name":"veth1f9ee21d","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":34640,"processes":4,"cpu":{"usage":488719000,"allocated_time":24000000000},"started_at":"2026-09-12T15:40:02.619999885Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.523 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.244 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.249 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.308 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=1.078 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.475 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.475/0.953/1.308 ms +elapsed_seconds=2.236 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.950 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.693 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.285 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.285/0.642/0.950 ms +elapsed_seconds=2.659 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.296 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.218 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.619 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.619/1.377/2.296 ms +elapsed_seconds=2.192 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.176 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.155 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.089 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 1.089/1.473/2.176 ms +elapsed_seconds=2.275 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Non-authoritative answer: +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.310 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.267 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.324 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.279 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.029 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.128441 bytes_per_second=778567591 +elapsed_seconds=0.375 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.500 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.109174 bytes_per_second=915969003 +elapsed_seconds=0.347 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.506 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/tcpdump-arp.log new file mode 100644 index 0000000..a47c6ed --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +15:40:09.287107 10:66:6a:1f:21:eb > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +15:40:17.288927 10:66:6a:1f:21:eb > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/topology.jsonl new file mode 100644 index 0000000..ee5c8e3 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-3/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.081, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.38, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.633, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.109, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.271, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.436, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:40:01.184518696Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"aa5b61c5-95e6-4e79-9ab4-64f3a49730b6\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:40:01.184518696Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.416, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.428, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:40:02.033534024Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"dc39bb43-7be2-4e5c-a349-13346255be24\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:40:02.033534024Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.313, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.197, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 147652000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 6180864,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe1b:1ab9\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth87094e38\",\n\t\t\t\"hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4176513,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:40:00.859999895Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.217, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 124330000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6434816,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe8c:72d6\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"veth1f9ee21d\",\n\t\t\t\"hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 34640,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:40:02.619999885Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t},\n\t\"created_at\": \"2026-09-12T15:40:01.27122137Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:40:01.848300453Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t},\n\t\"created_at\": \"2026-09-12T15:40:02.076644578Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:40:02.613021579Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.227, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=2.076 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 2.076/2.076/2.076 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.317, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.201, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.274, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.339, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-gp4imcze/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.194, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.271, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.523, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.029354 seconds, 3.2GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.532, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.024458 seconds, 3.8GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.258, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:40:01.27122137Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"996e94d7-6d15-43a2-b952-845b43c3ed3d\",\n\t\t\t\"volatile.eth0.host_name\": \"veth87094e38\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:1b:1a:b9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"cd170a60-a186-4715-8e91-927e2fd2163d\",\n\t\t\t\"volatile.uuid.generation\": \"cd170a60-a186-4715-8e91-927e2fd2163d\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:40:01.848300453Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:40:02.076644578Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"1abfea6f-a42c-492f-be6c-1f5406a0f084\",\n\t\t\t\"volatile.eth0.host_name\": \"veth1f9ee21d\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:8c:72:d6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\",\n\t\t\t\"volatile.uuid.generation\": \"484c0081-0f47-4f02-901e-461f79d4f2dc\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:40:02.613021579Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.964, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.955, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.142, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.18, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.083, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T15:40:02.108326115Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T15:40:01.055152699Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.126, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.104, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/commands.jsonl new file mode 100644 index 0000000..1574939 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.101, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:44:31.308443+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.316, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:44:31.624613+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.185, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T15:44:31.810437+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 6068, "ready": true, "ready_signal": "time=\"2026-09-12T08:44:31-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:44:31.893578+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/topology.jsonl", "create"], "seconds": 8.908, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.591,\n \"first_cross_member_ping_seconds\": 3.697,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:40.802043+00:00"} +{"capture": "monitor-create", "pid": 6068, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.log", "ready_signal": "time=\"2026-09-12T08:44:31-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:44:40.807097+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.089, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:40.896375+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.09, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:3d:55:e6 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:02:c1:d4 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:40.987096+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.119, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch c601fdcd-bf61-4321-aff9-ac4cbff4de3a (incus-net35-ls-ext)\n port incus-net35-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net35-ls-ext-lsp-router\n type: router\n router-port: incus-net35-lr-lrp-ext\nswitch d1459ccf-1f95-4363-b19a-409fa9de431e (incus-net35-ls-int)\n port incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0\n addresses: [\"10:66:6a:02:c1:d4 dynamic\"]\n port incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0\n addresses: [\"10:66:6a:3d:55:e6 dynamic\"]\n port incus-net35-ls-int-lsp-router\n type: router\n router-port: incus-net35-lr-lrp-int\nrouter 32d5651d-981e-4e16-bb5c-68e374be097f (incus-net35-lr)\n port incus-net35-lr-lrp-ext\n mac: \"10:66:6a:97:88:42\"\n ipv6-lla: \"fe80::1266:6aff:fe97:8842\"\n networks: [\"10.10.40.64/24\"]\n port incus-net35-lr-lrp-int\n mac: \"10:66:6a:97:88:42\"\n ipv6-lla: \"fe80::1266:6aff:fe97:8842\"\n networks: [\"10.253.73.1/24\"]\n nat c214de1b-a159-4a64-b0a9-f4c6a19f2767\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net35-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : bdd30abd-df43-4485-a81d-94ba968e7d2b\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:97:88:42\"\nname : incus-net35-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 9a0ddff7-cb8a-4193-9a4a-9d24b5e6eec8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 24073851-46ac-4583-85ec-51ea82f837d7\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:97:88:42\"\nname : incus-net35-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 6e985934-0679-400b-bc2f-0008abc6afda\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : 2f43d3a3-036c-4734-8f3c-1ba4a4dc22ec\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c81f3409-dc9d-4972-9594-2b864d3d35fd\nlogical_port : cr-incus-net35-lr-lrp-ext\nmac : [\"10:66:6a:97:88:42 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net35-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:97:88:42 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:44:41.106462+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.32, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:97:88:42 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:44:41.426651+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.24, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873753775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84316|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873753922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84317|bridge|INFO|bridge incusovn16: using datapath ID 00009a579efe0f49\"\n },\n {\n \"at\": \"1789227873753964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84318|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873755158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84319|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873755212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873755237\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873755257\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873755280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873755297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873755310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873755396\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873755445\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873755464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873755505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873755556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873755612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84320|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873755628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873755640\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873755653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873755666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873755683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873755702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873755761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873755817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873755830\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873755869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873755905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873755941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873755982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84321|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873756003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873756016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873756027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873756048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873756066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873756078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873756130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873756150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873756170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873756188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873756204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756222\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873756239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873756253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873756271\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873756322\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756336\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873849544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler265)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873849658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler265)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873849714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873849762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873849809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xa3aaccff your_disc:0x0\"\n },\n {\n \"at\": \"1789227873849850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873849954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873850025\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873850289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873850334\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873850380\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873850418\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873850539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873850573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873850604\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873850634\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873850667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873850743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873850780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873850814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873850851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873850891\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873851015\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151850ms\"\n },\n {\n \"at\": \"1789227873851347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151850ms\"\n },\n {\n \"at\": \"1789227873851450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873851695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873851727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873851765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873851804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873851836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873851878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873851911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873851950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873851986\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873852016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873852067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873852108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873852146\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84322|dpif|WARN|Dropped 627 log messages in last 247 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227873852177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84324|bridge|WARN|Dropped 54314 log messages in last 273 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227873852269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84325|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873852307\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84327|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873852427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84329|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873853317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler265)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873853407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler265)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873853474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873853536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873853581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x15434add your_disc:0x296246be\"\n },\n {\n \"at\": \"1789227873853617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873853661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873853697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873853731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873853766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873853809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873853834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873853864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873853910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +832ms\"\n },\n {\n \"at\": \"1789227873853947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789227873853976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873854005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873854037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873854070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873854109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873854210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873854259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873854289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873854328\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873854354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873854402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler265)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873854442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873854481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873854526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873854558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873854592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873854619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873854657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +832ms\"\n },\n {\n \"at\": \"1789227873854693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789227873854967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873855036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873855073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873855122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855173\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873855201\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873855231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873855296\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855322\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler265)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873855393\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler265)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873855424\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873855450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873855473\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x277d8736 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873855503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873855531\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873855554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873855578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873855616\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873855639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873855657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873855753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873855771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873855809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873855864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873855887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873855927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873855950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873856013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873856035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873856056\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873856073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873856092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873856111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873856133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151854ms\"\n },\n {\n \"at\": \"1789227873856160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151854ms\"\n },\n {\n \"at\": \"1789227873856181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873856198\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873856219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873856234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873856251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856265\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873856302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873856325\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873856339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873856356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873856420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873856444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84331|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873856465\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84332|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873859876\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84333|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227873859992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84334|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789227874139693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84335|bridge|WARN|Dropped 513 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227874139803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84336|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227874783907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874784116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874784138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874784159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874784177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874784196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874784210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874784222\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +32ms\"\n },\n {\n \"at\": \"1789227874784246\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -928ms\"\n },\n {\n \"at\": \"1789227874784262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874784274\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874784295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874784313\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227874784327\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874784366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874784385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874784402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227874784419\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874784429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874820283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874820359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874820386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874820407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874820427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874820446\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874820461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874820477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +657ms\"\n },\n {\n \"at\": \"1789227874820503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -143ms\"\n },\n {\n \"at\": \"1789227874820524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874820534\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874820550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874820560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227874820570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874820614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874820624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874820639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227874820652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874820666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820676\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874849601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84337|dpif|WARN|Dropped 1965 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227874849667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227875225028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84339|bridge|INFO|bridge br-int: added interface vethe8917453 on port 34\"\n },\n {\n \"at\": \"1789227875850136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84340|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227875850324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227876092045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84342|poll_loop|INFO|Dropped 722 log messages in last 250 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227876092166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84343|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876092469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84344|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876093067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876093475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876094184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84347|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876094690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876095158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84349|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876095711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84350|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876096181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84351|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876096671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84352|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876849808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84353|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227876849933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227877849856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84355|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227877850152\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227878849960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84357|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227878850208\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227879849905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84359|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227879850029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227880849973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84361|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227880850106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:41.670894+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.17, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873737783\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00214|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873738103\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00215|bridge|INFO|bridge incusovn16: using datapath ID 0000c687844de948\"\n },\n {\n \"at\": \"1789227873738311\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00216|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873740647\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873740697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873740712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873740726\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873740737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873740747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873740763\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740795\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740805\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873740818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873740834\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873740845\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873740856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873740866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740875\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873740887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873740899\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873740908\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873740919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740930\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740941\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873740951\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00218|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873740964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873740974\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873740985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873740995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741014\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741026\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741037\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873741049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873741102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741160\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741169\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873741189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00219|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741201\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741227\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741274\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741294\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741304\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741344\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741353\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873741365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741375\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741397\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741409\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741439\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873743978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler261)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873744016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler261)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873744033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873744048\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873744063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x296246be your_disc:0x0\"\n },\n {\n \"at\": \"1789227873744076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873744087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873744099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873744109\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744120\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873744132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744143\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744182\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744193\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873744203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873744215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873744236\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873744270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873744287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873744308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873744320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873744354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873744365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744375\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873744386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744401\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744412\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873744426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873744456\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873744466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744476\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873744486\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744508\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873744520\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873744531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744541\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873744552\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744576\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873835313\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873835363\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227873837095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler261)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873837134\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler261)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873837146\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873837156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873837170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xe1085a38 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873837181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873837192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873837203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873837213\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873837233\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837244\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873837301\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873837310\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837321\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873837331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873837360\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873837370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873837390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873837403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837413\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873837433\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873837441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873837459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873837488\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873837515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873837525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873837542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873837567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873837576\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837583\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873837593\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837601\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler261)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873841104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler261)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873841114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873841123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873841131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xbf36e8e3 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873841140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873841149\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873841157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873841166\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873841184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841200\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128840ms\"\n },\n {\n \"at\": \"1789227873841210\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227873841221\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227873841230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873841239\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873841248\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873841264\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873841293\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873841300\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873841316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873841323\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841338\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873841346\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873841354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873841369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841385\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873841392\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227873841403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227873841410\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873841418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873841426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841435\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873841443\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873841472\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873841479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841487\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873841496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873842905\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873843010\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00223|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227874672898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874673000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874673029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874673050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874673073\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874673102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874673124\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874673147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +158ms\"\n },\n {\n \"at\": \"1789227874673170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -832ms\"\n },\n {\n \"at\": \"1789227874673192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874673214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874673243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874673273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227874673292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874673355\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874673379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874673408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227874673428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874673450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874758219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874758471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874758495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874758517\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874758543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874758567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874758589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874758608\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227874758627\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -87ms\"\n },\n {\n \"at\": \"1789227874758651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874758674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874758696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874758717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227874758739\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758760\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758781\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874758800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874758821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874758840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227874758859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874758880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874761753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874761808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874761819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874761828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874761837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874761847\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874761856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874761864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +510ms\"\n },\n {\n \"at\": \"1789227874761876\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -250ms\"\n },\n {\n \"at\": \"1789227874761887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874761896\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874761907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874761916\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874761924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761933\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874761951\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874761959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874761969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874761978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874761986\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:41.841872+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.171, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873738760\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00236|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873738935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000066e755c19444\"\n },\n {\n \"at\": \"1789227873738964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00238|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873741335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00239|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741422\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741495\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741539\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741571\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741604\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873741621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741653\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873741768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873749097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00240|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873749159\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873749174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873749185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873749195\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873749206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873749217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749251\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873749262\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749273\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749282\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873749294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873749305\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873749326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749345\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873749356\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873749389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00241|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873749403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873749415\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873749424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873749435\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873749445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873749456\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873749497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749506\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873749532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873749543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749552\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873749563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749578\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873749598\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873836271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00242|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873836530\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00243|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227873843804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00244|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873843888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00245|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227873844239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler265)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873844326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler265)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873844365\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873844400\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873844424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x57037ae4 your_disc:0x277d8736\"\n },\n {\n \"at\": \"1789227873844448\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873844476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873844499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873844523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873844545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873844568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873844596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873844622\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028842ms\"\n },\n {\n \"at\": \"1789227873844647\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +927ms\"\n },\n {\n \"at\": \"1789227873844678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227873844703\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873844725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873844753\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873844781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873844804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873844875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873844898\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873844922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873844946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873844971\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873845020\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler265)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873845044\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873845079\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873845102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873845124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873845144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873845165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873845189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +927ms\"\n },\n {\n \"at\": \"1789227873845212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227873845235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873845297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873845320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873845344\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873845366\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845386\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873845429\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873845450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873845472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873845493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845519\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874496814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler272)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227874496927\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler272)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227874496968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227874497006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227874497031\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xbeb6ee15 your_disc:0x42213715\"\n },\n {\n \"at\": \"1789227874497058\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874497098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874497124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227874497151\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497181\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874497208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50029494ms\"\n },\n {\n \"at\": \"1789227874497286\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +195ms\"\n },\n {\n \"at\": \"1789227874497315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -755ms\"\n },\n {\n \"at\": \"1789227874497338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874497362\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874497384\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874497436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497466\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874497523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874497545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497569\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874497594\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227874497617\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497666\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler272)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874497695\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874497724\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874497771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874497841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +195ms\"\n },\n {\n \"at\": \"1789227874497866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -755ms\"\n },\n {\n \"at\": \"1789227874497890\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874497920\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874497944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874497999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874498087\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874498114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874498138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874498162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874512379\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler272)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227874512490\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler272)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227874512532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227874512561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227874512586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x323b8422 your_disc:0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874512614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874512644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874512675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227874512701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874512727\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874512758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874512786\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874512810\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50029510ms\"\n },\n {\n \"at\": \"1789227874512838\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +249ms\"\n },\n {\n \"at\": \"1789227874512862\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -671ms\"\n },\n {\n \"at\": \"1789227874512888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874512911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874512935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874512958\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874512983\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874513057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874513090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513126\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874513152\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227874513172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513195\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874513220\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler272)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874513247\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874513271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874513292\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874513313\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874513335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874513358\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874513389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +249ms\"\n },\n {\n \"at\": \"1789227874513410\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -671ms\"\n },\n {\n \"at\": \"1789227874513469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874513499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874513523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513546\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874513568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513616\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874513639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874513659\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513682\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874513704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513748\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227876199497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge br-int: added interface veth3e3d489f on port 32\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:42.013654+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.168, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873618063\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873618214\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 00001e098d56774c\"\n },\n {\n \"at\": \"1789227873618232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00220|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873715222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873715390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227873722901\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00223|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873723034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00224|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789227873741657\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00225|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741688\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741767\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741801\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741833\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741882\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873741899\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741945\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741995\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873742011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873742030\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873742045\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873742061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873746586\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler273)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873746610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler273)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873746628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873746651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873746705\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x42213715 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873746728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873746751\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873746766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873746781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873746795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873746810\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873746824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873746850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255610ms\"\n },\n {\n \"at\": \"1789227873746866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +755ms\"\n },\n {\n \"at\": \"1789227873746883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227873746905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873746922\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873746940\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873746955\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873746975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873746996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747020\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873747063\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747084\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873747108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747130\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747151\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747205\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747258\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747301\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747315\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873747334\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +755ms\"\n },\n {\n \"at\": \"1789227873747348\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227873747365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873747383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873747398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747412\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873747426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747461\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873747490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747504\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873747519\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747538\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747583\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747614\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873747658\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747672\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747708\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873747722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873747735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873747765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873747823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747838\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873747853\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873747900\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00227|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873747993\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748023\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873748052\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873748066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873748080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873748096\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873748110\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873748141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873748158\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873748173\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873748193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873846849\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler273)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873847004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler273)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873847026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873847049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873847065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xff024ef1 your_disc:0xe1085a38\"\n },\n {\n \"at\": \"1789227873847083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873847098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873847114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873847135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873847165\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847196\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255710ms\"\n },\n {\n \"at\": \"1789227873847211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +816ms\"\n },\n {\n \"at\": \"1789227873847228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227873847255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873847269\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873847282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847296\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873847311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847328\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873847360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873847379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873847411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873847426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler273)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873847474\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873847489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847503\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873847517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873847560\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +816ms\"\n },\n {\n \"at\": \"1789227873847575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227873847589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873847604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873847619\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847634\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873847649\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847676\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873847691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873847704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847719\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873847733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847755\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847770\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849210\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler273)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873849345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler273)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873849365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873849376\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873849387\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x33a33fab your_disc:0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849418\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873849432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873849454\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255713ms\"\n },\n {\n \"at\": \"1789227873849488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +963ms\"\n },\n {\n \"at\": \"1789227873849500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227873849515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873849525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873849536\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873849592\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873849602\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873849629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873849639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler273)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873849674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873849685\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849698\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873849709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849718\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849737\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873849747\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +963ms\"\n },\n {\n \"at\": \"1789227873849758\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227873849768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873849780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873849791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849801\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849811\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849821\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873849841\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873849854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849887\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873849907\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849939\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874697395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874697803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874697827\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874697853\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874697888\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874697965\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874698000\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874698034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +634ms\"\n },\n {\n \"at\": \"1789227874698068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -196ms\"\n },\n {\n \"at\": \"1789227874698098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874698125\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874698163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874698191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874698219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698247\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874698303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874698338\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874698365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874698395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874698422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:42.182377+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-before-probe.txt", "router_mac": "10:66:6a:97:88:42", "at": "2026-09-12T15:44:42.183245+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.089, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:44:34.604286256Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:44:35.453504088Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:44:35.69990885Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:44:36.279137454Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:42.272487+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 6600, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T15:44:42.389751+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.41, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.086 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.086 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\"volatile.eth0.host_name\":\"vethe8917453\",\"volatile.eth0.hwaddr\":\"10:66:6a:3d:55:e6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\"volatile.uuid.generation\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:44:34.604286256Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\"volatile.eth0.host_name\":\"vethe8917453\",\"volatile.eth0.hwaddr\":\"10:66:6a:3d:55:e6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\"volatile.uuid.generation\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:44:35.453504088Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9863168,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe3d:55e6\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:3d:55:e6\",\"host_name\":\"vethe8917453\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4177784,\"processes\":4,\"cpu\":{\"usage\":525974000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:44:34.470000028Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ff0468-0864-413e-89cc-3fc5368af7e0\",\"volatile.eth0.host_name\":\"veth3e3d489f\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:c1:d4\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\",\"volatile.uuid.generation\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:44:35.69990885Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ff0468-0864-413e-89cc-3fc5368af7e0\",\"volatile.eth0.host_name\":\"veth3e3d489f\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:c1:d4\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\",\"volatile.uuid.generation\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:44:36.279137454Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11436032,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe02:c1d4\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:02:c1:d4\",\"host_name\":\"veth3e3d489f\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":35431,\"processes\":4,\"cpu\":{\"usage\":508698000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:44:36.289999961Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.359 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.243 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.220 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.029 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.907 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.318 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.318/0.751/1.029 ms\nelapsed_seconds=2.292 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.132 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.826 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.468 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.468/0.808/1.132 ms\nelapsed_seconds=2.253 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.051 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.456 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.732 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.732/1.413/2.051 ms\nelapsed_seconds=2.329 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.879 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.331 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.857 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.857/1.355/1.879 ms\nelapsed_seconds=2.327 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nelapsed_seconds=0.423 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.237 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.376 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.316 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.025 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.198354 bytes_per_second=504149147\nelapsed_seconds=0.433 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.503 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.120895 bytes_per_second=827164067\nelapsed_seconds=0.350 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.508 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:56.800239+00:00"} +{"capture": "tcpdump-arp", "pid": 6600, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T15:44:56.802810+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.083, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:56.885577+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:3d:55:e6 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:02:c1:d4 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:56.972154+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.124, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch c601fdcd-bf61-4321-aff9-ac4cbff4de3a (incus-net35-ls-ext)\n port incus-net35-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net35-ls-ext-lsp-router\n type: router\n router-port: incus-net35-lr-lrp-ext\nswitch d1459ccf-1f95-4363-b19a-409fa9de431e (incus-net35-ls-int)\n port incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0\n addresses: [\"10:66:6a:02:c1:d4 dynamic\"]\n port incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0\n addresses: [\"10:66:6a:3d:55:e6 dynamic\"]\n port incus-net35-ls-int-lsp-router\n type: router\n router-port: incus-net35-lr-lrp-int\nrouter 32d5651d-981e-4e16-bb5c-68e374be097f (incus-net35-lr)\n port incus-net35-lr-lrp-ext\n mac: \"10:66:6a:97:88:42\"\n ipv6-lla: \"fe80::1266:6aff:fe97:8842\"\n networks: [\"10.10.40.64/24\"]\n port incus-net35-lr-lrp-int\n mac: \"10:66:6a:97:88:42\"\n ipv6-lla: \"fe80::1266:6aff:fe97:8842\"\n networks: [\"10.253.73.1/24\"]\n nat c214de1b-a159-4a64-b0a9-f4c6a19f2767\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net35-lr-lrp-ext\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : bdd30abd-df43-4485-a81d-94ba968e7d2b\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:97:88:42\"\nname : incus-net35-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 9a0ddff7-cb8a-4193-9a4a-9d24b5e6eec8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 24073851-46ac-4583-85ec-51ea82f837d7\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:97:88:42\"\nname : incus-net35-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"67314e94-b0b4-4c97-8146-0c67aff4d585\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 6e985934-0679-400b-bc2f-0008abc6afda\nadditional_chassis : []\nadditional_encap : []\nchassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3\ndatapath : 2f43d3a3-036c-4734-8f3c-1ba4a4dc22ec\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c81f3409-dc9d-4972-9594-2b864d3d35fd\nlogical_port : cr-incus-net35-lr-lrp-ext\nmac : [\"10:66:6a:97:88:42 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net35-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:97:88:42 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:44:57.095964+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.318, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:97:88:42 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:44:57.414528+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.173, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873753775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84316|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873753922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84317|bridge|INFO|bridge incusovn16: using datapath ID 00009a579efe0f49\"\n },\n {\n \"at\": \"1789227873753964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84318|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873755158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84319|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873755212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873755237\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873755257\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873755280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873755297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873755310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873755396\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873755445\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873755464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873755505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873755556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873755612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84320|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873755628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873755640\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873755653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873755666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873755683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873755702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873755761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873755817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873755830\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873755869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873755905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873755941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873755982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84321|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873756003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873756016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873756027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873756048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873756066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873756078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873756130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873756150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873756170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873756188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873756204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756222\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873756239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873756253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873756271\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873756322\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756336\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873849544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler265)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873849658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler265)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873849714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873849762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873849809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xa3aaccff your_disc:0x0\"\n },\n {\n \"at\": \"1789227873849850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873849954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873850025\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873850289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873850334\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873850380\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873850418\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873850539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873850573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873850604\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873850634\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873850667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873850743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873850780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873850814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873850851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873850891\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873851015\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151850ms\"\n },\n {\n \"at\": \"1789227873851347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151850ms\"\n },\n {\n \"at\": \"1789227873851450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873851695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873851727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873851765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873851804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873851836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873851878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873851911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873851950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873851986\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873852016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873852067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873852108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873852146\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84322|dpif|WARN|Dropped 627 log messages in last 247 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227873852177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84324|bridge|WARN|Dropped 54314 log messages in last 273 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227873852269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84325|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873852307\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84327|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873852427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84329|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873853317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler265)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873853407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler265)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873853474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873853536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873853581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x15434add your_disc:0x296246be\"\n },\n {\n \"at\": \"1789227873853617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873853661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873853697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873853731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873853766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873853809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873853834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873853864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873853910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +832ms\"\n },\n {\n \"at\": \"1789227873853947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789227873853976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873854005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873854037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873854070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873854109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873854210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873854259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873854289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873854328\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873854354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873854402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler265)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873854442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873854481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873854526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873854558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873854592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873854619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873854657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +832ms\"\n },\n {\n \"at\": \"1789227873854693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789227873854967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873855036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873855073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873855122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855173\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873855201\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873855231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873855296\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855322\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler265)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873855393\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler265)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873855424\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873855450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873855473\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x277d8736 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873855503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873855531\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873855554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873855578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873855616\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873855639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873855657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873855753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873855771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873855809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873855864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873855887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873855927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873855950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873856013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873856035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873856056\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873856073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873856092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873856111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873856133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151854ms\"\n },\n {\n \"at\": \"1789227873856160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151854ms\"\n },\n {\n \"at\": \"1789227873856181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873856198\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873856219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873856234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873856251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856265\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873856302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873856325\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873856339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873856356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873856420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873856444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84331|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873856465\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84332|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873859876\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84333|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227873859992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84334|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789227874139693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84335|bridge|WARN|Dropped 513 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227874139803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84336|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227874783907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874784116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874784138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874784159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874784177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874784196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874784210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874784222\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +32ms\"\n },\n {\n \"at\": \"1789227874784246\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -928ms\"\n },\n {\n \"at\": \"1789227874784262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874784274\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874784295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874784313\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227874784327\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874784366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874784385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874784402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227874784419\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874784429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874820283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874820359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874820386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874820407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874820427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874820446\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874820461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874820477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +657ms\"\n },\n {\n \"at\": \"1789227874820503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -143ms\"\n },\n {\n \"at\": \"1789227874820524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874820534\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874820550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874820560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227874820570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874820614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874820624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874820639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227874820652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874820666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820676\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874849601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84337|dpif|WARN|Dropped 1965 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227874849667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227875225028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84339|bridge|INFO|bridge br-int: added interface vethe8917453 on port 34\"\n },\n {\n \"at\": \"1789227875850136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84340|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227875850324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227876092045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84342|poll_loop|INFO|Dropped 722 log messages in last 250 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227876092166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84343|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876092469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84344|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876093067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876093475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876094184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84347|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876094690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876095158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84349|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876095711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84350|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876096181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84351|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876096671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84352|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876849808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84353|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227876849933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227877849856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84355|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227877850152\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227878849960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84357|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227878850208\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227879849905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84359|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227879850029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227880849973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84361|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227880850106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227881849613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84363|dpif|WARN|Dropped 2094 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227881849716\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227882092169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84365|poll_loop|INFO|Dropped 12403 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227882092349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84366|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227882849696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84367|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227882849796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227883756788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84369|connmgr|INFO|br-int<->unix#7: 893 flow_mods in the 7 s starting 10 s ago (829 adds, 57 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789227883850082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84370|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227883850155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227884849858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84372|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227884850102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84373|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227885849589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84374|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227885849687\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227886849563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84376|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227886849803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227887849833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84378|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227887850050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227888091593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84380|poll_loop|INFO|Dropped 12195 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227888091690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84381|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227888849637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84382|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227888849776\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227889850071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84384|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227889850315\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227890849645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84386|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227890849757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227891849872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84388|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227891850136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227892849901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84390|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227892850133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227893849869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84392|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227893850026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84393|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227894092228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84394|poll_loop|INFO|Dropped 12194 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227894092354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84395|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227894849639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84396|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227894849747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84397|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227895849744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84398|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227895849992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84399|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227896849667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84400|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227896849825\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84401|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:57.589863+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.176, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873737783\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00214|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873738103\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00215|bridge|INFO|bridge incusovn16: using datapath ID 0000c687844de948\"\n },\n {\n \"at\": \"1789227873738311\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00216|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873740647\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873740697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873740712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873740726\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873740737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873740747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873740763\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740795\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740805\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873740818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873740834\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873740845\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873740856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873740866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740875\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873740887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873740899\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873740908\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873740919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740930\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740941\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873740951\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00218|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873740964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873740974\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873740985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873740995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741014\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741026\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741037\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873741049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873741102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741160\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741169\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873741189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00219|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741201\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741227\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741274\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741294\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741304\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741344\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741353\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873741365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741375\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741397\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741409\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741439\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873743978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler261)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873744016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler261)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873744033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873744048\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873744063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x296246be your_disc:0x0\"\n },\n {\n \"at\": \"1789227873744076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873744087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873744099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873744109\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744120\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873744132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744143\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744182\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744193\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873744203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873744215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873744236\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873744270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873744287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873744308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873744320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873744354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873744365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744375\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873744386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744401\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744412\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873744426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873744456\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873744466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744476\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873744486\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744508\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873744520\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873744531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744541\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873744552\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744576\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873835313\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873835363\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227873837095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler261)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873837134\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler261)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873837146\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873837156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873837170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xe1085a38 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873837181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873837192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873837203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873837213\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873837233\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837244\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873837301\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873837310\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837321\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873837331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873837360\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873837370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873837390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873837403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837413\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873837433\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873837441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873837459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873837488\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873837515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873837525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873837542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873837567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873837576\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837583\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873837593\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837601\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler261)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873841104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler261)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873841114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873841123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873841131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xbf36e8e3 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873841140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873841149\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873841157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873841166\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873841184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841200\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128840ms\"\n },\n {\n \"at\": \"1789227873841210\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227873841221\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227873841230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873841239\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873841248\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873841264\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873841293\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873841300\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873841316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873841323\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841338\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873841346\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873841354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873841369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841385\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873841392\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227873841403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227873841410\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873841418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873841426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841435\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873841443\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873841472\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873841479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841487\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873841496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873842905\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873843010\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00223|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227874672898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874673000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874673029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874673050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874673073\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874673102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874673124\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874673147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +158ms\"\n },\n {\n \"at\": \"1789227874673170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -832ms\"\n },\n {\n \"at\": \"1789227874673192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874673214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874673243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874673273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227874673292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874673355\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874673379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874673408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227874673428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874673450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874758219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874758471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874758495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874758517\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874758543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874758567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874758589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874758608\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227874758627\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -87ms\"\n },\n {\n \"at\": \"1789227874758651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874758674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874758696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874758717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227874758739\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758760\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758781\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874758800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874758821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874758840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227874758859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874758880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874761753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874761808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874761819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874761828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874761837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874761847\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874761856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874761864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +510ms\"\n },\n {\n \"at\": \"1789227874761876\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -250ms\"\n },\n {\n \"at\": \"1789227874761887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874761896\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874761907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874761916\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874761924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761933\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874761951\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874761959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874761969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874761978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874761986\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227883742689\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00224|connmgr|INFO|br-int<->unix#7: 913 flow_mods in the 7 s starting 10 s ago (845 adds, 68 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:57.766709+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.178, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873738760\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00236|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873738935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000066e755c19444\"\n },\n {\n \"at\": \"1789227873738964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00238|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873741335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00239|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741422\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741495\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741539\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741571\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741604\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873741621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741653\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873741768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873749097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00240|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873749159\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873749174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873749185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873749195\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873749206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873749217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749251\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873749262\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749273\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749282\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873749294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873749305\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873749326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749345\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873749356\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873749389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00241|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873749403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873749415\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873749424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873749435\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873749445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873749456\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873749497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749506\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873749532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873749543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749552\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873749563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749578\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873749598\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873836271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00242|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873836530\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00243|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227873843804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00244|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873843888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00245|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227873844239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler265)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873844326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler265)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873844365\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873844400\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873844424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x57037ae4 your_disc:0x277d8736\"\n },\n {\n \"at\": \"1789227873844448\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873844476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873844499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873844523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873844545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873844568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873844596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873844622\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028842ms\"\n },\n {\n \"at\": \"1789227873844647\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +927ms\"\n },\n {\n \"at\": \"1789227873844678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227873844703\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873844725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873844753\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873844781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873844804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873844875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873844898\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873844922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873844946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873844971\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873845020\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler265)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873845044\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873845079\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873845102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873845124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873845144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873845165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873845189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +927ms\"\n },\n {\n \"at\": \"1789227873845212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227873845235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873845297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873845320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873845344\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873845366\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845386\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873845429\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873845450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873845472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873845493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845519\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874496814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler272)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227874496927\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler272)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227874496968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227874497006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227874497031\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xbeb6ee15 your_disc:0x42213715\"\n },\n {\n \"at\": \"1789227874497058\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874497098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874497124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227874497151\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497181\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874497208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50029494ms\"\n },\n {\n \"at\": \"1789227874497286\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +195ms\"\n },\n {\n \"at\": \"1789227874497315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -755ms\"\n },\n {\n \"at\": \"1789227874497338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874497362\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874497384\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874497436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497466\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874497523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874497545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497569\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874497594\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227874497617\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497666\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler272)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874497695\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874497724\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874497771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874497841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +195ms\"\n },\n {\n \"at\": \"1789227874497866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -755ms\"\n },\n {\n \"at\": \"1789227874497890\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874497920\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874497944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874497999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874498087\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874498114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874498138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874498162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874512379\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler272)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227874512490\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler272)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227874512532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227874512561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227874512586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x323b8422 your_disc:0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874512614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874512644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874512675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227874512701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874512727\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874512758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874512786\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874512810\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50029510ms\"\n },\n {\n \"at\": \"1789227874512838\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +249ms\"\n },\n {\n \"at\": \"1789227874512862\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -671ms\"\n },\n {\n \"at\": \"1789227874512888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874512911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874512935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874512958\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874512983\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874513057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874513090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513126\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874513152\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227874513172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513195\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874513220\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler272)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874513247\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874513271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874513292\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874513313\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874513335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874513358\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874513389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +249ms\"\n },\n {\n \"at\": \"1789227874513410\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -671ms\"\n },\n {\n \"at\": \"1789227874513469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874513499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874513523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513546\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874513568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513616\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874513639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874513659\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513682\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874513704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513748\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227876199497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge br-int: added interface veth3e3d489f on port 32\"\n },\n {\n \"at\": \"1789227883744374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00247|connmgr|INFO|br-int<->unix#7: 886 flow_mods in the 7 s starting 10 s ago (825 adds, 53 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:57.944869+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.166, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873618063\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873618214\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 00001e098d56774c\"\n },\n {\n \"at\": \"1789227873618232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00220|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873715222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873715390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227873722901\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00223|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873723034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00224|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789227873741657\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00225|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741688\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741767\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741801\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741833\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741882\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873741899\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741945\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741995\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873742011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873742030\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873742045\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873742061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873746586\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler273)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873746610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler273)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873746628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873746651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873746705\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x42213715 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873746728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873746751\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873746766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873746781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873746795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873746810\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873746824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873746850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255610ms\"\n },\n {\n \"at\": \"1789227873746866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +755ms\"\n },\n {\n \"at\": \"1789227873746883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227873746905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873746922\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873746940\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873746955\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873746975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873746996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747020\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873747063\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747084\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873747108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747130\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747151\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747205\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747258\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747301\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747315\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873747334\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +755ms\"\n },\n {\n \"at\": \"1789227873747348\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227873747365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873747383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873747398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747412\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873747426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747461\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873747490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747504\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873747519\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747538\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747583\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747614\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873747658\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747672\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747708\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873747722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873747735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873747765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873747823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747838\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873747853\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873747900\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00227|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873747993\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748023\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873748052\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873748066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873748080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873748096\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873748110\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873748141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873748158\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873748173\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873748193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873846849\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler273)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873847004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler273)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873847026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873847049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873847065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xff024ef1 your_disc:0xe1085a38\"\n },\n {\n \"at\": \"1789227873847083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873847098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873847114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873847135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873847165\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847196\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255710ms\"\n },\n {\n \"at\": \"1789227873847211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +816ms\"\n },\n {\n \"at\": \"1789227873847228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227873847255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873847269\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873847282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847296\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873847311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847328\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873847360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873847379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873847411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873847426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler273)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873847474\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873847489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847503\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873847517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873847560\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +816ms\"\n },\n {\n \"at\": \"1789227873847575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227873847589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873847604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873847619\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847634\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873847649\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847676\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873847691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873847704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847719\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873847733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847755\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847770\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849210\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler273)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873849345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler273)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873849365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873849376\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873849387\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x33a33fab your_disc:0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849418\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873849432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873849454\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255713ms\"\n },\n {\n \"at\": \"1789227873849488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +963ms\"\n },\n {\n \"at\": \"1789227873849500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227873849515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873849525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873849536\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873849592\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873849602\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873849629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873849639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler273)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873849674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873849685\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849698\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873849709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849718\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849737\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873849747\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +963ms\"\n },\n {\n \"at\": \"1789227873849758\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227873849768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873849780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873849791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849801\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849811\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849821\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873849841\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873849854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849887\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873849907\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849939\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874697395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874697803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874697827\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874697853\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874697888\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874697965\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874698000\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874698034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +634ms\"\n },\n {\n \"at\": \"1789227874698068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -196ms\"\n },\n {\n \"at\": \"1789227874698098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874698125\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874698163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874698191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874698219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698247\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874698303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874698338\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874698365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874698395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874698422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227883623399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00228|connmgr|INFO|br-int<->unix#7: 927 flow_mods in the 7 s starting 10 s ago (843 adds, 83 deletes, 1 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:44:58.111660+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-probe.txt", "router_mac": "10:66:6a:97:88:42", "at": "2026-09-12T15:44:58.112744+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 7903, "ready": true, "ready_signal": "time=\"2026-09-12T08:44:58-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:44:58.195911+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/topology.jsonl", "destroy"], "seconds": 3.708, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:45:01.903887+00:00"} +{"capture": "monitor-delete", "pid": 7903, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.log", "ready_signal": "time=\"2026-09-12T08:44:58-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:45:01.906365+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.08, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:45:01.986612+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.084, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:45:02.070600+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.114, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:97:88:42 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:45:02.185092+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.327, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:97:88:42 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:45:02.511908+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.213, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873753775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84316|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873753922\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84317|bridge|INFO|bridge incusovn16: using datapath ID 00009a579efe0f49\"\n },\n {\n \"at\": \"1789227873753964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84318|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873755158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84319|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873755212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873755237\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873755257\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873755280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873755297\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873755310\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873755396\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873755445\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873755464\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873755505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873755556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755598\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873755612\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84320|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873755628\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873755640\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873755653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873755666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873755683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873755702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873755749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873755761\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755797\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873755817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873755830\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873755869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873755882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873755905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873755924\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873755941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873755966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873755982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84321|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873756003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873756016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873756027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873756048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873756066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873756078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151755ms\"\n },\n {\n \"at\": \"1789227873756117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873756130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873756150\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873756170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873756188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873756204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756222\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873756239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873756253\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873756271\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873756322\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756336\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873756349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873849544\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler265)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873849658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler265)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873849714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873849762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873849809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xa3aaccff your_disc:0x0\"\n },\n {\n \"at\": \"1789227873849850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849883\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873849954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873850025\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151849ms\"\n },\n {\n \"at\": \"1789227873850245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873850289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873850334\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873850380\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873850418\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850452\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873850539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873850573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873850604\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873850634\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873850667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873850711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873850743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873850780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873850814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873850851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873850891\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873850964\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873851015\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151850ms\"\n },\n {\n \"at\": \"1789227873851347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151850ms\"\n },\n {\n \"at\": \"1789227873851450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873851695\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873851727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873851765\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873851804\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873851836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873851878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873851911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873851950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873851986\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873852016\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873852067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873852108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873852146\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84322|dpif|WARN|Dropped 627 log messages in last 247 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227873852177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84324|bridge|WARN|Dropped 54314 log messages in last 273 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227873852269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84325|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873852307\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84327|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873852427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873852468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84329|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873853317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler265)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873853407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler265)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873853474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873853536\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873853581\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x15434add your_disc:0x296246be\"\n },\n {\n \"at\": \"1789227873853617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873853661\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873853697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873853731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873853766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873853809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873853834\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873853864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873853910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +832ms\"\n },\n {\n \"at\": \"1789227873853947\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789227873853976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873854005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873854037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873854070\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873854109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873854210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873854259\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873854289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873854328\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873854354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873854378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873854402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler265)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873854442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873854481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873854526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873854558\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873854592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873854619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873854657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +832ms\"\n },\n {\n \"at\": \"1789227873854693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789227873854967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873855036\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873855073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873855122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855173\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873855201\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873855231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855260\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873855296\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855322\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler265)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873855393\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler265)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873855424\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873855450\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873855473\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x277d8736 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873855503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873855531\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873855554\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873855578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873855616\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873855639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873855657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855689\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855712\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151853ms\"\n },\n {\n \"at\": \"1789227873855734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873855753\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873855771\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873855809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873855864\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873855887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873855909\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873855927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873855950\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873855967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873855990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873856013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873856035\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873856056\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873856073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873856092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873856111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873856133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542151854ms\"\n },\n {\n \"at\": \"1789227873856160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542151854ms\"\n },\n {\n \"at\": \"1789227873856181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873856198\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873856219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873856234\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873856251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856265\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873856302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873856325\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873856339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873856356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873856397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873856420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873856444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84331|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227873856465\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84332|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227873859876\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84333|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227873859992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84334|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789227874139693\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84335|bridge|WARN|Dropped 513 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227874139803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84336|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789227874783907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874784116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874784138\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874784159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874784177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874784196\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874784210\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874784222\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +32ms\"\n },\n {\n \"at\": \"1789227874784246\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -928ms\"\n },\n {\n \"at\": \"1789227874784262\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874784274\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874784295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874784313\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227874784327\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874784366\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874784385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874784402\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227874784419\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874784429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874784444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874820283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874820359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874820386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874820407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874820427\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874820446\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874820461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874820477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +657ms\"\n },\n {\n \"at\": \"1789227874820503\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -143ms\"\n },\n {\n \"at\": \"1789227874820524\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874820534\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874820550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874820560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227874820570\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820579\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874820614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874820624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874820639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227874820652\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874820666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874820676\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874849601\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84337|dpif|WARN|Dropped 1965 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227874849667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227875225028\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84339|bridge|INFO|bridge br-int: added interface vethe8917453 on port 34\"\n },\n {\n \"at\": \"1789227875850136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84340|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227875850324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227876092045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84342|poll_loop|INFO|Dropped 722 log messages in last 250 seconds (most recently, 247 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227876092166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84343|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876092469\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84344|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876093067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876093475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876094184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84347|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876094690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876095158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84349|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876095711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84350|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876096181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84351|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876096671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84352|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)\"\n },\n {\n \"at\": \"1789227876849808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84353|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227876849933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227877849856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84355|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227877850152\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227878849960\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84357|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227878850208\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227879849905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84359|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227879850029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227880849973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84361|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227880850106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227881849613\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84363|dpif|WARN|Dropped 2094 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227881849716\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227882092169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84365|poll_loop|INFO|Dropped 12403 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227882092349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84366|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227882849696\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84367|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227882849796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227883756788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84369|connmgr|INFO|br-int<->unix#7: 893 flow_mods in the 7 s starting 10 s ago (829 adds, 57 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789227883850082\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84370|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227883850155\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227884849858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84372|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227884850102\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84373|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227885849589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84374|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227885849687\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227886849563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84376|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227886849803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227887849833\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84378|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227887850050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227888091593\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84380|poll_loop|INFO|Dropped 12195 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227888091690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84381|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789227888849637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84382|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227888849776\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227889850071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84384|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227889850315\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227890849645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84386|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227890849757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227891849872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84388|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227891850136\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227892849901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84390|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227892850133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227893849869\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84392|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227893850026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84393|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227894092228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84394|poll_loop|INFO|Dropped 12194 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227894092354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84395|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227894849639\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84396|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227894849747\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84397|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227895849744\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84398|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227895849992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84399|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227896849667\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84400|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227896849825\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84401|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227897850009\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84402|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227897850202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84403|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227898849901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84404|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227898849990\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84405|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227898908201\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84406|bridge|INFO|bridge br-int: deleted interface vethe8917453 on port 34\"\n },\n {\n \"at\": \"1789227899849967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84407|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227899850047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84408|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227900091856\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84409|poll_loop|INFO|Dropped 12253 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227900092025\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84410|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789227900849931\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84411|dpif|WARN|Dropped 2073 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789227900850031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84412|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789227901322120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84413|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227901322191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84414|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789227901337237\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789227901340870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84415|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:45:02.727787+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.414, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873737783\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00214|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873738103\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00215|bridge|INFO|bridge incusovn16: using datapath ID 0000c687844de948\"\n },\n {\n \"at\": \"1789227873738311\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00216|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873740647\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873740697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873740712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873740726\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873740737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873740747\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873740763\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740780\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740795\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873740805\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873740818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873740834\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873740845\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873740856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873740866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740875\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873740887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873740899\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873740908\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873740919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740930\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873740941\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873740951\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00218|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873740964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873740974\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873740985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873740995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741014\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741026\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741037\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873741049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873741102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741160\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741169\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873741189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00219|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741201\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741211\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741227\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741274\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741294\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741304\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128740ms\"\n },\n {\n \"at\": \"1789227873741325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741344\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741353\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873741365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741375\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741397\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741409\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741429\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741439\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873743978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler261)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873744016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler261)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873744033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873744048\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873744063\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x296246be your_disc:0x0\"\n },\n {\n \"at\": \"1789227873744076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873744087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873744099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873744109\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744120\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873744132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744143\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744182\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744193\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873744203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873744215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873744236\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873744270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873744287\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873744308\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873744320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873744354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873744365\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873744375\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873744386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744401\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873744412\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873744426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128743ms\"\n },\n {\n \"at\": \"1789227873744446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873744456\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873744466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744476\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227873744486\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744508\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873744520\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873744531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873744541\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227873744552\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744565\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873744576\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873835313\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873835363\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789227873837095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler261)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873837134\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler261)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873837146\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873837156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873837170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xe1085a38 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873837181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873837192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873837203\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873837213\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873837233\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837244\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837266\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837291\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873837301\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873837310\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837321\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873837331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837350\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873837360\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873837370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873837390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873837403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837413\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837421\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873837433\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873837441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873837451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873837459\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873837479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873837488\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591128836ms\"\n },\n {\n \"at\": \"1789227873837506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873837515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873837525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873837542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873837567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873837576\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873837583\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873837593\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837601\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873837609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler261)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873841104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler261)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873841114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873841123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873841131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xbf36e8e3 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873841140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873841149\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873841157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873841166\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873841184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841200\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591128840ms\"\n },\n {\n \"at\": \"1789227873841210\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227873841221\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227873841230\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873841239\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873841248\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841256\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873841264\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873841293\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873841300\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841307\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873841316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873841323\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841331\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841338\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873841346\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873841354\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873841362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873841369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873841385\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873841392\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789227873841403\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789227873841410\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873841418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873841426\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841435\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227873841443\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841451\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841463\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873841472\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873841479\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873841487\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873841496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841504\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873841512\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873842905\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873843010\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00223|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227874672898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874673000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874673029\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874673050\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874673073\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874673102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874673124\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874673147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +158ms\"\n },\n {\n \"at\": \"1789227874673170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -832ms\"\n },\n {\n \"at\": \"1789227874673192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874673214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874673243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874673273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x15434add\"\n },\n {\n \"at\": \"1789227874673292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874673355\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874673379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874673408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x296246be\"\n },\n {\n \"at\": \"1789227874673428\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874673450\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874673469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874758219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874758471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874758495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874758517\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874758543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874758567\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874758589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874758608\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +843ms\"\n },\n {\n \"at\": \"1789227874758627\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -87ms\"\n },\n {\n \"at\": \"1789227874758651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874758674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874758696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874758717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227874758739\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758760\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758781\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874758800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874758821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874758840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227874758859\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874758880\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874758902\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874761753\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874761808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874761819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874761828\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874761837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874761847\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874761856\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874761864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +510ms\"\n },\n {\n \"at\": \"1789227874761876\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -250ms\"\n },\n {\n \"at\": \"1789227874761887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874761896\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874761907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874761916\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874761924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761933\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761942\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874761951\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874761959\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874761969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874761978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874761986\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874761995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227883742689\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00224|connmgr|INFO|br-int<->unix#7: 913 flow_mods in the 7 s starting 10 s ago (845 adds, 68 deletes)\"\n },\n {\n \"at\": \"1789227901311503\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00225|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227901311766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00226|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227901311800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227901334162\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00228|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20\"\n },\n {\n \"at\": \"1789227901334320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:45:03.142198+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.168, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873738760\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00236|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873738935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000066e755c19444\"\n },\n {\n \"at\": \"1789227873738964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00238|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873741335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00239|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741422\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741444\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741495\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741539\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028739ms\"\n },\n {\n \"at\": \"1789227873741556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741571\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741604\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873741621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741653\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741670\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873741719\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873741768\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873749097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00240|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873749159\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873749174\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873749185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873749195\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873749206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873749217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749251\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873749262\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749273\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749282\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227873749294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873749305\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873749326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749345\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873749356\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749378\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873749389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00241|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873749403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873749415\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873749424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873749435\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873749445\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873749456\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749465\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50028747ms\"\n },\n {\n \"at\": \"1789227873749486\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873749497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749506\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873749532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873749543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749552\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873749563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873749578\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873749587\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873749598\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873749620\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873836271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00242|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873836530\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00243|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789227873843804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00244|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873843888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00245|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31\"\n },\n {\n \"at\": \"1789227873844239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler265)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873844326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler265)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873844365\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873844400\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873844424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x57037ae4 your_disc:0x277d8736\"\n },\n {\n \"at\": \"1789227873844448\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873844476\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873844499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873844523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873844545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873844568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873844596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873844622\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50028842ms\"\n },\n {\n \"at\": \"1789227873844647\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +927ms\"\n },\n {\n \"at\": \"1789227873844678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227873844703\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873844725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873844753\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873844781\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873844804\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844826\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873844875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873844898\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873844922\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873844946\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873844971\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873844993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873845020\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler265)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873845044\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873845079\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873845102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873845124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873845144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873845165\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873845189\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +927ms\"\n },\n {\n \"at\": \"1789227873845212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789227873845235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873845297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873845320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873845344\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x277d8736\"\n },\n {\n \"at\": \"1789227873845366\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845386\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873845429\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873845450\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873845472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x57037ae4\"\n },\n {\n \"at\": \"1789227873845493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845519\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873845541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874496814\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler272)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227874496927\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler272)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227874496968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227874497006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227874497031\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xbeb6ee15 your_disc:0x42213715\"\n },\n {\n \"at\": \"1789227874497058\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874497098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874497124\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227874497151\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497181\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874497208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50029494ms\"\n },\n {\n \"at\": \"1789227874497286\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +195ms\"\n },\n {\n \"at\": \"1789227874497315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -755ms\"\n },\n {\n \"at\": \"1789227874497338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874497362\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874497384\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497407\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874497436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497466\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874497523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874497545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497569\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874497594\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227874497617\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874497645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497666\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler272)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874497695\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874497724\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874497747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874497771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497794\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874497818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874497841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +195ms\"\n },\n {\n \"at\": \"1789227874497866\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -755ms\"\n },\n {\n \"at\": \"1789227874497890\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874497920\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874497944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874497972\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874497999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874498087\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874498114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874498138\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874498162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874498212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874512379\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler272)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227874512490\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler272)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227874512532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227874512561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227874512586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x323b8422 your_disc:0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874512614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874512644\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227874512675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227874512701\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874512727\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874512758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874512786\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874512810\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50029510ms\"\n },\n {\n \"at\": \"1789227874512838\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +249ms\"\n },\n {\n \"at\": \"1789227874512862\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -671ms\"\n },\n {\n \"at\": \"1789227874512888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874512911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874512935\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874512958\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874512983\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874513057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874513090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513126\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874513152\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227874513172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513195\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874513220\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler272)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874513247\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874513271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874513292\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874513313\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874513335\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874513358\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874513389\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +249ms\"\n },\n {\n \"at\": \"1789227874513410\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -671ms\"\n },\n {\n \"at\": \"1789227874513469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874513499\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227874513523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513546\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbf36e8e3\"\n },\n {\n \"at\": \"1789227874513568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513591\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513616\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874513639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227874513659\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874513682\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x323b8422\"\n },\n {\n \"at\": \"1789227874513704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874513748\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227876199497\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge br-int: added interface veth3e3d489f on port 32\"\n },\n {\n \"at\": \"1789227883744374\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00247|connmgr|INFO|br-int<->unix#7: 886 flow_mods in the 7 s starting 10 s ago (825 adds, 53 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789227899951589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00248|bridge|INFO|bridge br-int: deleted interface veth3e3d489f on port 32\"\n },\n {\n \"at\": \"1789227901309821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00249|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227901309983\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00250|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227901310012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00251|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227901342570\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789227901347002\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00252|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:45:03.310633+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A44%3A31.206854%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.169, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789227873618063\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227873618214\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 00001e098d56774c\"\n },\n {\n \"at\": \"1789227873618232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00220|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789227873715222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227873715390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789227873722901\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00223|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227873723034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00224|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789227873741657\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00225|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873741688\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873741713\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873741735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873741750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873741767\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873741784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741801\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255605ms\"\n },\n {\n \"at\": \"1789227873741833\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873741850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741882\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873741899\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873741929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873741945\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873741963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873741978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873741995\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873742011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873742030\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873742045\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873742061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789227873746586\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler273)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873746610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler273)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873746628\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789227873746651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873746705\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x42213715 your_disc:0x0\"\n },\n {\n \"at\": \"1789227873746728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873746751\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873746766\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873746781\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873746795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873746810\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873746824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873746850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255610ms\"\n },\n {\n \"at\": \"1789227873746866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +755ms\"\n },\n {\n \"at\": \"1789227873746883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227873746905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873746922\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873746940\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873746955\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873746975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873746996\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747020\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873747063\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747084\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873747108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747130\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747151\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747205\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747258\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747301\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747315\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873747334\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +755ms\"\n },\n {\n \"at\": \"1789227873747348\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789227873747365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873747383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873747398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747412\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227873747426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747461\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789227873747490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747504\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227873747519\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747538\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747583\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747600\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747614\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873747658\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747672\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873747708\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873747722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873747735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873747765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873747780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873747809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873747823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873747838\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873747853\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873747886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873747900\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00227|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873747919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873747935\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873747948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873747962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873747978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789227873747993\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748008\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748023\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591255611ms\"\n },\n {\n \"at\": \"1789227873748037\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873748052\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789227873748066\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873748080\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873748096\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873748110\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873748141\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789227873748158\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873748173\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789227873748193\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873748222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789227873846849\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler273)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873847004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler273)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873847026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873847049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873847065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xff024ef1 your_disc:0xe1085a38\"\n },\n {\n \"at\": \"1789227873847083\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873847098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873847114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873847135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873847165\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847196\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255710ms\"\n },\n {\n \"at\": \"1789227873847211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +816ms\"\n },\n {\n \"at\": \"1789227873847228\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227873847255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873847269\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873847282\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847296\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873847311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847328\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873847360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873847379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873847411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873847426\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler273)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873847474\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873847489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873847503\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873847517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847531\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873847545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873847560\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +816ms\"\n },\n {\n \"at\": \"1789227873847575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -4ms\"\n },\n {\n \"at\": \"1789227873847589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873847604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873847619\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847634\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xe1085a38\"\n },\n {\n \"at\": \"1789227873847649\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847676\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873847691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873847704\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873847719\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xff024ef1\"\n },\n {\n \"at\": \"1789227873847733\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847755\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873847770\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849210\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler273)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789227873849345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler273)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789227873849365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789227873849376\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789227873849387\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x33a33fab your_disc:0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789227873849418\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789227873849432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873849454\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849475\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591255713ms\"\n },\n {\n \"at\": \"1789227873849488\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +963ms\"\n },\n {\n \"at\": \"1789227873849500\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227873849515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873849525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873849536\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849581\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873849592\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873849602\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873849629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789227873849639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849661\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler273)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227873849674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227873849685\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227873849698\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227873849709\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849718\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227873849737\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227873849747\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +963ms\"\n },\n {\n \"at\": \"1789227873849758\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -7ms\"\n },\n {\n \"at\": \"1789227873849768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227873849780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789227873849791\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849801\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xa3aaccff\"\n },\n {\n \"at\": \"1789227873849811\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849821\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227873849841\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789227873849854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227873849887\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x33a33fab\"\n },\n {\n \"at\": \"1789227873849907\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849939\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227873849948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874697395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789227874697803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789227874697827\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227874697853\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789227874697888\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874697965\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789227874698000\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789227874698034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +634ms\"\n },\n {\n \"at\": \"1789227874698068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -196ms\"\n },\n {\n \"at\": \"1789227874698098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789227874698125\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789227874698163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874698191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xbeb6ee15\"\n },\n {\n \"at\": \"1789227874698219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698247\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789227874698303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789227874698338\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789227874698365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x42213715\"\n },\n {\n \"at\": \"1789227874698395\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789227874698422\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789227874698451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789227883623399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00228|connmgr|INFO|br-int<->unix#7: 927 flow_mods in the 7 s starting 10 s ago (843 adds, 83 deletes, 1 modifications)\"\n },\n {\n \"at\": \"1789227901323039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789227901432424\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00229|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789227901432624\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00230|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789227901432660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00231|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789227901456634\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00232|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:45:03.480252+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T15:45:03.480866+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/create.stdout.json new file mode 100644 index 0000000..d5b6264 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.591, + "first_cross_member_ping_seconds": 3.697, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/cycle.json new file mode 100644 index 0000000..a6b2485 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T15:44:31.206854+00:00", + "ended_at": "2026-09-12T15:45:03.480952+00:00", + "seconds": 32.274, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:97:88:42", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.591, + "first_cross_member_ping_seconds": 3.697, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.086 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.086 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\"volatile.eth0.host_name\":\"vethe8917453\",\"volatile.eth0.hwaddr\":\"10:66:6a:3d:55:e6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\"volatile.uuid.generation\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:44:34.604286256Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\"volatile.eth0.host_name\":\"vethe8917453\",\"volatile.eth0.hwaddr\":\"10:66:6a:3d:55:e6\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\"volatile.uuid.generation\":\"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:44:35.453504088Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9863168,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe3d:55e6\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:3d:55:e6\",\"host_name\":\"vethe8917453\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4177784,\"processes\":4,\"cpu\":{\"usage\":525974000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:44:34.470000028Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ff0468-0864-413e-89cc-3fc5368af7e0\",\"volatile.eth0.host_name\":\"veth3e3d489f\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:c1:d4\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\",\"volatile.uuid.generation\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:44:35.69990885Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ff0468-0864-413e-89cc-3fc5368af7e0\",\"volatile.eth0.host_name\":\"veth3e3d489f\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:c1:d4\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\",\"volatile.uuid.generation\":\"2e740595-2f8a-44dc-853a-ff4b7c226485\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:44:36.279137454Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11436032,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe02:c1d4\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:02:c1:d4\",\"host_name\":\"veth3e3d489f\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":35431,\"processes\":4,\"cpu\":{\"usage\":508698000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:44:36.289999961Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.359 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.243 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.220 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.029 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.907 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.318 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.318/0.751/1.029 ms\nelapsed_seconds=2.292 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.132 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.826 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.468 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.468/0.808/1.132 ms\nelapsed_seconds=2.253 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.051 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.456 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.732 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.732/1.413/2.051 ms\nelapsed_seconds=2.329 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.879 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.331 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.857 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.857/1.355/1.879 ms\nelapsed_seconds=2.327 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nelapsed_seconds=0.423 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.237 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.376 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.316 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.025 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.198354 bytes_per_second=504149147\nelapsed_seconds=0.433 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.503 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.120895 bytes_per_second=827164067\nelapsed_seconds=0.350 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.508 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 6068, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.log", + "bytes": 175671, + "ready_signal": "time=\"2026-09-12T08:44:31-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:44:31.811156+00:00", + "stopped_at": "2026-09-12T15:44:40.806950+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 6600, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T15:44:42.273075+00:00", + "stopped_at": "2026-09-12T15:44:56.802661+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 7903, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.log", + "bytes": 40434, + "ready_signal": "time=\"2026-09-12T08:44:58-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:44:58.113316+00:00", + "stopped_at": "2026-09-12T15:45:01.905991+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-probe.txt new file mode 100644 index 0000000..2743ae4 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-probe.txt @@ -0,0 +1,5701 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:3d:55:e6 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:02:c1:d4 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch c601fdcd-bf61-4321-aff9-ac4cbff4de3a (incus-net35-ls-ext) + port incus-net35-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net35-ls-ext-lsp-router + type: router + router-port: incus-net35-lr-lrp-ext +switch d1459ccf-1f95-4363-b19a-409fa9de431e (incus-net35-ls-int) + port incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0 + addresses: ["10:66:6a:02:c1:d4 dynamic"] + port incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0 + addresses: ["10:66:6a:3d:55:e6 dynamic"] + port incus-net35-ls-int-lsp-router + type: router + router-port: incus-net35-lr-lrp-int +router 32d5651d-981e-4e16-bb5c-68e374be097f (incus-net35-lr) + port incus-net35-lr-lrp-ext + mac: "10:66:6a:97:88:42" + ipv6-lla: "fe80::1266:6aff:fe97:8842" + networks: ["10.10.40.64/24"] + port incus-net35-lr-lrp-int + mac: "10:66:6a:97:88:42" + ipv6-lla: "fe80::1266:6aff:fe97:8842" + networks: ["10.253.73.1/24"] + nat c214de1b-a159-4a64-b0a9-f4c6a19f2767 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net35-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : bdd30abd-df43-4485-a81d-94ba968e7d2b +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:97:88:42" +name : incus-net35-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 9a0ddff7-cb8a-4193-9a4a-9d24b5e6eec8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 24073851-46ac-4583-85ec-51ea82f837d7 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:97:88:42" +name : incus-net35-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 6e985934-0679-400b-bc2f-0008abc6afda +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : 2f43d3a3-036c-4734-8f3c-1ba4a4dc22ec +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c81f3409-dc9d-4972-9594-2b864d3d35fd +logical_port : cr-incus-net35-lr-lrp-ext +mac : ["10:66:6a:97:88:42 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net35-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:97:88:42 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:97:88:42 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873753775", + "member": "lab01.glab.lol", + "message": "ovs|84316|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873753922", + "member": "lab01.glab.lol", + "message": "ovs|84317|bridge|INFO|bridge incusovn16: using datapath ID 00009a579efe0f49" + }, + { + "at": "1789227873753964", + "member": "lab01.glab.lol", + "message": "ovs|84318|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873755158", + "member": "lab01.glab.lol", + "message": "ovs|84319|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873755212", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873755237", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873755257", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873755280", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873755297", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873755310", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873755330", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873755350", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873755376", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873755396", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873755410", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755427", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873755445", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873755464", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755483", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873755505", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873755521", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755544", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873755556", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873755579", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755598", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873755612", + "member": "lab01.glab.lol", + "message": "ovs|84320|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873755628", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873755640", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873755653", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873755666", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873755683", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873755702", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873755715", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873755729", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873755749", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873755761", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873755779", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755797", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873755817", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873755830", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755850", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873755869", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873755882", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873755905", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755924", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873755941", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873755952", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755966", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873755982", + "member": "lab01.glab.lol", + "message": "ovs|84321|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873756003", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873756016", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873756027", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873756048", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873756066", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873756078", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873756092", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873756105", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873756117", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873756130", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873756150", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873756170", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873756188", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873756204", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873756222", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873756239", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873756253", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873756271", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873756322", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873756336", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873756349", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873849544", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler265)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873849658", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler265)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227873849714", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873849762", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873849809", + "member": "lab01.glab.lol", + "message": " my_disc:0xa3aaccff your_disc:0x0" + }, + { + "at": "1789227873849850", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873849883", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873849912", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873849954", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849984", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873850025", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873850065", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873850109", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151849ms" + }, + { + "at": "1789227873850159", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151849ms" + }, + { + "at": "1789227873850202", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151849ms" + }, + { + "at": "1789227873850245", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873850289", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873850334", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873850380", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873850418", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873850452", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873850497", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873850539", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873850573", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873850604", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873850634", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873850667", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873850711", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873850743", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873850780", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873850814", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873850851", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873850891", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873850923", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873850964", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873851015", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151850ms" + }, + { + "at": "1789227873851347", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151850ms" + }, + { + "at": "1789227873851450", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873851695", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873851727", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873851765", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873851804", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873851836", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873851878", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873851911", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873851950", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873851986", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873852016", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873852067", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873852108", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873852146", + "member": "lab01.glab.lol", + "message": "ovs|84322|dpif|WARN|Dropped 627 log messages in last 247 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227873852177", + "member": "lab01.glab.lol", + "message": "ovs|84323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852228", + "member": "lab01.glab.lol", + "message": "ovs|84324|bridge|WARN|Dropped 54314 log messages in last 273 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227873852269", + "member": "lab01.glab.lol", + "message": "ovs|84325|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873852307", + "member": "lab01.glab.lol", + "message": "ovs|84326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852349", + "member": "lab01.glab.lol", + "message": "ovs|84327|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873852427", + "member": "lab01.glab.lol", + "message": "ovs|84328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852468", + "member": "lab01.glab.lol", + "message": "ovs|84329|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873853317", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler265)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873853407", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler265)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227873853474", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873853536", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873853581", + "member": "lab01.glab.lol", + "message": " my_disc:0x15434add your_disc:0x296246be" + }, + { + "at": "1789227873853617", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873853661", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873853697", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873853731", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873853766", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873853809", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873853834", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873853864", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151853ms" + }, + { + "at": "1789227873853910", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +832ms" + }, + { + "at": "1789227873853947", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789227873853976", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873854005", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873854037", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873854070", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873854109", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873854148", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873854183", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873854210", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873854259", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873854289", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x15434add" + }, + { + "at": "1789227873854328", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873854354", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873854378", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873854402", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler265)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873854442", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873854481", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873854526", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873854558", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873854592", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873854619", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873854657", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +832ms" + }, + { + "at": "1789227873854693", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789227873854967", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873855036", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873855073", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855100", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873855122", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855143", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855173", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873855201", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873855231", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855260", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x15434add" + }, + { + "at": "1789227873855296", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855322", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855347", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873855363", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler265)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873855393", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler265)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873855424", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873855450", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873855473", + "member": "lab01.glab.lol", + "message": " my_disc:0x277d8736 your_disc:0x0" + }, + { + "at": "1789227873855503", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873855531", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873855554", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873855578", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873855601", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873855616", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873855639", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873855657", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151853ms" + }, + { + "at": "1789227873855689", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151853ms" + }, + { + "at": "1789227873855712", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151853ms" + }, + { + "at": "1789227873855734", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873855753", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873855771", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855788", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873855809", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855827", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855849", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873855864", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873855887", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855909", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227873855927", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873855950", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855967", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873855990", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873856013", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873856035", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873856056", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873856073", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873856092", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873856111", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873856133", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151854ms" + }, + { + "at": "1789227873856160", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151854ms" + }, + { + "at": "1789227873856181", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873856198", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873856219", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873856234", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873856251", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873856265", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873856279", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873856302", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873856325", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873856339", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227873856356", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873856378", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873856397", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873856420", + "member": "lab01.glab.lol", + "message": "ovs|84330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873856444", + "member": "lab01.glab.lol", + "message": "ovs|84331|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873856465", + "member": "lab01.glab.lol", + "message": "ovs|84332|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873859876", + "member": "lab01.glab.lol", + "message": "ovs|84333|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227873859992", + "member": "lab01.glab.lol", + "message": "ovs|84334|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789227874139693", + "member": "lab01.glab.lol", + "message": "ovs|84335|bridge|WARN|Dropped 513 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227874139803", + "member": "lab01.glab.lol", + "message": "ovs|84336|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227874783907", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874784116", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874784138", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874784159", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874784177", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874784196", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874784210", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874784222", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +32ms" + }, + { + "at": "1789227874784246", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -928ms" + }, + { + "at": "1789227874784262", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874784274", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874784295", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874784313", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227874784327", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874784339", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874784355", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874784366", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874784385", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874784402", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227874784419", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874784429", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874784444", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874820283", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874820359", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874820386", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874820407", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874820427", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874820446", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874820461", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874820477", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +657ms" + }, + { + "at": "1789227874820503", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -143ms" + }, + { + "at": "1789227874820524", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874820534", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874820550", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874820560", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227874820570", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874820579", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874820601", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874820614", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874820624", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874820639", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227874820652", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874820666", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874820676", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874849601", + "member": "lab01.glab.lol", + "message": "ovs|84337|dpif|WARN|Dropped 1965 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227874849667", + "member": "lab01.glab.lol", + "message": "ovs|84338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227875225028", + "member": "lab01.glab.lol", + "message": "ovs|84339|bridge|INFO|bridge br-int: added interface vethe8917453 on port 34" + }, + { + "at": "1789227875850136", + "member": "lab01.glab.lol", + "message": "ovs|84340|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227875850324", + "member": "lab01.glab.lol", + "message": "ovs|84341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227876092045", + "member": "lab01.glab.lol", + "message": "ovs|84342|poll_loop|INFO|Dropped 722 log messages in last 250 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227876092166", + "member": "lab01.glab.lol", + "message": "ovs|84343|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876092469", + "member": "lab01.glab.lol", + "message": "ovs|84344|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876093067", + "member": "lab01.glab.lol", + "message": "ovs|84345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876093475", + "member": "lab01.glab.lol", + "message": "ovs|84346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876094184", + "member": "lab01.glab.lol", + "message": "ovs|84347|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876094690", + "member": "lab01.glab.lol", + "message": "ovs|84348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876095158", + "member": "lab01.glab.lol", + "message": "ovs|84349|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876095711", + "member": "lab01.glab.lol", + "message": "ovs|84350|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876096181", + "member": "lab01.glab.lol", + "message": "ovs|84351|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876096671", + "member": "lab01.glab.lol", + "message": "ovs|84352|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876849808", + "member": "lab01.glab.lol", + "message": "ovs|84353|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227876849933", + "member": "lab01.glab.lol", + "message": "ovs|84354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227877849856", + "member": "lab01.glab.lol", + "message": "ovs|84355|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227877850152", + "member": "lab01.glab.lol", + "message": "ovs|84356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227878849960", + "member": "lab01.glab.lol", + "message": "ovs|84357|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227878850208", + "member": "lab01.glab.lol", + "message": "ovs|84358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227879849905", + "member": "lab01.glab.lol", + "message": "ovs|84359|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227879850029", + "member": "lab01.glab.lol", + "message": "ovs|84360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227880849973", + "member": "lab01.glab.lol", + "message": "ovs|84361|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227880850106", + "member": "lab01.glab.lol", + "message": "ovs|84362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227881849613", + "member": "lab01.glab.lol", + "message": "ovs|84363|dpif|WARN|Dropped 2094 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227881849716", + "member": "lab01.glab.lol", + "message": "ovs|84364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227882092169", + "member": "lab01.glab.lol", + "message": "ovs|84365|poll_loop|INFO|Dropped 12403 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227882092349", + "member": "lab01.glab.lol", + "message": "ovs|84366|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227882849696", + "member": "lab01.glab.lol", + "message": "ovs|84367|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227882849796", + "member": "lab01.glab.lol", + "message": "ovs|84368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227883756788", + "member": "lab01.glab.lol", + "message": "ovs|84369|connmgr|INFO|br-int<->unix#7: 893 flow_mods in the 7 s starting 10 s ago (829 adds, 57 deletes, 7 modifications)" + }, + { + "at": "1789227883850082", + "member": "lab01.glab.lol", + "message": "ovs|84370|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227883850155", + "member": "lab01.glab.lol", + "message": "ovs|84371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227884849858", + "member": "lab01.glab.lol", + "message": "ovs|84372|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227884850102", + "member": "lab01.glab.lol", + "message": "ovs|84373|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227885849589", + "member": "lab01.glab.lol", + "message": "ovs|84374|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227885849687", + "member": "lab01.glab.lol", + "message": "ovs|84375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227886849563", + "member": "lab01.glab.lol", + "message": "ovs|84376|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227886849803", + "member": "lab01.glab.lol", + "message": "ovs|84377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227887849833", + "member": "lab01.glab.lol", + "message": "ovs|84378|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227887850050", + "member": "lab01.glab.lol", + "message": "ovs|84379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227888091593", + "member": "lab01.glab.lol", + "message": "ovs|84380|poll_loop|INFO|Dropped 12195 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227888091690", + "member": "lab01.glab.lol", + "message": "ovs|84381|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227888849637", + "member": "lab01.glab.lol", + "message": "ovs|84382|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227888849776", + "member": "lab01.glab.lol", + "message": "ovs|84383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227889850071", + "member": "lab01.glab.lol", + "message": "ovs|84384|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227889850315", + "member": "lab01.glab.lol", + "message": "ovs|84385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227890849645", + "member": "lab01.glab.lol", + "message": "ovs|84386|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227890849757", + "member": "lab01.glab.lol", + "message": "ovs|84387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227891849872", + "member": "lab01.glab.lol", + "message": "ovs|84388|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227891850136", + "member": "lab01.glab.lol", + "message": "ovs|84389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227892849901", + "member": "lab01.glab.lol", + "message": "ovs|84390|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227892850133", + "member": "lab01.glab.lol", + "message": "ovs|84391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227893849869", + "member": "lab01.glab.lol", + "message": "ovs|84392|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227893850026", + "member": "lab01.glab.lol", + "message": "ovs|84393|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227894092228", + "member": "lab01.glab.lol", + "message": "ovs|84394|poll_loop|INFO|Dropped 12194 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227894092354", + "member": "lab01.glab.lol", + "message": "ovs|84395|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227894849639", + "member": "lab01.glab.lol", + "message": "ovs|84396|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227894849747", + "member": "lab01.glab.lol", + "message": "ovs|84397|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227895849744", + "member": "lab01.glab.lol", + "message": "ovs|84398|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227895849992", + "member": "lab01.glab.lol", + "message": "ovs|84399|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227896849667", + "member": "lab01.glab.lol", + "message": "ovs|84400|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227896849825", + "member": "lab01.glab.lol", + "message": "ovs|84401|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873737783", + "member": "lab02.glab.lol", + "message": "ovs|00214|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873738103", + "member": "lab02.glab.lol", + "message": "ovs|00215|bridge|INFO|bridge incusovn16: using datapath ID 0000c687844de948" + }, + { + "at": "1789227873738311", + "member": "lab02.glab.lol", + "message": "ovs|00216|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873740647", + "member": "lab02.glab.lol", + "message": "ovs|00217|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873740697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873740712", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873740726", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873740737", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873740747", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873740763", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873740780", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873740795", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873740805", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873740818", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873740834", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873740845", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873740856", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873740866", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873740875", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873740887", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873740899", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873740908", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873740919", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873740930", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873740941", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873740951", + "member": "lab02.glab.lol", + "message": "ovs|00218|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873740964", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873740974", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873740985", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873740995", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741004", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741014", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873741026", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873741037", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873741049", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873741059", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741069", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741080", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741091", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873741102", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741111", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741121", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741131", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741140", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741150", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741160", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741169", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741179", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873741189", + "member": "lab02.glab.lol", + "message": "ovs|00219|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741201", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741211", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741227", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741274", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741284", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741294", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873741304", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873741315", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873741325", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741334", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741344", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741353", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873741365", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741375", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741386", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741397", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741409", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741420", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741429", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741439", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741449", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873743978", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler261)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873744016", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler261)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873744033", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873744048", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873744063", + "member": "lab02.glab.lol", + "message": " my_disc:0x296246be your_disc:0x0" + }, + { + "at": "1789227873744076", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873744087", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873744099", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873744109", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873744120", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873744132", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873744143", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873744157", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128743ms" + }, + { + "at": "1789227873744170", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128743ms" + }, + { + "at": "1789227873744182", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128743ms" + }, + { + "at": "1789227873744193", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873744203", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873744215", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744226", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873744236", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744247", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744259", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873744270", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873744287", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744297", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227873744308", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873744320", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744331", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873744342", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873744354", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873744365", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873744375", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873744386", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873744401", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873744412", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873744426", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128743ms" + }, + { + "at": "1789227873744436", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128743ms" + }, + { + "at": "1789227873744446", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873744456", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873744466", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744476", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873744486", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744497", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744508", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873744520", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873744531", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744541", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227873744552", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744565", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744576", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873835313", + "member": "lab02.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873835363", + "member": "lab02.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227873837095", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler261)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873837134", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler261)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227873837146", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873837156", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873837170", + "member": "lab02.glab.lol", + "message": " my_disc:0xe1085a38 your_disc:0x0" + }, + { + "at": "1789227873837181", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873837192", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873837203", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873837213", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873837222", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873837233", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873837244", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873837256", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128836ms" + }, + { + "at": "1789227873837266", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128836ms" + }, + { + "at": "1789227873837277", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128836ms" + }, + { + "at": "1789227873837291", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873837301", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873837310", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837321", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873837331", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837341", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837350", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873837360", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873837370", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837380", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227873837390", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873837403", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837413", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873837421", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873837433", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873837441", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873837451", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873837459", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873837469", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873837479", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873837488", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128836ms" + }, + { + "at": "1789227873837497", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128836ms" + }, + { + "at": "1789227873837506", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873837515", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873837525", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837533", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873837542", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837551", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837559", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873837567", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873837576", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837583", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227873837593", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837601", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837609", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873841091", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler261)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873841104", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler261)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873841114", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873841123", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873841131", + "member": "lab02.glab.lol", + "message": " my_disc:0xbf36e8e3 your_disc:0x0" + }, + { + "at": "1789227873841140", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873841149", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873841157", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873841166", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873841175", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873841184", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873841192", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873841200", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128840ms" + }, + { + "at": "1789227873841210", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227873841221", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227873841230", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873841239", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873841248", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841256", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873841264", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841273", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841285", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873841293", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873841300", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841307", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873841316", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873841323", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841331", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873841338", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873841346", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873841354", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873841362", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873841369", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873841377", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873841385", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873841392", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227873841403", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227873841410", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873841418", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873841426", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841435", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873841443", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841451", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841463", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873841472", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873841479", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841487", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873841496", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841504", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841512", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873842905", + "member": "lab02.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873843010", + "member": "lab02.glab.lol", + "message": "ovs|00223|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227874672898", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874673000", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874673029", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874673050", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874673073", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874673102", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874673124", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874673147", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +158ms" + }, + { + "at": "1789227874673170", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -832ms" + }, + { + "at": "1789227874673192", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874673214", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874673243", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874673273", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227874673292", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874673314", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874673334", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874673355", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874673379", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874673408", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227874673428", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874673450", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874673469", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874758219", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874758471", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874758495", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874758517", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874758543", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874758567", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874758589", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874758608", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227874758627", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -87ms" + }, + { + "at": "1789227874758651", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874758674", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874758696", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874758717", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227874758739", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874758760", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874758781", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874758800", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874758821", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874758840", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227874758859", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874758880", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874758902", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874761753", + "member": "lab02.glab.lol", + "message": "ovs|00012|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874761808", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874761819", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874761828", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874761837", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874761847", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874761856", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874761864", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +510ms" + }, + { + "at": "1789227874761876", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -250ms" + }, + { + "at": "1789227874761887", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874761896", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874761907", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874761916", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227874761924", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874761933", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874761942", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874761951", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874761959", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874761969", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874761978", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874761986", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874761995", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227883742689", + "member": "lab02.glab.lol", + "message": "ovs|00224|connmgr|INFO|br-int<->unix#7: 913 flow_mods in the 7 s starting 10 s ago (845 adds, 68 deletes)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873738760", + "member": "lab03.glab.lol", + "message": "ovs|00236|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873738935", + "member": "lab03.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000066e755c19444" + }, + { + "at": "1789227873738964", + "member": "lab03.glab.lol", + "message": "ovs|00238|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873741335", + "member": "lab03.glab.lol", + "message": "ovs|00239|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741398", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741422", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741444", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741461", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741477", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741495", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028739ms" + }, + { + "at": "1789227873741515", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028739ms" + }, + { + "at": "1789227873741539", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028739ms" + }, + { + "at": "1789227873741556", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741571", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741587", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741604", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227873741621", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741634", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741653", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741670", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741686", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741702", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741719", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741736", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741751", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873741768", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873749097", + "member": "lab03.glab.lol", + "message": "ovs|00240|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873749159", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873749174", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873749185", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873749195", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873749206", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873749217", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028747ms" + }, + { + "at": "1789227873749228", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028747ms" + }, + { + "at": "1789227873749239", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028747ms" + }, + { + "at": "1789227873749251", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873749262", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873749273", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749282", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873749294", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873749305", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749315", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873749326", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873749335", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749345", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873749356", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873749368", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749378", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873749389", + "member": "lab03.glab.lol", + "message": "ovs|00241|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873749403", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873749415", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873749424", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873749435", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873749445", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873749456", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028747ms" + }, + { + "at": "1789227873749465", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028747ms" + }, + { + "at": "1789227873749475", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028747ms" + }, + { + "at": "1789227873749486", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873749497", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873749506", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749516", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873749532", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873749543", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749552", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873749563", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873749578", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749587", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873749598", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873749610", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749620", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873836271", + "member": "lab03.glab.lol", + "message": "ovs|00242|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873836530", + "member": "lab03.glab.lol", + "message": "ovs|00243|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227873843804", + "member": "lab03.glab.lol", + "message": "ovs|00244|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873843888", + "member": "lab03.glab.lol", + "message": "ovs|00245|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227873844239", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler265)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873844326", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler265)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873844365", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873844400", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873844424", + "member": "lab03.glab.lol", + "message": " my_disc:0x57037ae4 your_disc:0x277d8736" + }, + { + "at": "1789227873844448", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873844476", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873844499", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873844523", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873844545", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873844568", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873844596", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873844622", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028842ms" + }, + { + "at": "1789227873844647", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +927ms" + }, + { + "at": "1789227873844678", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227873844703", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873844725", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873844753", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873844781", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873844804", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873844826", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873844853", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873844875", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873844898", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873844922", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x57037ae4" + }, + { + "at": "1789227873844946", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873844971", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873844993", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873845020", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler265)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873845044", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873845079", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873845102", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873845124", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873845144", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873845165", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873845189", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +927ms" + }, + { + "at": "1789227873845212", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227873845235", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873845297", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873845320", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873845344", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873845366", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873845386", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873845407", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873845429", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873845450", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873845472", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x57037ae4" + }, + { + "at": "1789227873845493", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873845519", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873845541", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874496814", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler272)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227874496927", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler272)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227874496968", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227874497006", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227874497031", + "member": "lab03.glab.lol", + "message": " my_disc:0xbeb6ee15 your_disc:0x42213715" + }, + { + "at": "1789227874497058", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227874497098", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227874497124", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227874497151", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874497181", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874497208", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874497231", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874497260", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50029494ms" + }, + { + "at": "1789227874497286", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +195ms" + }, + { + "at": "1789227874497315", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -755ms" + }, + { + "at": "1789227874497338", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874497362", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874497384", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497407", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227874497436", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874497466", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874497497", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874497523", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874497545", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497569", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874497594", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227874497617", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874497645", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874497666", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler272)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874497695", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874497724", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874497747", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874497771", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874497794", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874497818", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874497841", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +195ms" + }, + { + "at": "1789227874497866", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -755ms" + }, + { + "at": "1789227874497890", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874497920", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874497944", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497972", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227874497999", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874498021", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874498045", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874498087", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874498114", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874498138", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874498162", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874498187", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874498212", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874512379", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler272)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227874512490", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler272)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227874512532", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227874512561", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227874512586", + "member": "lab03.glab.lol", + "message": " my_disc:0x323b8422 your_disc:0xbf36e8e3" + }, + { + "at": "1789227874512614", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227874512644", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227874512675", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227874512701", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874512727", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874512758", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874512786", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874512810", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50029510ms" + }, + { + "at": "1789227874512838", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +249ms" + }, + { + "at": "1789227874512862", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -671ms" + }, + { + "at": "1789227874512888", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874512911", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874512935", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874512958", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874512983", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513009", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513036", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874513057", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874513090", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513126", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x323b8422" + }, + { + "at": "1789227874513152", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227874513172", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513195", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874513220", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler272)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874513247", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874513271", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874513292", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874513313", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874513335", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874513358", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874513389", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +249ms" + }, + { + "at": "1789227874513410", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -671ms" + }, + { + "at": "1789227874513469", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874513499", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874513523", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513546", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874513568", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513591", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513616", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874513639", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874513659", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513682", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x323b8422" + }, + { + "at": "1789227874513704", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513725", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513748", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227876199497", + "member": "lab03.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge br-int: added interface veth3e3d489f on port 32" + }, + { + "at": "1789227883744374", + "member": "lab03.glab.lol", + "message": "ovs|00247|connmgr|INFO|br-int<->unix#7: 886 flow_mods in the 7 s starting 10 s ago (825 adds, 53 deletes, 8 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873618063", + "member": "nas01.glab.lol", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873618214", + "member": "nas01.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 00001e098d56774c" + }, + { + "at": "1789227873618232", + "member": "nas01.glab.lol", + "message": "ovs|00220|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873715222", + "member": "nas01.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873715390", + "member": "nas01.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227873722901", + "member": "nas01.glab.lol", + "message": "ovs|00223|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873723034", + "member": "nas01.glab.lol", + "message": "ovs|00224|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789227873741657", + "member": "nas01.glab.lol", + "message": "ovs|00225|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741688", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741713", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741735", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741750", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741767", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741784", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255605ms" + }, + { + "at": "1789227873741801", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255605ms" + }, + { + "at": "1789227873741817", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255605ms" + }, + { + "at": "1789227873741833", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741850", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741867", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741882", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873741899", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741929", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741945", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741963", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741978", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741995", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873742011", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873742030", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873742045", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873742061", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873746586", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler273)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873746610", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler273)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873746628", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873746651", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873746705", + "member": "nas01.glab.lol", + "message": " my_disc:0x42213715 your_disc:0x0" + }, + { + "at": "1789227873746728", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873746751", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873746766", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873746781", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873746795", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873746810", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873746824", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873746850", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255610ms" + }, + { + "at": "1789227873746866", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +755ms" + }, + { + "at": "1789227873746883", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227873746905", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873746922", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873746940", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873746955", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873746975", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873746996", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747020", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747037", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873747063", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747084", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227873747108", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873747130", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747151", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873747205", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747227", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747243", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747258", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747272", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747301", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873747315", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873747334", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +755ms" + }, + { + "at": "1789227873747348", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227873747365", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873747383", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873747398", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747412", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873747426", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747444", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747461", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747475", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873747490", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747504", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227873747519", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747538", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747553", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873747568", + "member": "nas01.glab.lol", + "message": "ovs|00226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747583", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747600", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747614", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747629", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747643", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873747658", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255611ms" + }, + { + "at": "1789227873747672", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255611ms" + }, + { + "at": "1789227873747692", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255611ms" + }, + { + "at": "1789227873747708", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873747722", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873747735", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747750", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873747765", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747780", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873747795", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747809", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873747823", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747838", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873747853", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873747867", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873747886", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873747900", + "member": "nas01.glab.lol", + "message": "ovs|00227|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747919", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747935", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747948", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747962", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747978", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873747993", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255611ms" + }, + { + "at": "1789227873748008", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255611ms" + }, + { + "at": "1789227873748023", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255611ms" + }, + { + "at": "1789227873748037", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873748052", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873748066", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873748080", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873748096", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873748110", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873748124", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873748141", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873748158", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873748173", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873748193", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873748208", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873748222", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873846849", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler273)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873847004", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler273)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227873847026", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873847049", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873847065", + "member": "nas01.glab.lol", + "message": " my_disc:0xff024ef1 your_disc:0xe1085a38" + }, + { + "at": "1789227873847083", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873847098", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873847114", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873847135", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873847150", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873847165", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873847180", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873847196", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255710ms" + }, + { + "at": "1789227873847211", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +816ms" + }, + { + "at": "1789227873847228", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227873847255", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873847269", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873847282", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847296", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873847311", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847328", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847346", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873847360", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873847379", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847395", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff024ef1" + }, + { + "at": "1789227873847411", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873847426", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847443", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873847457", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler273)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873847474", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873847489", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873847503", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873847517", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873847531", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873847545", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873847560", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +816ms" + }, + { + "at": "1789227873847575", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227873847589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873847604", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873847619", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847634", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873847649", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847663", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847676", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873847691", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873847704", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847719", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff024ef1" + }, + { + "at": "1789227873847733", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847755", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847770", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873849210", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler273)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873849345", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler273)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873849365", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873849376", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873849387", + "member": "nas01.glab.lol", + "message": " my_disc:0x33a33fab your_disc:0xa3aaccff" + }, + { + "at": "1789227873849398", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873849408", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873849418", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873849432", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849443", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873849454", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873849465", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873849475", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255713ms" + }, + { + "at": "1789227873849488", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +963ms" + }, + { + "at": "1789227873849500", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227873849515", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873849525", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873849536", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849547", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873849558", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849570", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849581", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873849592", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873849602", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849612", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x33a33fab" + }, + { + "at": "1789227873849629", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873849639", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849650", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873849661", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler273)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873849674", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873849685", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849698", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873849709", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873849718", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873849737", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873849747", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +963ms" + }, + { + "at": "1789227873849758", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227873849768", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873849780", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873849791", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849801", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873849811", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849821", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849832", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873849841", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873849854", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849887", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x33a33fab" + }, + { + "at": "1789227873849907", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849939", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849948", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874697395", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874697803", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874697827", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874697853", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874697888", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874697965", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874698000", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874698034", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +634ms" + }, + { + "at": "1789227874698068", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -196ms" + }, + { + "at": "1789227874698098", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874698125", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874698163", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874698191", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874698219", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874698247", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874698276", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874698303", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874698338", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874698365", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227874698395", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874698422", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874698451", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227883623399", + "member": "nas01.glab.lol", + "message": "ovs|00228|connmgr|INFO|br-int<->unix#7: 927 flow_mods in the 7 s starting 10 s ago (843 adds, 83 deletes, 1 modifications)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-teardown.txt new file mode 100644 index 0000000..5cbc73a --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-after-teardown.txt @@ -0,0 +1,5740 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:97:88:42 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:97:88:42 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873753775", + "member": "lab01.glab.lol", + "message": "ovs|84316|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873753922", + "member": "lab01.glab.lol", + "message": "ovs|84317|bridge|INFO|bridge incusovn16: using datapath ID 00009a579efe0f49" + }, + { + "at": "1789227873753964", + "member": "lab01.glab.lol", + "message": "ovs|84318|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873755158", + "member": "lab01.glab.lol", + "message": "ovs|84319|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873755212", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873755237", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873755257", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873755280", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873755297", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873755310", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873755330", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873755350", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873755376", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873755396", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873755410", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755427", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873755445", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873755464", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755483", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873755505", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873755521", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755544", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873755556", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873755579", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755598", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873755612", + "member": "lab01.glab.lol", + "message": "ovs|84320|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873755628", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873755640", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873755653", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873755666", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873755683", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873755702", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873755715", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873755729", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873755749", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873755761", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873755779", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755797", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873755817", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873755830", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755850", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873755869", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873755882", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873755905", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755924", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873755941", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873755952", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755966", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873755982", + "member": "lab01.glab.lol", + "message": "ovs|84321|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873756003", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873756016", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873756027", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873756048", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873756066", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873756078", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873756092", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873756105", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873756117", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873756130", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873756150", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873756170", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873756188", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873756204", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873756222", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873756239", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873756253", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873756271", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873756322", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873756336", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873756349", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873849544", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler265)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873849658", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler265)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227873849714", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873849762", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873849809", + "member": "lab01.glab.lol", + "message": " my_disc:0xa3aaccff your_disc:0x0" + }, + { + "at": "1789227873849850", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873849883", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873849912", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873849954", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849984", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873850025", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873850065", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873850109", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151849ms" + }, + { + "at": "1789227873850159", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151849ms" + }, + { + "at": "1789227873850202", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151849ms" + }, + { + "at": "1789227873850245", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873850289", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873850334", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873850380", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873850418", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873850452", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873850497", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873850539", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873850573", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873850604", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873850634", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873850667", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873850711", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873850743", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873850780", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873850814", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873850851", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873850891", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873850923", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873850964", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873851015", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151850ms" + }, + { + "at": "1789227873851347", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151850ms" + }, + { + "at": "1789227873851450", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873851695", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873851727", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873851765", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873851804", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873851836", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873851878", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873851911", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873851950", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873851986", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873852016", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873852067", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873852108", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873852146", + "member": "lab01.glab.lol", + "message": "ovs|84322|dpif|WARN|Dropped 627 log messages in last 247 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227873852177", + "member": "lab01.glab.lol", + "message": "ovs|84323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852228", + "member": "lab01.glab.lol", + "message": "ovs|84324|bridge|WARN|Dropped 54314 log messages in last 273 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227873852269", + "member": "lab01.glab.lol", + "message": "ovs|84325|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873852307", + "member": "lab01.glab.lol", + "message": "ovs|84326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852349", + "member": "lab01.glab.lol", + "message": "ovs|84327|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873852427", + "member": "lab01.glab.lol", + "message": "ovs|84328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852468", + "member": "lab01.glab.lol", + "message": "ovs|84329|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873853317", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler265)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873853407", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler265)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227873853474", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873853536", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873853581", + "member": "lab01.glab.lol", + "message": " my_disc:0x15434add your_disc:0x296246be" + }, + { + "at": "1789227873853617", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873853661", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873853697", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873853731", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873853766", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873853809", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873853834", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873853864", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151853ms" + }, + { + "at": "1789227873853910", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +832ms" + }, + { + "at": "1789227873853947", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789227873853976", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873854005", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873854037", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873854070", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873854109", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873854148", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873854183", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873854210", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873854259", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873854289", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x15434add" + }, + { + "at": "1789227873854328", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873854354", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873854378", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873854402", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler265)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873854442", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873854481", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873854526", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873854558", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873854592", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873854619", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873854657", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +832ms" + }, + { + "at": "1789227873854693", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789227873854967", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873855036", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873855073", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855100", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873855122", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855143", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855173", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873855201", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873855231", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855260", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x15434add" + }, + { + "at": "1789227873855296", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855322", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855347", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873855363", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler265)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873855393", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler265)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873855424", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873855450", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873855473", + "member": "lab01.glab.lol", + "message": " my_disc:0x277d8736 your_disc:0x0" + }, + { + "at": "1789227873855503", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873855531", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873855554", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873855578", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873855601", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873855616", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873855639", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873855657", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151853ms" + }, + { + "at": "1789227873855689", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151853ms" + }, + { + "at": "1789227873855712", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151853ms" + }, + { + "at": "1789227873855734", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873855753", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873855771", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855788", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873855809", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855827", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855849", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873855864", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873855887", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855909", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227873855927", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873855950", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855967", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873855990", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873856013", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873856035", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873856056", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873856073", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873856092", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873856111", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873856133", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151854ms" + }, + { + "at": "1789227873856160", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151854ms" + }, + { + "at": "1789227873856181", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873856198", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873856219", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873856234", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873856251", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873856265", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873856279", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873856302", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873856325", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873856339", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227873856356", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873856378", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873856397", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873856420", + "member": "lab01.glab.lol", + "message": "ovs|84330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873856444", + "member": "lab01.glab.lol", + "message": "ovs|84331|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873856465", + "member": "lab01.glab.lol", + "message": "ovs|84332|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873859876", + "member": "lab01.glab.lol", + "message": "ovs|84333|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227873859992", + "member": "lab01.glab.lol", + "message": "ovs|84334|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789227874139693", + "member": "lab01.glab.lol", + "message": "ovs|84335|bridge|WARN|Dropped 513 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227874139803", + "member": "lab01.glab.lol", + "message": "ovs|84336|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227874783907", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874784116", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874784138", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874784159", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874784177", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874784196", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874784210", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874784222", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +32ms" + }, + { + "at": "1789227874784246", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -928ms" + }, + { + "at": "1789227874784262", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874784274", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874784295", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874784313", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227874784327", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874784339", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874784355", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874784366", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874784385", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874784402", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227874784419", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874784429", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874784444", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874820283", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874820359", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874820386", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874820407", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874820427", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874820446", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874820461", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874820477", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +657ms" + }, + { + "at": "1789227874820503", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -143ms" + }, + { + "at": "1789227874820524", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874820534", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874820550", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874820560", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227874820570", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874820579", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874820601", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874820614", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874820624", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874820639", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227874820652", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874820666", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874820676", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874849601", + "member": "lab01.glab.lol", + "message": "ovs|84337|dpif|WARN|Dropped 1965 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227874849667", + "member": "lab01.glab.lol", + "message": "ovs|84338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227875225028", + "member": "lab01.glab.lol", + "message": "ovs|84339|bridge|INFO|bridge br-int: added interface vethe8917453 on port 34" + }, + { + "at": "1789227875850136", + "member": "lab01.glab.lol", + "message": "ovs|84340|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227875850324", + "member": "lab01.glab.lol", + "message": "ovs|84341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227876092045", + "member": "lab01.glab.lol", + "message": "ovs|84342|poll_loop|INFO|Dropped 722 log messages in last 250 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227876092166", + "member": "lab01.glab.lol", + "message": "ovs|84343|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876092469", + "member": "lab01.glab.lol", + "message": "ovs|84344|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876093067", + "member": "lab01.glab.lol", + "message": "ovs|84345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876093475", + "member": "lab01.glab.lol", + "message": "ovs|84346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876094184", + "member": "lab01.glab.lol", + "message": "ovs|84347|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876094690", + "member": "lab01.glab.lol", + "message": "ovs|84348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876095158", + "member": "lab01.glab.lol", + "message": "ovs|84349|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876095711", + "member": "lab01.glab.lol", + "message": "ovs|84350|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876096181", + "member": "lab01.glab.lol", + "message": "ovs|84351|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876096671", + "member": "lab01.glab.lol", + "message": "ovs|84352|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876849808", + "member": "lab01.glab.lol", + "message": "ovs|84353|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227876849933", + "member": "lab01.glab.lol", + "message": "ovs|84354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227877849856", + "member": "lab01.glab.lol", + "message": "ovs|84355|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227877850152", + "member": "lab01.glab.lol", + "message": "ovs|84356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227878849960", + "member": "lab01.glab.lol", + "message": "ovs|84357|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227878850208", + "member": "lab01.glab.lol", + "message": "ovs|84358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227879849905", + "member": "lab01.glab.lol", + "message": "ovs|84359|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227879850029", + "member": "lab01.glab.lol", + "message": "ovs|84360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227880849973", + "member": "lab01.glab.lol", + "message": "ovs|84361|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227880850106", + "member": "lab01.glab.lol", + "message": "ovs|84362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227881849613", + "member": "lab01.glab.lol", + "message": "ovs|84363|dpif|WARN|Dropped 2094 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227881849716", + "member": "lab01.glab.lol", + "message": "ovs|84364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227882092169", + "member": "lab01.glab.lol", + "message": "ovs|84365|poll_loop|INFO|Dropped 12403 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227882092349", + "member": "lab01.glab.lol", + "message": "ovs|84366|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227882849696", + "member": "lab01.glab.lol", + "message": "ovs|84367|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227882849796", + "member": "lab01.glab.lol", + "message": "ovs|84368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227883756788", + "member": "lab01.glab.lol", + "message": "ovs|84369|connmgr|INFO|br-int<->unix#7: 893 flow_mods in the 7 s starting 10 s ago (829 adds, 57 deletes, 7 modifications)" + }, + { + "at": "1789227883850082", + "member": "lab01.glab.lol", + "message": "ovs|84370|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227883850155", + "member": "lab01.glab.lol", + "message": "ovs|84371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227884849858", + "member": "lab01.glab.lol", + "message": "ovs|84372|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227884850102", + "member": "lab01.glab.lol", + "message": "ovs|84373|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227885849589", + "member": "lab01.glab.lol", + "message": "ovs|84374|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227885849687", + "member": "lab01.glab.lol", + "message": "ovs|84375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227886849563", + "member": "lab01.glab.lol", + "message": "ovs|84376|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227886849803", + "member": "lab01.glab.lol", + "message": "ovs|84377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227887849833", + "member": "lab01.glab.lol", + "message": "ovs|84378|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227887850050", + "member": "lab01.glab.lol", + "message": "ovs|84379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227888091593", + "member": "lab01.glab.lol", + "message": "ovs|84380|poll_loop|INFO|Dropped 12195 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227888091690", + "member": "lab01.glab.lol", + "message": "ovs|84381|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789227888849637", + "member": "lab01.glab.lol", + "message": "ovs|84382|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227888849776", + "member": "lab01.glab.lol", + "message": "ovs|84383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227889850071", + "member": "lab01.glab.lol", + "message": "ovs|84384|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227889850315", + "member": "lab01.glab.lol", + "message": "ovs|84385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227890849645", + "member": "lab01.glab.lol", + "message": "ovs|84386|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227890849757", + "member": "lab01.glab.lol", + "message": "ovs|84387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227891849872", + "member": "lab01.glab.lol", + "message": "ovs|84388|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227891850136", + "member": "lab01.glab.lol", + "message": "ovs|84389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227892849901", + "member": "lab01.glab.lol", + "message": "ovs|84390|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227892850133", + "member": "lab01.glab.lol", + "message": "ovs|84391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227893849869", + "member": "lab01.glab.lol", + "message": "ovs|84392|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227893850026", + "member": "lab01.glab.lol", + "message": "ovs|84393|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227894092228", + "member": "lab01.glab.lol", + "message": "ovs|84394|poll_loop|INFO|Dropped 12194 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227894092354", + "member": "lab01.glab.lol", + "message": "ovs|84395|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227894849639", + "member": "lab01.glab.lol", + "message": "ovs|84396|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227894849747", + "member": "lab01.glab.lol", + "message": "ovs|84397|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227895849744", + "member": "lab01.glab.lol", + "message": "ovs|84398|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227895849992", + "member": "lab01.glab.lol", + "message": "ovs|84399|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227896849667", + "member": "lab01.glab.lol", + "message": "ovs|84400|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227896849825", + "member": "lab01.glab.lol", + "message": "ovs|84401|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227897850009", + "member": "lab01.glab.lol", + "message": "ovs|84402|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227897850202", + "member": "lab01.glab.lol", + "message": "ovs|84403|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227898849901", + "member": "lab01.glab.lol", + "message": "ovs|84404|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227898849990", + "member": "lab01.glab.lol", + "message": "ovs|84405|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227898908201", + "member": "lab01.glab.lol", + "message": "ovs|84406|bridge|INFO|bridge br-int: deleted interface vethe8917453 on port 34" + }, + { + "at": "1789227899849967", + "member": "lab01.glab.lol", + "message": "ovs|84407|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227899850047", + "member": "lab01.glab.lol", + "message": "ovs|84408|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227900091856", + "member": "lab01.glab.lol", + "message": "ovs|84409|poll_loop|INFO|Dropped 12253 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227900092025", + "member": "lab01.glab.lol", + "message": "ovs|84410|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789227900849931", + "member": "lab01.glab.lol", + "message": "ovs|84411|dpif|WARN|Dropped 2073 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227900850031", + "member": "lab01.glab.lol", + "message": "ovs|84412|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227901322120", + "member": "lab01.glab.lol", + "message": "ovs|84413|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227901322191", + "member": "lab01.glab.lol", + "message": "ovs|84414|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227901337237", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated" + }, + { + "at": "1789227901340870", + "member": "lab01.glab.lol", + "message": "ovs|84415|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873737783", + "member": "lab02.glab.lol", + "message": "ovs|00214|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873738103", + "member": "lab02.glab.lol", + "message": "ovs|00215|bridge|INFO|bridge incusovn16: using datapath ID 0000c687844de948" + }, + { + "at": "1789227873738311", + "member": "lab02.glab.lol", + "message": "ovs|00216|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873740647", + "member": "lab02.glab.lol", + "message": "ovs|00217|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873740697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873740712", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873740726", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873740737", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873740747", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873740763", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873740780", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873740795", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873740805", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873740818", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873740834", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873740845", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873740856", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873740866", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873740875", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873740887", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873740899", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873740908", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873740919", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873740930", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873740941", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873740951", + "member": "lab02.glab.lol", + "message": "ovs|00218|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873740964", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873740974", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873740985", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873740995", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741004", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741014", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873741026", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873741037", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873741049", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873741059", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741069", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741080", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741091", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873741102", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741111", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741121", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741131", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741140", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741150", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741160", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741169", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741179", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873741189", + "member": "lab02.glab.lol", + "message": "ovs|00219|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741201", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741211", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741227", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741274", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741284", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741294", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873741304", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873741315", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873741325", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741334", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741344", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741353", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873741365", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741375", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741386", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741397", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741409", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741420", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741429", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741439", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741449", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873743978", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler261)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873744016", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler261)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873744033", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873744048", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873744063", + "member": "lab02.glab.lol", + "message": " my_disc:0x296246be your_disc:0x0" + }, + { + "at": "1789227873744076", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873744087", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873744099", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873744109", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873744120", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873744132", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873744143", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873744157", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128743ms" + }, + { + "at": "1789227873744170", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128743ms" + }, + { + "at": "1789227873744182", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128743ms" + }, + { + "at": "1789227873744193", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873744203", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873744215", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744226", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873744236", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744247", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744259", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873744270", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873744287", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744297", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227873744308", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873744320", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744331", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873744342", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873744354", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873744365", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873744375", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873744386", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873744401", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873744412", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873744426", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128743ms" + }, + { + "at": "1789227873744436", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128743ms" + }, + { + "at": "1789227873744446", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873744456", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873744466", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744476", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873744486", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744497", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744508", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873744520", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873744531", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744541", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227873744552", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744565", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744576", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873835313", + "member": "lab02.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873835363", + "member": "lab02.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227873837095", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler261)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873837134", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler261)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227873837146", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873837156", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873837170", + "member": "lab02.glab.lol", + "message": " my_disc:0xe1085a38 your_disc:0x0" + }, + { + "at": "1789227873837181", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873837192", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873837203", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873837213", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873837222", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873837233", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873837244", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873837256", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128836ms" + }, + { + "at": "1789227873837266", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128836ms" + }, + { + "at": "1789227873837277", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128836ms" + }, + { + "at": "1789227873837291", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873837301", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873837310", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837321", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873837331", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837341", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837350", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873837360", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873837370", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837380", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227873837390", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873837403", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837413", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873837421", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873837433", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873837441", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873837451", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873837459", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873837469", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873837479", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873837488", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128836ms" + }, + { + "at": "1789227873837497", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128836ms" + }, + { + "at": "1789227873837506", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873837515", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873837525", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837533", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873837542", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837551", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837559", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873837567", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873837576", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837583", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227873837593", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837601", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837609", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873841091", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler261)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873841104", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler261)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873841114", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873841123", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873841131", + "member": "lab02.glab.lol", + "message": " my_disc:0xbf36e8e3 your_disc:0x0" + }, + { + "at": "1789227873841140", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873841149", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873841157", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873841166", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873841175", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873841184", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873841192", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873841200", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128840ms" + }, + { + "at": "1789227873841210", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227873841221", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227873841230", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873841239", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873841248", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841256", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873841264", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841273", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841285", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873841293", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873841300", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841307", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873841316", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873841323", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841331", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873841338", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873841346", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873841354", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873841362", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873841369", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873841377", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873841385", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873841392", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227873841403", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227873841410", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873841418", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873841426", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841435", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873841443", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841451", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841463", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873841472", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873841479", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841487", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873841496", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841504", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841512", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873842905", + "member": "lab02.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873843010", + "member": "lab02.glab.lol", + "message": "ovs|00223|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227874672898", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874673000", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874673029", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874673050", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874673073", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874673102", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874673124", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874673147", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +158ms" + }, + { + "at": "1789227874673170", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -832ms" + }, + { + "at": "1789227874673192", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874673214", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874673243", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874673273", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227874673292", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874673314", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874673334", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874673355", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874673379", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874673408", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227874673428", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874673450", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874673469", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874758219", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874758471", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874758495", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874758517", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874758543", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874758567", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874758589", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874758608", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227874758627", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -87ms" + }, + { + "at": "1789227874758651", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874758674", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874758696", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874758717", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227874758739", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874758760", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874758781", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874758800", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874758821", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874758840", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227874758859", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874758880", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874758902", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874761753", + "member": "lab02.glab.lol", + "message": "ovs|00012|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874761808", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874761819", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874761828", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874761837", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874761847", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874761856", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874761864", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +510ms" + }, + { + "at": "1789227874761876", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -250ms" + }, + { + "at": "1789227874761887", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874761896", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874761907", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874761916", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227874761924", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874761933", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874761942", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874761951", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874761959", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874761969", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874761978", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874761986", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874761995", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227883742689", + "member": "lab02.glab.lol", + "message": "ovs|00224|connmgr|INFO|br-int<->unix#7: 913 flow_mods in the 7 s starting 10 s ago (845 adds, 68 deletes)" + }, + { + "at": "1789227901311503", + "member": "lab02.glab.lol", + "message": "ovs|00225|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227901311766", + "member": "lab02.glab.lol", + "message": "ovs|00226|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227901311800", + "member": "lab02.glab.lol", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227901334162", + "member": "lab02.glab.lol", + "message": "ovs|00228|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227901334320", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873738760", + "member": "lab03.glab.lol", + "message": "ovs|00236|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873738935", + "member": "lab03.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000066e755c19444" + }, + { + "at": "1789227873738964", + "member": "lab03.glab.lol", + "message": "ovs|00238|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873741335", + "member": "lab03.glab.lol", + "message": "ovs|00239|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741398", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741422", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741444", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741461", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741477", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741495", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028739ms" + }, + { + "at": "1789227873741515", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028739ms" + }, + { + "at": "1789227873741539", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028739ms" + }, + { + "at": "1789227873741556", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741571", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741587", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741604", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227873741621", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741634", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741653", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741670", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741686", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741702", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741719", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741736", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741751", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873741768", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873749097", + "member": "lab03.glab.lol", + "message": "ovs|00240|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873749159", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873749174", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873749185", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873749195", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873749206", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873749217", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028747ms" + }, + { + "at": "1789227873749228", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028747ms" + }, + { + "at": "1789227873749239", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028747ms" + }, + { + "at": "1789227873749251", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873749262", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873749273", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749282", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873749294", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873749305", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749315", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873749326", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873749335", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749345", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873749356", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873749368", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749378", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873749389", + "member": "lab03.glab.lol", + "message": "ovs|00241|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873749403", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873749415", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873749424", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873749435", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873749445", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873749456", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028747ms" + }, + { + "at": "1789227873749465", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028747ms" + }, + { + "at": "1789227873749475", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028747ms" + }, + { + "at": "1789227873749486", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873749497", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873749506", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749516", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873749532", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873749543", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749552", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873749563", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873749578", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749587", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873749598", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873749610", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749620", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873836271", + "member": "lab03.glab.lol", + "message": "ovs|00242|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873836530", + "member": "lab03.glab.lol", + "message": "ovs|00243|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227873843804", + "member": "lab03.glab.lol", + "message": "ovs|00244|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873843888", + "member": "lab03.glab.lol", + "message": "ovs|00245|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227873844239", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler265)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873844326", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler265)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873844365", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873844400", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873844424", + "member": "lab03.glab.lol", + "message": " my_disc:0x57037ae4 your_disc:0x277d8736" + }, + { + "at": "1789227873844448", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873844476", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873844499", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873844523", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873844545", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873844568", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873844596", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873844622", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028842ms" + }, + { + "at": "1789227873844647", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +927ms" + }, + { + "at": "1789227873844678", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227873844703", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873844725", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873844753", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873844781", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873844804", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873844826", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873844853", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873844875", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873844898", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873844922", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x57037ae4" + }, + { + "at": "1789227873844946", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873844971", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873844993", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873845020", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler265)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873845044", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873845079", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873845102", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873845124", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873845144", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873845165", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873845189", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +927ms" + }, + { + "at": "1789227873845212", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227873845235", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873845297", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873845320", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873845344", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873845366", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873845386", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873845407", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873845429", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873845450", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873845472", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x57037ae4" + }, + { + "at": "1789227873845493", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873845519", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873845541", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874496814", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler272)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227874496927", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler272)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227874496968", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227874497006", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227874497031", + "member": "lab03.glab.lol", + "message": " my_disc:0xbeb6ee15 your_disc:0x42213715" + }, + { + "at": "1789227874497058", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227874497098", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227874497124", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227874497151", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874497181", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874497208", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874497231", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874497260", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50029494ms" + }, + { + "at": "1789227874497286", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +195ms" + }, + { + "at": "1789227874497315", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -755ms" + }, + { + "at": "1789227874497338", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874497362", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874497384", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497407", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227874497436", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874497466", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874497497", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874497523", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874497545", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497569", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874497594", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227874497617", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874497645", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874497666", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler272)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874497695", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874497724", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874497747", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874497771", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874497794", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874497818", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874497841", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +195ms" + }, + { + "at": "1789227874497866", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -755ms" + }, + { + "at": "1789227874497890", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874497920", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874497944", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497972", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227874497999", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874498021", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874498045", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874498087", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874498114", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874498138", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874498162", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874498187", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874498212", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874512379", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler272)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227874512490", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler272)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227874512532", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227874512561", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227874512586", + "member": "lab03.glab.lol", + "message": " my_disc:0x323b8422 your_disc:0xbf36e8e3" + }, + { + "at": "1789227874512614", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227874512644", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227874512675", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227874512701", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874512727", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874512758", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874512786", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874512810", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50029510ms" + }, + { + "at": "1789227874512838", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +249ms" + }, + { + "at": "1789227874512862", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -671ms" + }, + { + "at": "1789227874512888", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874512911", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874512935", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874512958", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874512983", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513009", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513036", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874513057", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874513090", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513126", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x323b8422" + }, + { + "at": "1789227874513152", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227874513172", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513195", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874513220", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler272)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874513247", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874513271", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874513292", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874513313", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874513335", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874513358", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874513389", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +249ms" + }, + { + "at": "1789227874513410", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -671ms" + }, + { + "at": "1789227874513469", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874513499", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874513523", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513546", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874513568", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513591", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513616", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874513639", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874513659", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513682", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x323b8422" + }, + { + "at": "1789227874513704", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513725", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513748", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227876199497", + "member": "lab03.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge br-int: added interface veth3e3d489f on port 32" + }, + { + "at": "1789227883744374", + "member": "lab03.glab.lol", + "message": "ovs|00247|connmgr|INFO|br-int<->unix#7: 886 flow_mods in the 7 s starting 10 s ago (825 adds, 53 deletes, 8 modifications)" + }, + { + "at": "1789227899951589", + "member": "lab03.glab.lol", + "message": "ovs|00248|bridge|INFO|bridge br-int: deleted interface veth3e3d489f on port 32" + }, + { + "at": "1789227901309821", + "member": "lab03.glab.lol", + "message": "ovs|00249|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227901309983", + "member": "lab03.glab.lol", + "message": "ovs|00250|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227901310012", + "member": "lab03.glab.lol", + "message": "ovs|00251|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227901342570", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated" + }, + { + "at": "1789227901347002", + "member": "lab03.glab.lol", + "message": "ovs|00252|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873618063", + "member": "nas01.glab.lol", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873618214", + "member": "nas01.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 00001e098d56774c" + }, + { + "at": "1789227873618232", + "member": "nas01.glab.lol", + "message": "ovs|00220|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873715222", + "member": "nas01.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873715390", + "member": "nas01.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227873722901", + "member": "nas01.glab.lol", + "message": "ovs|00223|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873723034", + "member": "nas01.glab.lol", + "message": "ovs|00224|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789227873741657", + "member": "nas01.glab.lol", + "message": "ovs|00225|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741688", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741713", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741735", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741750", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741767", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741784", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255605ms" + }, + { + "at": "1789227873741801", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255605ms" + }, + { + "at": "1789227873741817", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255605ms" + }, + { + "at": "1789227873741833", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741850", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741867", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741882", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873741899", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741929", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741945", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741963", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741978", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741995", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873742011", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873742030", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873742045", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873742061", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873746586", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler273)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873746610", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler273)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873746628", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873746651", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873746705", + "member": "nas01.glab.lol", + "message": " my_disc:0x42213715 your_disc:0x0" + }, + { + "at": "1789227873746728", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873746751", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873746766", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873746781", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873746795", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873746810", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873746824", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873746850", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255610ms" + }, + { + "at": "1789227873746866", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +755ms" + }, + { + "at": "1789227873746883", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227873746905", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873746922", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873746940", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873746955", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873746975", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873746996", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747020", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747037", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873747063", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747084", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227873747108", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873747130", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747151", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873747205", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747227", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747243", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747258", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747272", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747301", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873747315", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873747334", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +755ms" + }, + { + "at": "1789227873747348", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227873747365", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873747383", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873747398", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747412", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873747426", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747444", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747461", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747475", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873747490", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747504", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227873747519", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747538", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747553", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873747568", + "member": "nas01.glab.lol", + "message": "ovs|00226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747583", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747600", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747614", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747629", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747643", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873747658", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255611ms" + }, + { + "at": "1789227873747672", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255611ms" + }, + { + "at": "1789227873747692", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255611ms" + }, + { + "at": "1789227873747708", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873747722", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873747735", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747750", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873747765", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747780", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873747795", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747809", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873747823", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747838", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873747853", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873747867", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873747886", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873747900", + "member": "nas01.glab.lol", + "message": "ovs|00227|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747919", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747935", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747948", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747962", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747978", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873747993", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255611ms" + }, + { + "at": "1789227873748008", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255611ms" + }, + { + "at": "1789227873748023", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255611ms" + }, + { + "at": "1789227873748037", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873748052", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873748066", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873748080", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873748096", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873748110", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873748124", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873748141", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873748158", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873748173", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873748193", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873748208", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873748222", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873846849", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler273)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873847004", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler273)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227873847026", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873847049", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873847065", + "member": "nas01.glab.lol", + "message": " my_disc:0xff024ef1 your_disc:0xe1085a38" + }, + { + "at": "1789227873847083", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873847098", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873847114", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873847135", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873847150", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873847165", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873847180", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873847196", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255710ms" + }, + { + "at": "1789227873847211", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +816ms" + }, + { + "at": "1789227873847228", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227873847255", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873847269", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873847282", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847296", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873847311", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847328", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847346", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873847360", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873847379", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847395", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff024ef1" + }, + { + "at": "1789227873847411", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873847426", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847443", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873847457", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler273)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873847474", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873847489", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873847503", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873847517", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873847531", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873847545", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873847560", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +816ms" + }, + { + "at": "1789227873847575", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227873847589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873847604", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873847619", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847634", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873847649", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847663", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847676", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873847691", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873847704", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847719", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff024ef1" + }, + { + "at": "1789227873847733", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847755", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847770", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873849210", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler273)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873849345", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler273)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873849365", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873849376", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873849387", + "member": "nas01.glab.lol", + "message": " my_disc:0x33a33fab your_disc:0xa3aaccff" + }, + { + "at": "1789227873849398", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873849408", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873849418", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873849432", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849443", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873849454", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873849465", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873849475", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255713ms" + }, + { + "at": "1789227873849488", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +963ms" + }, + { + "at": "1789227873849500", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227873849515", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873849525", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873849536", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849547", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873849558", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849570", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849581", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873849592", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873849602", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849612", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x33a33fab" + }, + { + "at": "1789227873849629", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873849639", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849650", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873849661", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler273)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873849674", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873849685", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849698", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873849709", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873849718", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873849737", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873849747", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +963ms" + }, + { + "at": "1789227873849758", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227873849768", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873849780", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873849791", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849801", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873849811", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849821", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849832", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873849841", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873849854", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849887", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x33a33fab" + }, + { + "at": "1789227873849907", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849939", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849948", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874697395", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874697803", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874697827", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874697853", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874697888", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874697965", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874698000", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874698034", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +634ms" + }, + { + "at": "1789227874698068", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -196ms" + }, + { + "at": "1789227874698098", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874698125", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874698163", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874698191", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874698219", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874698247", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874698276", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874698303", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874698338", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874698365", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227874698395", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874698422", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874698451", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227883623399", + "member": "nas01.glab.lol", + "message": "ovs|00228|connmgr|INFO|br-int<->unix#7: 927 flow_mods in the 7 s starting 10 s ago (843 adds, 83 deletes, 1 modifications)" + }, + { + "at": "1789227901323039", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor289)|INFO|monitor thread terminated" + }, + { + "at": "1789227901432424", + "member": "nas01.glab.lol", + "message": "ovs|00229|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227901432624", + "member": "nas01.glab.lol", + "message": "ovs|00230|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789227901432660", + "member": "nas01.glab.lol", + "message": "ovs|00231|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789227901456634", + "member": "nas01.glab.lol", + "message": "ovs|00232|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-before-probe.txt new file mode 100644 index 0000000..1f20cf8 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/diagnostics-before-probe.txt @@ -0,0 +1,5491 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:3d:55:e6 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:02:c1:d4 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch c601fdcd-bf61-4321-aff9-ac4cbff4de3a (incus-net35-ls-ext) + port incus-net35-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net35-ls-ext-lsp-router + type: router + router-port: incus-net35-lr-lrp-ext +switch d1459ccf-1f95-4363-b19a-409fa9de431e (incus-net35-ls-int) + port incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0 + addresses: ["10:66:6a:02:c1:d4 dynamic"] + port incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0 + addresses: ["10:66:6a:3d:55:e6 dynamic"] + port incus-net35-ls-int-lsp-router + type: router + router-port: incus-net35-lr-lrp-int +router 32d5651d-981e-4e16-bb5c-68e374be097f (incus-net35-lr) + port incus-net35-lr-lrp-ext + mac: "10:66:6a:97:88:42" + ipv6-lla: "fe80::1266:6aff:fe97:8842" + networks: ["10.10.40.64/24"] + port incus-net35-lr-lrp-int + mac: "10:66:6a:97:88:42" + ipv6-lla: "fe80::1266:6aff:fe97:8842" + networks: ["10.253.73.1/24"] + nat c214de1b-a159-4a64-b0a9-f4c6a19f2767 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net35-instance-2e740595-2f8a-44dc-853a-ff4b7c226485-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} + Port_Binding cr-incus-net35-lr-lrp-ext +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net35-instance-ae26d44c-9692-4d26-9d00-43f1b7a21ed0-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : bdd30abd-df43-4485-a81d-94ba968e7d2b +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:97:88:42" +name : incus-net35-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 9a0ddff7-cb8a-4193-9a4a-9d24b5e6eec8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 24073851-46ac-4583-85ec-51ea82f837d7 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:97:88:42" +name : incus-net35-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="67314e94-b0b4-4c97-8146-0c67aff4d585"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 6e985934-0679-400b-bc2f-0008abc6afda +additional_chassis : [] +additional_encap : [] +chassis : 96ed7fb7-18eb-47bb-b6fa-ca235f6425a3 +datapath : 2f43d3a3-036c-4734-8f3c-1ba4a4dc22ec +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c81f3409-dc9d-4972-9594-2b864d3d35fd +logical_port : cr-incus-net35-lr-lrp-ext +mac : ["10:66:6a:97:88:42 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net35-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:97:88:42 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:97:88:42 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873753775", + "member": "lab01.glab.lol", + "message": "ovs|84316|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873753922", + "member": "lab01.glab.lol", + "message": "ovs|84317|bridge|INFO|bridge incusovn16: using datapath ID 00009a579efe0f49" + }, + { + "at": "1789227873753964", + "member": "lab01.glab.lol", + "message": "ovs|84318|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873755158", + "member": "lab01.glab.lol", + "message": "ovs|84319|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873755212", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873755237", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873755257", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873755280", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873755297", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873755310", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873755330", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873755350", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873755376", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873755396", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873755410", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755427", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873755445", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873755464", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755483", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873755505", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873755521", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755544", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873755556", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873755579", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755598", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873755612", + "member": "lab01.glab.lol", + "message": "ovs|84320|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873755628", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873755640", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873755653", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873755666", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873755683", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873755702", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873755715", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873755729", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873755749", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873755761", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873755779", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755797", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873755817", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873755830", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755850", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873755869", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873755882", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873755905", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873755924", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873755941", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873755952", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873755966", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873755982", + "member": "lab01.glab.lol", + "message": "ovs|84321|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873756003", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873756016", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873756027", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873756048", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873756066", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873756078", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151755ms" + }, + { + "at": "1789227873756092", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151755ms" + }, + { + "at": "1789227873756105", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151755ms" + }, + { + "at": "1789227873756117", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873756130", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873756150", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873756170", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873756188", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873756204", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873756222", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873756239", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873756253", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873756271", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873756322", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873756336", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873756349", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873849544", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler265)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873849658", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler265)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227873849714", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873849762", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873849809", + "member": "lab01.glab.lol", + "message": " my_disc:0xa3aaccff your_disc:0x0" + }, + { + "at": "1789227873849850", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873849883", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873849912", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873849954", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849984", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873850025", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873850065", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873850109", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151849ms" + }, + { + "at": "1789227873850159", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151849ms" + }, + { + "at": "1789227873850202", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151849ms" + }, + { + "at": "1789227873850245", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873850289", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873850334", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873850380", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873850418", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873850452", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873850497", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873850539", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873850573", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873850604", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873850634", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873850667", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873850711", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873850743", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873850780", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873850814", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873850851", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873850891", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873850923", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873850964", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873851015", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151850ms" + }, + { + "at": "1789227873851347", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151850ms" + }, + { + "at": "1789227873851450", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873851695", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873851727", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873851765", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227873851804", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873851836", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873851878", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873851911", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873851950", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873851986", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873852016", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873852067", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873852108", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873852146", + "member": "lab01.glab.lol", + "message": "ovs|84322|dpif|WARN|Dropped 627 log messages in last 247 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227873852177", + "member": "lab01.glab.lol", + "message": "ovs|84323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852228", + "member": "lab01.glab.lol", + "message": "ovs|84324|bridge|WARN|Dropped 54314 log messages in last 273 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227873852269", + "member": "lab01.glab.lol", + "message": "ovs|84325|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873852307", + "member": "lab01.glab.lol", + "message": "ovs|84326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852349", + "member": "lab01.glab.lol", + "message": "ovs|84327|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873852427", + "member": "lab01.glab.lol", + "message": "ovs|84328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873852468", + "member": "lab01.glab.lol", + "message": "ovs|84329|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873853317", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler265)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873853407", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler265)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227873853474", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873853536", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873853581", + "member": "lab01.glab.lol", + "message": " my_disc:0x15434add your_disc:0x296246be" + }, + { + "at": "1789227873853617", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873853661", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873853697", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873853731", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873853766", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873853809", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873853834", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873853864", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151853ms" + }, + { + "at": "1789227873853910", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +832ms" + }, + { + "at": "1789227873853947", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789227873853976", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873854005", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873854037", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873854070", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873854109", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873854148", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873854183", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873854210", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873854259", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873854289", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x15434add" + }, + { + "at": "1789227873854328", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873854354", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873854378", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873854402", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler265)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873854442", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873854481", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873854526", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873854558", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873854592", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873854619", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873854657", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +832ms" + }, + { + "at": "1789227873854693", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789227873854967", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873855036", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873855073", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855100", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x296246be" + }, + { + "at": "1789227873855122", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855143", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855173", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873855201", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873855231", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855260", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x15434add" + }, + { + "at": "1789227873855296", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855322", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855347", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873855363", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler265)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873855393", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler265)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873855424", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873855450", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873855473", + "member": "lab01.glab.lol", + "message": " my_disc:0x277d8736 your_disc:0x0" + }, + { + "at": "1789227873855503", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873855531", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873855554", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873855578", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873855601", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873855616", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873855639", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873855657", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542151853ms" + }, + { + "at": "1789227873855689", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151853ms" + }, + { + "at": "1789227873855712", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151853ms" + }, + { + "at": "1789227873855734", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873855753", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873855771", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855788", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873855809", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873855827", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855849", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873855864", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873855887", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873855909", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227873855927", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873855950", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873855967", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873855990", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873856013", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873856035", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873856056", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873856073", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873856092", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873856111", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873856133", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542151854ms" + }, + { + "at": "1789227873856160", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542151854ms" + }, + { + "at": "1789227873856181", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873856198", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873856219", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873856234", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227873856251", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873856265", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873856279", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873856302", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873856325", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873856339", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227873856356", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873856378", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873856397", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873856420", + "member": "lab01.glab.lol", + "message": "ovs|84330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873856444", + "member": "lab01.glab.lol", + "message": "ovs|84331|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227873856465", + "member": "lab01.glab.lol", + "message": "ovs|84332|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227873859876", + "member": "lab01.glab.lol", + "message": "ovs|84333|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789227873859992", + "member": "lab01.glab.lol", + "message": "ovs|84334|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789227874139693", + "member": "lab01.glab.lol", + "message": "ovs|84335|bridge|WARN|Dropped 513 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227874139803", + "member": "lab01.glab.lol", + "message": "ovs|84336|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789227874783907", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler265)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874784116", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874784138", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874784159", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874784177", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874784196", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874784210", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874784222", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +32ms" + }, + { + "at": "1789227874784246", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -928ms" + }, + { + "at": "1789227874784262", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874784274", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874784295", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874784313", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x57037ae4" + }, + { + "at": "1789227874784327", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874784339", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874784355", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874784366", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874784385", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874784402", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x277d8736" + }, + { + "at": "1789227874784419", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874784429", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874784444", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874820283", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler265)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874820359", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874820386", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874820407", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874820427", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874820446", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874820461", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874820477", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +657ms" + }, + { + "at": "1789227874820503", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -143ms" + }, + { + "at": "1789227874820524", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874820534", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874820550", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874820560", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x33a33fab" + }, + { + "at": "1789227874820570", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874820579", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874820601", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874820614", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874820624", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874820639", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xa3aaccff" + }, + { + "at": "1789227874820652", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874820666", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874820676", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874849601", + "member": "lab01.glab.lol", + "message": "ovs|84337|dpif|WARN|Dropped 1965 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227874849667", + "member": "lab01.glab.lol", + "message": "ovs|84338|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227875225028", + "member": "lab01.glab.lol", + "message": "ovs|84339|bridge|INFO|bridge br-int: added interface vethe8917453 on port 34" + }, + { + "at": "1789227875850136", + "member": "lab01.glab.lol", + "message": "ovs|84340|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227875850324", + "member": "lab01.glab.lol", + "message": "ovs|84341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227876092045", + "member": "lab01.glab.lol", + "message": "ovs|84342|poll_loop|INFO|Dropped 722 log messages in last 250 seconds (most recently, 247 seconds ago) due to excessive rate" + }, + { + "at": "1789227876092166", + "member": "lab01.glab.lol", + "message": "ovs|84343|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876092469", + "member": "lab01.glab.lol", + "message": "ovs|84344|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876093067", + "member": "lab01.glab.lol", + "message": "ovs|84345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876093475", + "member": "lab01.glab.lol", + "message": "ovs|84346|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876094184", + "member": "lab01.glab.lol", + "message": "ovs|84347|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876094690", + "member": "lab01.glab.lol", + "message": "ovs|84348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876095158", + "member": "lab01.glab.lol", + "message": "ovs|84349|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876095711", + "member": "lab01.glab.lol", + "message": "ovs|84350|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876096181", + "member": "lab01.glab.lol", + "message": "ovs|84351|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876096671", + "member": "lab01.glab.lol", + "message": "ovs|84352|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (73% CPU usage)" + }, + { + "at": "1789227876849808", + "member": "lab01.glab.lol", + "message": "ovs|84353|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227876849933", + "member": "lab01.glab.lol", + "message": "ovs|84354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227877849856", + "member": "lab01.glab.lol", + "message": "ovs|84355|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227877850152", + "member": "lab01.glab.lol", + "message": "ovs|84356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227878849960", + "member": "lab01.glab.lol", + "message": "ovs|84357|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227878850208", + "member": "lab01.glab.lol", + "message": "ovs|84358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227879849905", + "member": "lab01.glab.lol", + "message": "ovs|84359|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227879850029", + "member": "lab01.glab.lol", + "message": "ovs|84360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789227880849973", + "member": "lab01.glab.lol", + "message": "ovs|84361|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789227880850106", + "member": "lab01.glab.lol", + "message": "ovs|84362|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873737783", + "member": "lab02.glab.lol", + "message": "ovs|00214|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873738103", + "member": "lab02.glab.lol", + "message": "ovs|00215|bridge|INFO|bridge incusovn16: using datapath ID 0000c687844de948" + }, + { + "at": "1789227873738311", + "member": "lab02.glab.lol", + "message": "ovs|00216|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873740647", + "member": "lab02.glab.lol", + "message": "ovs|00217|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873740697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873740712", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873740726", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873740737", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873740747", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873740763", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873740780", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873740795", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873740805", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873740818", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873740834", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873740845", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873740856", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873740866", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873740875", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873740887", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873740899", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873740908", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873740919", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873740930", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873740941", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873740951", + "member": "lab02.glab.lol", + "message": "ovs|00218|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873740964", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873740974", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873740985", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873740995", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741004", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741014", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873741026", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873741037", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873741049", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873741059", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741069", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741080", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741091", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873741102", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741111", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741121", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741131", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741140", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741150", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741160", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741169", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741179", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873741189", + "member": "lab02.glab.lol", + "message": "ovs|00219|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741201", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741211", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741227", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741274", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741284", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741294", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128740ms" + }, + { + "at": "1789227873741304", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128740ms" + }, + { + "at": "1789227873741315", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128740ms" + }, + { + "at": "1789227873741325", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741334", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741344", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741353", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873741365", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741375", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741386", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741397", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741409", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741420", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741429", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741439", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741449", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873743978", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler261)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873744016", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler261)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873744033", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873744048", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873744063", + "member": "lab02.glab.lol", + "message": " my_disc:0x296246be your_disc:0x0" + }, + { + "at": "1789227873744076", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873744087", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873744099", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873744109", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873744120", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873744132", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873744143", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873744157", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128743ms" + }, + { + "at": "1789227873744170", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128743ms" + }, + { + "at": "1789227873744182", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128743ms" + }, + { + "at": "1789227873744193", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873744203", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873744215", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744226", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873744236", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744247", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744259", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873744270", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873744287", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744297", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227873744308", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873744320", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744331", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873744342", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873744354", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873744365", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873744375", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873744386", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873744401", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873744412", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873744426", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128743ms" + }, + { + "at": "1789227873744436", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128743ms" + }, + { + "at": "1789227873744446", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873744456", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873744466", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744476", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227873744486", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744497", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744508", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873744520", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873744531", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873744541", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227873744552", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873744565", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873744576", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873835313", + "member": "lab02.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873835363", + "member": "lab02.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789227873837095", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler261)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873837134", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler261)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227873837146", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873837156", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873837170", + "member": "lab02.glab.lol", + "message": " my_disc:0xe1085a38 your_disc:0x0" + }, + { + "at": "1789227873837181", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873837192", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873837203", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873837213", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873837222", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873837233", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873837244", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873837256", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128836ms" + }, + { + "at": "1789227873837266", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128836ms" + }, + { + "at": "1789227873837277", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128836ms" + }, + { + "at": "1789227873837291", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873837301", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873837310", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837321", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873837331", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837341", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837350", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873837360", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873837370", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837380", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227873837390", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873837403", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837413", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873837421", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873837433", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873837441", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873837451", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873837459", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873837469", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873837479", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873837488", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591128836ms" + }, + { + "at": "1789227873837497", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591128836ms" + }, + { + "at": "1789227873837506", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873837515", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873837525", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837533", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227873837542", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837551", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837559", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873837567", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873837576", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873837583", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227873837593", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873837601", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873837609", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873841091", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler261)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873841104", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler261)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873841114", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873841123", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873841131", + "member": "lab02.glab.lol", + "message": " my_disc:0xbf36e8e3 your_disc:0x0" + }, + { + "at": "1789227873841140", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873841149", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873841157", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873841166", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873841175", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873841184", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873841192", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873841200", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591128840ms" + }, + { + "at": "1789227873841210", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227873841221", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227873841230", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873841239", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873841248", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841256", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873841264", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841273", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841285", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873841293", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873841300", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841307", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873841316", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873841323", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841331", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873841338", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873841346", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873841354", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873841362", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873841369", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873841377", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873841385", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873841392", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789227873841403", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789227873841410", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873841418", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873841426", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841435", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227873841443", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841451", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841463", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873841472", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873841479", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873841487", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873841496", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873841504", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873841512", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873842905", + "member": "lab02.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873843010", + "member": "lab02.glab.lol", + "message": "ovs|00223|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 20" + }, + { + "at": "1789227874672898", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler261)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874673000", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874673029", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874673050", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874673073", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874673102", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874673124", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874673147", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +158ms" + }, + { + "at": "1789227874673170", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -832ms" + }, + { + "at": "1789227874673192", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874673214", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874673243", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874673273", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x15434add" + }, + { + "at": "1789227874673292", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874673314", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874673334", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874673355", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874673379", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874673408", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x296246be" + }, + { + "at": "1789227874673428", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874673450", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874673469", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874758219", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler261)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874758471", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874758495", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874758517", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874758543", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874758567", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874758589", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874758608", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +843ms" + }, + { + "at": "1789227874758627", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -87ms" + }, + { + "at": "1789227874758651", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874758674", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874758696", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874758717", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xff024ef1" + }, + { + "at": "1789227874758739", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874758760", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874758781", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874758800", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874758821", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874758840", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xe1085a38" + }, + { + "at": "1789227874758859", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874758880", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874758902", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874761753", + "member": "lab02.glab.lol", + "message": "ovs|00012|bfd(handler261)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874761808", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874761819", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874761828", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874761837", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874761847", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874761856", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874761864", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +510ms" + }, + { + "at": "1789227874761876", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -250ms" + }, + { + "at": "1789227874761887", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874761896", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874761907", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874761916", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x323b8422" + }, + { + "at": "1789227874761924", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874761933", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874761942", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874761951", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874761959", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874761969", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874761978", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874761986", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874761995", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873738760", + "member": "lab03.glab.lol", + "message": "ovs|00236|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873738935", + "member": "lab03.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000066e755c19444" + }, + { + "at": "1789227873738964", + "member": "lab03.glab.lol", + "message": "ovs|00238|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873741335", + "member": "lab03.glab.lol", + "message": "ovs|00239|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741398", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741422", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741444", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741461", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741477", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741495", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028739ms" + }, + { + "at": "1789227873741515", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028739ms" + }, + { + "at": "1789227873741539", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028739ms" + }, + { + "at": "1789227873741556", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741571", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741587", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741604", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227873741621", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741634", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741653", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741670", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741686", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741702", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873741719", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873741736", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741751", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873741768", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873749097", + "member": "lab03.glab.lol", + "message": "ovs|00240|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873749159", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873749174", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873749185", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873749195", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873749206", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873749217", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028747ms" + }, + { + "at": "1789227873749228", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028747ms" + }, + { + "at": "1789227873749239", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028747ms" + }, + { + "at": "1789227873749251", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873749262", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873749273", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749282", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227873749294", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873749305", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749315", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873749326", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873749335", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749345", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873749356", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873749368", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749378", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873749389", + "member": "lab03.glab.lol", + "message": "ovs|00241|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873749403", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873749415", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873749424", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873749435", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873749445", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873749456", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028747ms" + }, + { + "at": "1789227873749465", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50028747ms" + }, + { + "at": "1789227873749475", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50028747ms" + }, + { + "at": "1789227873749486", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873749497", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873749506", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749516", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873749532", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873749543", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749552", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873749563", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873749578", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873749587", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873749598", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873749610", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873749620", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873836271", + "member": "lab03.glab.lol", + "message": "ovs|00242|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873836530", + "member": "lab03.glab.lol", + "message": "ovs|00243|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789227873843804", + "member": "lab03.glab.lol", + "message": "ovs|00244|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873843888", + "member": "lab03.glab.lol", + "message": "ovs|00245|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 31" + }, + { + "at": "1789227873844239", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler265)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873844326", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler265)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873844365", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873844400", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873844424", + "member": "lab03.glab.lol", + "message": " my_disc:0x57037ae4 your_disc:0x277d8736" + }, + { + "at": "1789227873844448", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873844476", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873844499", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873844523", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873844545", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873844568", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873844596", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873844622", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50028842ms" + }, + { + "at": "1789227873844647", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +927ms" + }, + { + "at": "1789227873844678", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227873844703", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873844725", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873844753", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873844781", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873844804", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873844826", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873844853", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873844875", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873844898", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873844922", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x57037ae4" + }, + { + "at": "1789227873844946", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873844971", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873844993", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873845020", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler265)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873845044", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873845079", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873845102", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873845124", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873845144", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873845165", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873845189", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +927ms" + }, + { + "at": "1789227873845212", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789227873845235", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873845297", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873845320", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873845344", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x277d8736" + }, + { + "at": "1789227873845366", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873845386", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873845407", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873845429", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873845450", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873845472", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x57037ae4" + }, + { + "at": "1789227873845493", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873845519", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873845541", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874496814", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler272)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227874496927", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler272)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789227874496968", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227874497006", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227874497031", + "member": "lab03.glab.lol", + "message": " my_disc:0xbeb6ee15 your_disc:0x42213715" + }, + { + "at": "1789227874497058", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227874497098", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227874497124", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227874497151", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874497181", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874497208", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874497231", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874497260", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50029494ms" + }, + { + "at": "1789227874497286", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +195ms" + }, + { + "at": "1789227874497315", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -755ms" + }, + { + "at": "1789227874497338", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874497362", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874497384", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497407", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227874497436", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874497466", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874497497", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874497523", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874497545", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497569", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874497594", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227874497617", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874497645", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874497666", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler272)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874497695", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874497724", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874497747", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874497771", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874497794", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874497818", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874497841", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +195ms" + }, + { + "at": "1789227874497866", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -755ms" + }, + { + "at": "1789227874497890", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874497920", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874497944", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874497972", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x42213715" + }, + { + "at": "1789227874497999", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874498021", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874498045", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874498087", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874498114", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874498138", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874498162", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874498187", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874498212", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874512379", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler272)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227874512490", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler272)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227874512532", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227874512561", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227874512586", + "member": "lab03.glab.lol", + "message": " my_disc:0x323b8422 your_disc:0xbf36e8e3" + }, + { + "at": "1789227874512614", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227874512644", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227874512675", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227874512701", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874512727", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874512758", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874512786", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874512810", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50029510ms" + }, + { + "at": "1789227874512838", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +249ms" + }, + { + "at": "1789227874512862", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -671ms" + }, + { + "at": "1789227874512888", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874512911", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874512935", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874512958", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874512983", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513009", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513036", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874513057", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874513090", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513126", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x323b8422" + }, + { + "at": "1789227874513152", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227874513172", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513195", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874513220", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler272)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874513247", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874513271", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874513292", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874513313", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874513335", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874513358", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874513389", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +249ms" + }, + { + "at": "1789227874513410", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -671ms" + }, + { + "at": "1789227874513469", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874513499", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227874513523", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513546", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbf36e8e3" + }, + { + "at": "1789227874513568", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513591", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513616", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874513639", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227874513659", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874513682", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x323b8422" + }, + { + "at": "1789227874513704", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874513725", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874513748", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227876199497", + "member": "lab03.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge br-int: added interface veth3e3d489f on port 32" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789227873618063", + "member": "nas01.glab.lol", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789227873618214", + "member": "nas01.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 00001e098d56774c" + }, + { + "at": "1789227873618232", + "member": "nas01.glab.lol", + "message": "ovs|00220|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789227873715222", + "member": "nas01.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789227873715390", + "member": "nas01.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789227873722901", + "member": "nas01.glab.lol", + "message": "ovs|00223|bridge|INFO|bridge incusovn16: added interface patch-incus-net35-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789227873723034", + "member": "nas01.glab.lol", + "message": "ovs|00224|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net35-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789227873741657", + "member": "nas01.glab.lol", + "message": "ovs|00225|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873741688", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873741713", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873741735", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873741750", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873741767", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873741784", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255605ms" + }, + { + "at": "1789227873741801", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255605ms" + }, + { + "at": "1789227873741817", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255605ms" + }, + { + "at": "1789227873741833", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873741850", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873741867", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741882", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873741899", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873741929", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873741945", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873741963", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873741978", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873741995", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873742011", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873742030", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873742045", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873742061", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor289)|INFO|monitor thread created" + }, + { + "at": "1789227873746586", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler273)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873746610", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler273)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789227873746628", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789227873746651", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873746705", + "member": "nas01.glab.lol", + "message": " my_disc:0x42213715 your_disc:0x0" + }, + { + "at": "1789227873746728", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873746751", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873746766", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873746781", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873746795", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873746810", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873746824", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873746850", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255610ms" + }, + { + "at": "1789227873746866", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +755ms" + }, + { + "at": "1789227873746883", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227873746905", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873746922", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873746940", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873746955", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873746975", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873746996", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747020", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747037", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873747063", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747084", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227873747108", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873747130", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747151", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873747205", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747227", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747243", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747258", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747272", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747301", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873747315", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873747334", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +755ms" + }, + { + "at": "1789227873747348", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789227873747365", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873747383", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873747398", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747412", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227873747426", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747444", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747461", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747475", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789227873747490", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747504", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227873747519", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747538", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873747553", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873747568", + "member": "nas01.glab.lol", + "message": "ovs|00226|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747583", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747600", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747614", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747629", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747643", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873747658", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255611ms" + }, + { + "at": "1789227873747672", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255611ms" + }, + { + "at": "1789227873747692", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255611ms" + }, + { + "at": "1789227873747708", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873747722", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873747735", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747750", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873747765", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873747780", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873747795", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873747809", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873747823", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873747838", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873747853", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873747867", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873747886", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873747900", + "member": "nas01.glab.lol", + "message": "ovs|00227|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873747919", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873747935", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873747948", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873747962", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873747978", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789227873747993", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255611ms" + }, + { + "at": "1789227873748008", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591255611ms" + }, + { + "at": "1789227873748023", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591255611ms" + }, + { + "at": "1789227873748037", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873748052", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789227873748066", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873748080", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873748096", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873748110", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789227873748124", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873748141", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789227873748158", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873748173", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789227873748193", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873748208", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789227873748222", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789227873846849", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler273)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873847004", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler273)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789227873847026", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873847049", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873847065", + "member": "nas01.glab.lol", + "message": " my_disc:0xff024ef1 your_disc:0xe1085a38" + }, + { + "at": "1789227873847083", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873847098", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873847114", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873847135", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873847150", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873847165", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873847180", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873847196", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255710ms" + }, + { + "at": "1789227873847211", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +816ms" + }, + { + "at": "1789227873847228", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227873847255", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873847269", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873847282", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847296", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873847311", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847328", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847346", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873847360", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873847379", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847395", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff024ef1" + }, + { + "at": "1789227873847411", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873847426", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847443", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873847457", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler273)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873847474", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873847489", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873847503", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873847517", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873847531", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873847545", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873847560", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +816ms" + }, + { + "at": "1789227873847575", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -4ms" + }, + { + "at": "1789227873847589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873847604", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873847619", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847634", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xe1085a38" + }, + { + "at": "1789227873847649", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847663", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847676", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873847691", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873847704", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873847719", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xff024ef1" + }, + { + "at": "1789227873847733", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873847755", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873847770", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873849210", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler273)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789227873849345", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler273)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789227873849365", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789227873849376", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789227873849387", + "member": "nas01.glab.lol", + "message": " my_disc:0x33a33fab your_disc:0xa3aaccff" + }, + { + "at": "1789227873849398", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789227873849408", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789227873849418", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789227873849432", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849443", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873849454", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873849465", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873849475", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591255713ms" + }, + { + "at": "1789227873849488", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +963ms" + }, + { + "at": "1789227873849500", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227873849515", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873849525", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873849536", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849547", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873849558", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849570", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849581", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873849592", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873849602", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849612", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x33a33fab" + }, + { + "at": "1789227873849629", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789227873849639", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849650", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227873849661", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler273)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227873849674", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227873849685", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227873849698", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227873849709", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227873849718", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227873849737", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227873849747", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +963ms" + }, + { + "at": "1789227873849758", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -7ms" + }, + { + "at": "1789227873849768", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227873849780", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789227873849791", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849801", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xa3aaccff" + }, + { + "at": "1789227873849811", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849821", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849832", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227873849841", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789227873849854", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227873849887", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x33a33fab" + }, + { + "at": "1789227873849907", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789227873849939", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227873849948", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789227874697395", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler273)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789227874697803", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789227874697827", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789227874697853", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789227874697888", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789227874697965", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789227874698000", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789227874698034", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +634ms" + }, + { + "at": "1789227874698068", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -196ms" + }, + { + "at": "1789227874698098", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789227874698125", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789227874698163", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789227874698191", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xbeb6ee15" + }, + { + "at": "1789227874698219", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789227874698247", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874698276", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789227874698303", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789227874698338", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789227874698365", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x42213715" + }, + { + "at": "1789227874698395", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789227874698422", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789227874698451", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.debug.log new file mode 100644 index 0000000..5b1ddff --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:44:31-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.log new file mode 100644 index 0000000..df37e07 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-create.log @@ -0,0 +1,543 @@ +time="2026-09-12T15:44:31Z" level=debug msg="[nas01] Event listener server handler started" id=4b22689c-38f4-4aa9-93cd-b30adbc2f168 local="10.10.10.14:8443" remote="100.122.142.76:55176" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55196" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55197" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55198" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55199" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55200" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55201" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55202" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55203" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55204" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55205" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:97:88:42" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.35 +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net35 driver=ovn memberID=1 network=default priority=28692 project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.25669919s +time="2026-09-12T15:44:33Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55206" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55207" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55208" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55209" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55210" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55211" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55212" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55213" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55214" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Event listener server handler started" id=0cb1ad21-8ece-4289-9e6e-5a0ed72634d9 local="10.10.10.14:8443" remote="100.122.142.76:55214" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55215" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=a8bcd33c-2837-4842-bebf-7d4736a7169d project=image-build +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=a8bcd33c-2837-4842-bebf-7d4736a7169d project=image-build +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55216" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Event listener server handler started" id=45055219-66b2-4423-b0ae-4a1f4004689b local="10.10.10.14:8443" remote="100.122.142.76:55216" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55217" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=edef56e7-3d3e-4b41-a2ed-7042d3ee0365 project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=edef56e7-3d3e-4b41-a2ed-7042d3ee0365 project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55218" method=GET protocol=tls url="/1.0/operations/edef56e7-3d3e-4b41-a2ed-7042d3ee0365?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=edef56e7-3d3e-4b41-a2ed-7042d3ee0365 project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=edef56e7-3d3e-4b41-a2ed-7042d3ee0365 project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Event listener server handler stopped" listener=0cb1ad21-8ece-4289-9e6e-5a0ed72634d9 local="10.10.10.14:8443" remote="100.122.142.76:55214" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Event listener server handler stopped" listener=45055219-66b2-4423-b0ae-4a1f4004689b local="10.10.10.14:8443" remote="100.122.142.76:55216" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55219" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55220" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"a8f68836-5eb6-465e-a4e6-ad3e188a177a\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:44:34.589513052Z\",\n\t\t\"updated_at\": \"2026-09-12T15:44:34.589513052Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55221" method=GET protocol=tls url="/1.0/operations/a8f68836-5eb6-465e-a4e6-ad3e188a177a/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:34Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:44:34Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55222" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55223" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55224" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Event listener server handler started" id=98f0118e-b6c9-4bde-a6bf-13fd5bf36ac7 local="10.10.10.14:8443" remote="100.122.142.76:55224" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55225" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:35Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 15:44:34.604286256 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55226" method=GET protocol=tls url="/1.0/operations/d8ba6d21-9f30-4e5a-bcaf-4470e27372ce?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 15:44:34.604286256 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Event listener server handler stopped" listener=98f0118e-b6c9-4bde-a6bf-13fd5bf36ac7 local="10.10.10.14:8443" remote="100.122.142.76:55224" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55227" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55228" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"a30f36cf-711f-4953-be0e-6a06761338b0\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:44:35.650041282Z\",\n\t\t\"updated_at\": \"2026-09-12T15:44:35.650041282Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55229" method=GET protocol=tls url="/1.0/operations/a30f36cf-711f-4953-be0e-6a06761338b0/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:35Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:44:35Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.64 network=default project=ac-ovn-spike +time="2026-09-12T15:44:35Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55230" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55231" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55232" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Event listener server handler started" id=d97a3d39-d57f-43f2-b206-c37c6b1f89f7 local="10.10.10.14:8443" remote="100.122.142.76:55232" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55233" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:36Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 15:44:35.69990885 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55234" method=GET protocol=tls url="/1.0/operations/1bc48b90-d75d-4a2a-aa55-0296c1d4ef47?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:36Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 15:44:35.69990885 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d97a3d39-d57f-43f2-b206-c37c6b1f89f7 local="10.10.10.14:8443" remote="100.122.142.76:55232" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55235" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55236" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55237" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55238" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55239" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55240" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55241" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55242" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:36Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55243" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55244" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Event listener server handler started" id=1a53e1a3-0171-4a57-a6e3-d88f19892adf local="10.10.10.14:8443" remote="100.122.142.76:55244" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55245" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55246" method=GET protocol=tls url="/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=894bb60beead4bbaa3f3e6ff70e48040388b83a4057e1835c9edb6c6bd9b49e0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55246" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=894bb60beead4bbaa3f3e6ff70e48040388b83a4057e1835c9edb6c6bd9b49e0" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55247" method=GET protocol=tls url="/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=2426a64a6e95101043b6118149a41cb38228dce2395f1b9531a37e7f1464c2d6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55247" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=2426a64a6e95101043b6118149a41cb38228dce2395f1b9531a37e7f1464c2d6" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55248" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=ab560d9fc9ee0049a52b0bdc9438bb162aa43d7e767cdc62c3aa3a9be025ece8" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55248" method=GET protocol=tls url="/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=ab560d9fc9ee0049a52b0bdc9438bb162aa43d7e767cdc62c3aa3a9be025ece8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55249" method=GET protocol=tls url="/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=08f7a1b20d869de78470c6c30507b533110dfed8ac52f94ab54de0b7cd731c64" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55249" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2/websocket?secret=08f7a1b20d869de78470c6c30507b533110dfed8ac52f94ab54de0b7cd731c64" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55247" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55250" method=GET protocol=tls url="/1.0/operations/f6e4ca2e-2cb7-4aa8-9a1b-f2c6073996d2?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55249" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55246" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55248" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Event listener server handler stopped" listener=1a53e1a3-0171-4a57-a6e3-d88f19892adf local="10.10.10.14:8443" remote="100.122.142.76:55244" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55251" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:37Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55252" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55253" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55254" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Event listener server handler started" id=936a3420-a50e-458e-a35b-57fd5a856f61 local="10.10.10.14:8443" remote="100.122.142.76:55254" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55255" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55256" method=GET protocol=tls url="/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=fdb3fbd3d6e9fe9801d4fbe6ab59e25d2435f41dc46cf26260436a52603fad99" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55256" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=fdb3fbd3d6e9fe9801d4fbe6ab59e25d2435f41dc46cf26260436a52603fad99" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55257" method=GET protocol=tls url="/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=cf00d9cb731cf5a169ef03ddb75a94ade4f1f8d19528e294cce65a66e9f2e459" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55257" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=cf00d9cb731cf5a169ef03ddb75a94ade4f1f8d19528e294cce65a66e9f2e459" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55258" method=GET protocol=tls url="/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=47e71eccddd6d8fedb0806ff9e5e912d554787cde1fe0e564c1d6009f1242dd9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55258" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=47e71eccddd6d8fedb0806ff9e5e912d554787cde1fe0e564c1d6009f1242dd9" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55259" method=GET protocol=tls url="/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=c49d0402968722096a3cc710e3aa1fceb352a7b8881766ed58e77d9dfbd03ed0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55259" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b/websocket?secret=c49d0402968722096a3cc710e3aa1fceb352a7b8881766ed58e77d9dfbd03ed0" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55257" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55260" method=GET protocol=tls url="/1.0/operations/e010a2a6-eb41-495e-a2d9-349e2fcadb2b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55256" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55259" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55258" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Event listener server handler stopped" listener=936a3420-a50e-458e-a35b-57fd5a856f61 local="10.10.10.14:8443" remote="100.122.142.76:55254" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55261" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55262" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Event listener server handler started" id=bd1a5370-13ad-42df-a213-0cc12d235347 local="10.10.10.14:8443" remote="100.122.142.76:55262" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55263" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55264" method=GET protocol=tls url="/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=89c04b2bd910488b9ece6e864ea0dfd6d5786710009d9c872505a3e921ff31a7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55264" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=89c04b2bd910488b9ece6e864ea0dfd6d5786710009d9c872505a3e921ff31a7" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55265" method=GET protocol=tls url="/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=522ad66bf7983e351f2c200e75849ee3badc99e4e668e00bbe14ff4da75357ae" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55265" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=522ad66bf7983e351f2c200e75849ee3badc99e4e668e00bbe14ff4da75357ae" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55266" method=GET protocol=tls url="/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=3bc42a4e3018c9a6614a1681dc77c3d93d548ec05bf074e5e497faabb971365a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55266" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=3bc42a4e3018c9a6614a1681dc77c3d93d548ec05bf074e5e497faabb971365a" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55267" method=GET protocol=tls url="/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=7aaa592ade63d2b0d1fb479842b1763186d8210577ff5c97e2b2c745f573dc84" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55267" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034/websocket?secret=7aaa592ade63d2b0d1fb479842b1763186d8210577ff5c97e2b2c745f573dc84" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55265" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55268" method=GET protocol=tls url="/1.0/operations/48b9baa9-8fd6-43c1-9bfa-92c1bb96a034?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55264" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55266" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55267" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Event listener server handler stopped" listener=bd1a5370-13ad-42df-a213-0cc12d235347 local="10.10.10.14:8443" remote="100.122.142.76:55262" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55269" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55270" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:44:38Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55271" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55272" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Event listener server handler started" id=2e90506c-11a6-4d55-914d-b9b8eff86ca5 local="10.10.10.14:8443" remote="100.122.142.76:55272" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55273" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55274" method=GET protocol=tls url="/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=a34bfed5efcbad34aef2ace8129de32ad326ed6568e46ba9e85fe3419c578f4d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55274" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=a34bfed5efcbad34aef2ace8129de32ad326ed6568e46ba9e85fe3419c578f4d" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55275" method=GET protocol=tls url="/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=4a46fec277aa62c7f1fb59fe52ac5272a204d111b021248e19f1e879d4133a9b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=4a46fec277aa62c7f1fb59fe52ac5272a204d111b021248e19f1e879d4133a9b" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55275" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55276" method=GET protocol=tls url="/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=8e96de1ea5558ed560bb1681ec80831eb73311f28986867f13790f23daad0a08" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55276" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=8e96de1ea5558ed560bb1681ec80831eb73311f28986867f13790f23daad0a08" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55277" method=GET protocol=tls url="/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=8cc5440ba25d90aad63c5dfa6cce103a990846025ab359018f2c4b5b4ff32492" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516/websocket?secret=8cc5440ba25d90aad63c5dfa6cce103a990846025ab359018f2c4b5b4ff32492" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55277" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55275" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55278" method=GET protocol=tls url="/1.0/operations/8bca93f5-571f-4607-9726-5c6af03b8516?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55277" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55274" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55276" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2e90506c-11a6-4d55-914d-b9b8eff86ca5 local="10.10.10.14:8443" remote="100.122.142.76:55272" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55279" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55280" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Event listener server handler started" id=44df13a8-7381-4315-a0da-9b2515be7361 local="10.10.10.14:8443" remote="100.122.142.76:55280" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55281" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55282" method=GET protocol=tls url="/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=d602e6973e464c9fc9aa59eb629327800490c164e5d78133857a7269d21c1e0a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=d602e6973e464c9fc9aa59eb629327800490c164e5d78133857a7269d21c1e0a" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55282" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55283" method=GET protocol=tls url="/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=8c70ba98a5604d32e93e9c6b858d471eeab038f4498d895c271a7eec91810435" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=8c70ba98a5604d32e93e9c6b858d471eeab038f4498d895c271a7eec91810435" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55283" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55284" method=GET protocol=tls url="/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=b27f8262fbbd6260b21033b9e8b564ef5e0e9a4efd7d8f5c525234930cb58092" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55284" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=b27f8262fbbd6260b21033b9e8b564ef5e0e9a4efd7d8f5c525234930cb58092" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55285" method=GET protocol=tls url="/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=50bf53b6ea196968195822ed5ea33af4aeec9c5572c8a66dfb71b659d77af8a0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55285" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120/websocket?secret=50bf53b6ea196968195822ed5ea33af4aeec9c5572c8a66dfb71b659d77af8a0" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55283" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55286" method=GET protocol=tls url="/1.0/operations/450310e0-d5fd-44e8-ab84-3a1403d4a120?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55282" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55284" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55285" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Event listener server handler stopped" listener=44df13a8-7381-4315-a0da-9b2515be7361 local="10.10.10.14:8443" remote="100.122.142.76:55280" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55287" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55288" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Event listener server handler started" id=29550f8d-2c43-44ae-8615-cec0af8091eb local="10.10.10.14:8443" remote="100.122.142.76:55288" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55289" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55290" method=GET protocol=tls url="/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=46551704134b5904d7c5d4aed25c237a8adc1d1c26d125c4776ee70b9c9e9e58" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55290" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=46551704134b5904d7c5d4aed25c237a8adc1d1c26d125c4776ee70b9c9e9e58" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55291" method=GET protocol=tls url="/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=1b3df536d75bcc3c567aca3c477adfc9fe85e8d73058c59b0aefbdc27a015517" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=1b3df536d75bcc3c567aca3c477adfc9fe85e8d73058c59b0aefbdc27a015517" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55291" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55292" method=GET protocol=tls url="/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=d99d3808c7a5f02166cba28e6bf9ff1c5227b4b003cf236fa150747f6e1195a9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55292" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=d99d3808c7a5f02166cba28e6bf9ff1c5227b4b003cf236fa150747f6e1195a9" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55293" method=GET protocol=tls url="/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=7bc0dd8aa97174165cef1459ac0d7fb275e87078a89d98213002d64e5a9fd83a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2/websocket?secret=7bc0dd8aa97174165cef1459ac0d7fb275e87078a89d98213002d64e5a9fd83a" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:55293" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55291" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55294" method=GET protocol=tls url="/1.0/operations/e600151d-1221-4769-9d8c-8c7405e4cbb2?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55293" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55290" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:55292" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=29550f8d-2c43-44ae-8615-cec0af8091eb local="10.10.10.14:8443" remote="100.122.142.76:55288" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55295" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55296" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Event listener server handler started" id=fdd42d4d-6c89-45b3-9347-aeafdac0eb97 local="10.10.10.14:8443" remote="100.122.142.76:55296" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55297" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55298" method=GET protocol=tls url="/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=3179947b006a49a2eb79a708ef59957799d1c85e50d45a76e6a3f34f3d6eff00" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55298" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=3179947b006a49a2eb79a708ef59957799d1c85e50d45a76e6a3f34f3d6eff00" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55299" method=GET protocol=tls url="/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=07d989709293d69eccd20c3dd7d4988663d6bd0cf9945dff592a19d86ee7d42c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=07d989709293d69eccd20c3dd7d4988663d6bd0cf9945dff592a19d86ee7d42c" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55299" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55300" method=GET protocol=tls url="/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=8ab3ab9b3891ca6d8f0a04770c395a454d0db245d0c40a47b1c1c27c4568b596" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55300" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=8ab3ab9b3891ca6d8f0a04770c395a454d0db245d0c40a47b1c1c27c4568b596" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55301" method=GET protocol=tls url="/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=607bb7a13f84d1c84f88d18f7fc5ba76bbcd4d92bc77416ea0248bcd2acc2cd4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:55301" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381/websocket?secret=607bb7a13f84d1c84f88d18f7fc5ba76bbcd4d92bc77416ea0248bcd2acc2cd4" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55299" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55302" method=GET protocol=tls url="/1.0/operations/45ff48ef-b349-47fb-8973-72776baa8381?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55298" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55301" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:55300" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=fdd42d4d-6c89-45b3-9347-aeafdac0eb97 local="10.10.10.14:8443" remote="100.122.142.76:55296" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55303" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55304" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:44:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.debug.log new file mode 100644 index 0000000..94c9fe2 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:44:58-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.log new file mode 100644 index 0000000..59b3b1d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/monitor-delete.log @@ -0,0 +1,166 @@ +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Event listener server handler started" id=4a7cac61-e4da-45a2-84ee-3d4bb71ea4a5 local="10.10.10.14:8443" remote="100.122.142.76:55482" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55483" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55484" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55485" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55486" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:44:34.604286256Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:44:35.453504088Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:44:35.69990885Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:44:36.279137454Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55487" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55488" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55489" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Event listener server handler started" id=a6944d29-3865-4e31-ad5d-4de493057373 local="10.10.10.14:8443" remote="100.122.142.76:55489" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55490" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 15:44:34.604286256 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:44:35.453504088 +0000 UTC" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55491" method=GET protocol=tls url="/1.0/operations/e138b752-6472-4229-bdd3-d3cb2c000081?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55495" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 15:44:34.604286256 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:44:35.453504088 +0000 UTC" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55496" method=GET protocol=tls url="/1.0/operations/44046933-f5a9-40d7-96c2-ef592ac0431c?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 15:44:34.604286256 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:44:35.453504088 +0000 UTC" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a6944d29-3865-4e31-ad5d-4de493057373 local="10.10.10.14:8443" remote="100.122.142.76:55489" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55497" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55498" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55499" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Event listener server handler started" id=d6f103a9-3753-4ad7-9696-1d19cfc81c9b local="10.10.10.14:8443" remote="100.122.142.76:55499" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55500" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 15:44:35.69990885 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:44:36.279137454 +0000 UTC" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55501" method=GET protocol=tls url="/1.0/operations/742395ad-2a1f-4d6f-955a-c954e0980b47?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:44:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55502" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:00Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 15:44:35.69990885 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:44:36.279137454 +0000 UTC" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55503" method=GET protocol=tls url="/1.0/operations/8fc5e740-68bd-42bf-b5b3-b4c642607e62?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 15:44:35.69990885 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:44:36.279137454 +0000 UTC" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d6f103a9-3753-4ad7-9696-1d19cfc81c9b local="10.10.10.14:8443" remote="100.122.142.76:55499" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55504" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55505" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55506" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55507" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55508" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55509" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55510" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55511" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55512" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55513" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55514" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55515" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55516" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55517" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55518" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55519" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55520" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Event listener server handler started" id=5e6d092a-2532-43a6-8c40-a4921b29598d local="10.10.10.14:8443" remote="100.122.142.76:55520" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55521" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=9894ff56-f5f1-4acc-b4ef-4c990baf54a4 project=ac-ovn-spike +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=9894ff56-f5f1-4acc-b4ef-4c990baf54a4 project=ac-ovn-spike +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=9894ff56-f5f1-4acc-b4ef-4c990baf54a4 project=ac-ovn-spike +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55522" method=GET protocol=tls url="/1.0/operations/9894ff56-f5f1-4acc-b4ef-4c990baf54a4?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=5e6d092a-2532-43a6-8c40-a4921b29598d local="10.10.10.14:8443" remote="100.122.142.76:55520" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55523" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:55525" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:45:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/probe.stdout.txt new file mode 100644 index 0000000..bcaee3d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/probe.stdout.txt @@ -0,0 +1,136 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.086 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.086 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"76e6d429-e43e-4b22-be38-2fb31893a6d1","volatile.eth0.host_name":"vethe8917453","volatile.eth0.hwaddr":"10:66:6a:3d:55:e6","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"ae26d44c-9692-4d26-9d00-43f1b7a21ed0","volatile.uuid.generation":"ae26d44c-9692-4d26-9d00-43f1b7a21ed0"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:44:34.604286256Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"76e6d429-e43e-4b22-be38-2fb31893a6d1","volatile.eth0.host_name":"vethe8917453","volatile.eth0.hwaddr":"10:66:6a:3d:55:e6","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"ae26d44c-9692-4d26-9d00-43f1b7a21ed0","volatile.uuid.generation":"ae26d44c-9692-4d26-9d00-43f1b7a21ed0"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:44:35.453504088Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9863168,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe3d:55e6","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:3d:55:e6","host_name":"vethe8917453","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4177784,"processes":4,"cpu":{"usage":525974000,"allocated_time":24000000000},"started_at":"2026-09-12T15:44:34.470000028Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"39ff0468-0864-413e-89cc-3fc5368af7e0","volatile.eth0.host_name":"veth3e3d489f","volatile.eth0.hwaddr":"10:66:6a:02:c1:d4","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"2e740595-2f8a-44dc-853a-ff4b7c226485","volatile.uuid.generation":"2e740595-2f8a-44dc-853a-ff4b7c226485"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:44:35.69990885Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"39ff0468-0864-413e-89cc-3fc5368af7e0","volatile.eth0.host_name":"veth3e3d489f","volatile.eth0.hwaddr":"10:66:6a:02:c1:d4","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"2e740595-2f8a-44dc-853a-ff4b7c226485","volatile.uuid.generation":"2e740595-2f8a-44dc-853a-ff4b7c226485"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:44:36.279137454Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11436032,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe02:c1d4","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:02:c1:d4","host_name":"veth3e3d489f","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":35431,"processes":4,"cpu":{"usage":508698000,"allocated_time":24000000000},"started_at":"2026-09-12T15:44:36.289999961Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.359 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.243 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.220 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.029 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.907 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.318 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.318/0.751/1.029 ms +elapsed_seconds=2.292 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.132 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.826 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.468 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.468/0.808/1.132 ms +elapsed_seconds=2.253 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.051 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.456 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.732 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.732/1.413/2.051 ms +elapsed_seconds=2.329 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.879 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.331 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.857 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.857/1.355/1.879 ms +elapsed_seconds=2.327 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +Non-authoritative answer: +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +elapsed_seconds=0.423 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.237 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.376 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.316 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.025 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.198354 bytes_per_second=504149147 +elapsed_seconds=0.433 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.503 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.120895 bytes_per_second=827164067 +elapsed_seconds=0.350 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.508 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/tcpdump-arp.log new file mode 100644 index 0000000..c6cfb7b --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +15:44:42.683025 10:66:6a:97:88:42 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +15:44:50.684537 10:66:6a:97:88:42 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/topology.jsonl new file mode 100644 index 0000000..b76ac88 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-4/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.083, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.127, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.59, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.252, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.473, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:44:34.589513052Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"a8f68836-5eb6-465e-a4e6-ad3e188a177a\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:44:34.589513052Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.597, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.428, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:44:35.650041282Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"a30f36cf-711f-4953-be0e-6a06761338b0\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:44:35.650041282Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.372, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.242, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 185485000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 7102464,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe3d:55e6\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"vethe8917453\",\n\t\t\t\"hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4177784,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:44:34.470000028Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.204, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 130361000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6275072,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe02:c1d4\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"veth3e3d489f\",\n\t\t\t\"hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 35431,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:44:36.289999961Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.083, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t},\n\t\"created_at\": \"2026-09-12T15:44:34.604286256Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:44:35.453504088Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t},\n\t\"created_at\": \"2026-09-12T15:44:35.69990885Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:44:36.279137454Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.77, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.713 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.713/1.713/1.713 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.331, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.208, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.29, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.369, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-iv38kf02/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.222, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.292, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.583, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.111312 seconds, 856.8MB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.619, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.025178 seconds, 3.7GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.198, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.185, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:44:34.604286256Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"76e6d429-e43e-4b22-be38-2fb31893a6d1\",\n\t\t\t\"volatile.eth0.host_name\": \"vethe8917453\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:3d:55:e6\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\",\n\t\t\t\"volatile.uuid.generation\": \"ae26d44c-9692-4d26-9d00-43f1b7a21ed0\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:44:35.453504088Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:44:35.69990885Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ff0468-0864-413e-89cc-3fc5368af7e0\",\n\t\t\t\"volatile.eth0.host_name\": \"veth3e3d489f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:c1:d4\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\",\n\t\t\t\"volatile.uuid.generation\": \"2e740595-2f8a-44dc-853a-ff4b7c226485\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:44:36.279137454Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.051, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.176, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.117, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.081, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.144, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.272, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.081, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T15:44:35.730867365Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T15:44:34.466755317Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.136, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.091, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/commands.jsonl new file mode 100644 index 0000000..e9c38f6 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.094, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:49:01.356381+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.371, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:49:01.728244+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.208, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T15:49:01.944329+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 24918, "ready": true, "ready_signal": "time=\"2026-09-12T08:49:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:49:02.032381+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/topology.jsonl", "create"], "seconds": 7.972, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.56,\n \"first_cross_member_ping_seconds\": 2.868,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:10.005304+00:00"} +{"capture": "monitor-create", "pid": 24918, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.log", "ready_signal": "time=\"2026-09-12T08:49:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:49:10.010728+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.082, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:10.093395+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.087, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:fa:34:71 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:b5:a6:1d |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:10.181337+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.129, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch e88c8df6-ece6-47fd-a7fe-5b4f27b757a6 (incus-net36-ls-int)\n port incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0\n addresses: [\"10:66:6a:fa:34:71 dynamic\"]\n port incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0\n addresses: [\"10:66:6a:b5:a6:1d dynamic\"]\n port incus-net36-ls-int-lsp-router\n type: router\n router-port: incus-net36-lr-lrp-int\nswitch 2eb3d377-43ac-4726-9d9e-38b2eacd0a32 (incus-net36-ls-ext)\n port incus-net36-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net36-ls-ext-lsp-router\n type: router\n router-port: incus-net36-lr-lrp-ext\nrouter bc73d56b-f557-4331-90a4-674d5b5358d8 (incus-net36-lr)\n port incus-net36-lr-lrp-int\n mac: \"10:66:6a:ef:03:ee\"\n ipv6-lla: \"fe80::1266:6aff:feef:3ee\"\n networks: [\"10.253.73.1/24\"]\n port incus-net36-lr-lrp-ext\n mac: \"10:66:6a:ef:03:ee\"\n ipv6-lla: \"fe80::1266:6aff:feef:3ee\"\n networks: [\"10.10.40.64/24\"]\n nat d1708fa6-e54a-418c-8898-e6418433f6ab\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net36-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : d14f4591-3990-4964-9c05-9c0cee5828be\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ef:03:ee\"\nname : incus-net36-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : fd00ec3f-deb9-4bf5-9d44-e57633fe2062\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ef:03:ee\"\nname : incus-net36-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 2bf3bac8-cfa3-4a1d-84bb-924f1d103157\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : 3316399c-503f-4e27-87f2-a52de668b028\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 9f453b2e-04c6-416c-8ded-750b1a34dfc4\nlogical_port : cr-incus-net36-lr-lrp-ext\nmac : [\"10:66:6a:ef:03:ee 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net36-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e\nexternal_ids : {}\nha_chassis : [35cd8d65-8ba5-4f8b-9266-91a6abef3a86, 75dd6966-985e-48f4-bdd4-bfb54d363e6f, 84eaad05-4254-4156-99ab-8262e0bc85e0, bd15f386-184e-46d8-b32f-0dd0b68470df]\nname : incus-net36\n=== ovn-nbctl list HA_Chassis ===\n_uuid : 84eaad05-4254-4156-99ab-8262e0bc85e0\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 13433\n\n_uuid : 35cd8d65-8ba5-4f8b-9266-91a6abef3a86\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 28146\n\n_uuid : bd15f386-184e-46d8-b32f-0dd0b68470df\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 29916\n\n_uuid : 75dd6966-985e-48f4-bdd4-bfb54d363e6f\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 6914\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:49:10.311098+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.293, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee DELAY \n", "stderr": "", "error": null, "at": "2026-09-12T15:49:10.604254+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.325, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144049088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84417|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144049912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84418|bridge|INFO|bridge incusovn16: using datapath ID 00002e04465f3d4b\"\n },\n {\n \"at\": \"1789228144049944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84419|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144052199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84420|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144052298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144052339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144052365\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144052386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144052410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144052434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052493\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052522\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144052541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144052559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144052578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144052607\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144052623\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144052670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144052692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144052710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144052728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144052808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84421|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144052837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144052858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144052873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144052890\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144052908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144052927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144053002\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144053064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144053079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144053122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144053179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053197\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144053244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144053266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84422|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144053295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144053317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144053343\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144053364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144053387\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144053401\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053418\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144053475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053517\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144053551\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144053568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144053605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053620\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144053657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144147061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84423|dpif|WARN|Dropped 981 log messages in last 244 seconds (most recently, 243 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228144147147\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84424|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144147186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84425|bridge|WARN|Dropped 55517 log messages in last 270 seconds (most recently, 243 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228144147219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84426|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144147521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84427|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144147549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84428|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144147860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler294)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144147979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler294)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144148022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144148069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144148099\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x6fe320e4 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144148131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144148167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144148195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144148232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144148735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144148814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144148850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144148889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144148934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144148980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144149055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144149096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144149166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149194\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144149267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144149305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144149370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144149398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149436\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144149472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144149526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144149565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144149591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144149629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144149656\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144149692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144149726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144149807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144149835\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144149888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144149965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144149998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144150031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144150066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144150106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144150133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144150160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84429|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144150204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84430|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144151637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84431|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144151679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84432|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144151715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler294)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144151760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler294)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144151793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144151820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144151845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xaf3b4f6c your_disc:0x0\"\n },\n {\n \"at\": \"1789228144151870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144151889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144151913\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144151933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144151958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144151979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144151997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422152ms\"\n },\n {\n \"at\": \"1789228144152048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +820ms\"\n },\n {\n \"at\": \"1789228144152066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144152087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144152114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144152132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144152175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152220\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144152244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144152261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144152311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144152335\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144152374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144152394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144152413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144152435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144152454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144152505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +820ms\"\n },\n {\n \"at\": \"1789228144152526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144152550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144152571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144152589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152603\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144152625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144152683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144152699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144152743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152768\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144153144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler294)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144153250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler294)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144153300\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144153330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144153359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x7e915dec your_disc:0x0\"\n },\n {\n \"at\": \"1789228144153390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144153429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144153456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144153496\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144153537\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144153573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144153609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144153647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422153ms\"\n },\n {\n \"at\": \"1789228144153686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +660ms\"\n },\n {\n \"at\": \"1789228144153726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144153759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144153787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144153822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144153850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144153874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144153902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144153929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144153962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144153997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144154060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144154093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144154184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144154219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144154266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144154289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144154316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144154347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +660ms\"\n },\n {\n \"at\": \"1789228144154376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144154405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144154434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144154457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154476\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144154506\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144154582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144154608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144154653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84433|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144154750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84434|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228144154779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84435|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228145027204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145027273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145027293\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145027308\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145027324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145027335\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145027346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145027360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228145027374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228145027394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145027416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145027437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145027447\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228145027462\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027479\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027499\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145027514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145027532\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145027548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228145027562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145027572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145091711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145091907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145091963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145091974\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145091999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145092017\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145092033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145092045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228145092059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -120ms\"\n },\n {\n \"at\": \"1789228145092073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145092093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145092108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145092128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228145092151\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145092183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145092192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145092202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228145092221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145092236\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145123050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145123132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145123154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145123167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145123182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145123193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145123202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145123212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +520ms\"\n },\n {\n \"at\": \"1789228145123232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -310ms\"\n },\n {\n \"at\": \"1789228145123255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145123275\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145123287\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145123305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228145123314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145123369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145123384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145123399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228145123414\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145123423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145146585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84436|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228145146645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84437|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228145374305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84438|bridge|INFO|bridge br-int: added interface veth4081215f on port 36\"\n },\n {\n \"at\": \"1789228146146775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84439|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228146147014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228146687937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84441|poll_loop|INFO|Dropped 2589 log messages in last 246 seconds (most recently, 244 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228146688040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84442|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146688334\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84443|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146688936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84444|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146689316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84445|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146690041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84446|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146690420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84447|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146691050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84448|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146691390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84449|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146692003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84450|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146692387\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84451|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228147146699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84452|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228147146794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84453|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228148147116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84454|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228148147368\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84455|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228149146894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84456|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228149147000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84457|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228150146746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84458|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228150146954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84459|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:10.931475+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.17, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144036901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00230|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144037060\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00231|bridge|INFO|bridge incusovn16: using datapath ID 0000d28f4d3fcb4c\"\n },\n {\n \"at\": \"1789228144037081\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00232|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144038884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00233|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144038941\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144038963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144038986\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144039001\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144039015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039081\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144039096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144039142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144039155\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039169\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144039186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039202\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144039231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039262\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144039276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144047179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00234|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144047204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144047215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144047226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144047237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144047247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144047257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144047306\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047328\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144047345\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144047356\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144047377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144047411\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047432\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144047443\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00235|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144047457\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144047466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144047475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144047484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144047495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144047506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144047545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047569\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144047579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144047589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047600\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144047610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144047640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047660\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144132800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00236|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228144132840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228144140016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00238|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228144140087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00239|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789228144820226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler295)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144820362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler295)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144820402\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144820446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144820471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xbaaac142 your_disc:0x8c8504e0\"\n },\n {\n \"at\": \"1789228144820495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144820517\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144820538\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144820559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144820579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144820603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144820628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144820653\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399819ms\"\n },\n {\n \"at\": \"1789228144820678\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +269ms\"\n },\n {\n \"at\": \"1789228144820702\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -681ms\"\n },\n {\n \"at\": \"1789228144820728\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144820750\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144820774\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144820796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144820818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144820838\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144820869\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144820892\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144820919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144820944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144820972\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144820997\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821019\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144821041\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler295)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144821065\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144821086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144821107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144821128\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144821157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144821181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144821206\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +269ms\"\n },\n {\n \"at\": \"1789228144821227\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -681ms\"\n },\n {\n \"at\": \"1789228144821249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144821271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144821292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144821314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144821336\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144821407\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144821431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144821453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144821480\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144960320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler295)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144960444\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler295)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144960477\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144960508\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144960531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x8d32d78d your_disc:0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144960555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144960585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144960607\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144960628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144960650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144960670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144960700\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144960719\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399959ms\"\n },\n {\n \"at\": \"1789228144960745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +109ms\"\n },\n {\n \"at\": \"1789228144960768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -821ms\"\n },\n {\n \"at\": \"1789228144960795\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144960816\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144960837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144960857\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144960884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144960906\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144960927\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144960949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144960971\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144960993\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144961021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144961044\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144961096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler295)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144961125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144961152\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144961171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144961198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144961218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144961239\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144961261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +109ms\"\n },\n {\n \"at\": \"1789228144961285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -821ms\"\n },\n {\n \"at\": \"1789228144961304\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144961325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144961347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144961367\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144961388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961445\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144961465\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144961483\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144961505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144961526\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961549\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler295)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228145015167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler295)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228145015197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228145015218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228145015237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x4cdc18a your_disc:0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145015257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228145015278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228145015298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228145015325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145015369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591400014ms\"\n },\n {\n \"at\": \"1789228145015447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +844ms\"\n },\n {\n \"at\": \"1789228145015472\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -126ms\"\n },\n {\n \"at\": \"1789228145015497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145015521\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228145015543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145015563\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145015586\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145015658\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228145015700\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145015722\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145015742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228145015764\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015783\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015802\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler295)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145015822\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145015841\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145015881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015918\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145015939\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +844ms\"\n },\n {\n \"at\": \"1789228145015958\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -126ms\"\n },\n {\n \"at\": \"1789228145015979\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145016000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228145016021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145016047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145016066\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145016127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228145016147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145016166\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145016187\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:11.102283+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.16, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144035012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144035571\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge incusovn16: using datapath ID 00001a8092d1f448\"\n },\n {\n \"at\": \"1789228144035615\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00256|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144039766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00257|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144039848\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144039881\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144039904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144039932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144039950\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039974\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144039993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040013\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040032\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144040050\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144040121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144040143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144040179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040219\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144040236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144040294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00258|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144040317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144040334\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144040351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144040368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144040385\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144040404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144040424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144040500\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040535\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144040554\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144040568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040585\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144040601\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144040651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040671\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144048618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00259|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144048708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144048736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144048751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144048759\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144048767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144048774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048785\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144048816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144048824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144048832\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144048839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144048848\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144048863\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144048871\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144048878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144048887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144134204\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00260|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228144134253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00261|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228144134973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler297)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144135089\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler297)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144135432\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144135512\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144135543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x6345f596 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144135574\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144135602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144135626\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144135651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144135675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144135699\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144135723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144135750\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135813\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144135863\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144135893\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144135917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144135940\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144135965\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144135991\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144136014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144136051\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144136116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144136145\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144136198\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144136225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144136248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144136272\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144136299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144136320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144136347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144136381\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144136404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144136428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144136454\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144136477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144136521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144136589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144136610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136638\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144136663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136714\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler297)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144139207\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler297)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144139235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144139260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144139288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x8c8504e0 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144139315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144139338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144139365\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144139388\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139412\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144139436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144139460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144139483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299137ms\"\n },\n {\n \"at\": \"1789228144139509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228144139543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144139572\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144139596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144139619\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144139643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144139668\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144139742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144139763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144139791\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144139821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144139844\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139868\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139889\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144139916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144139945\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144139992\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144140015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144140036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144140057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228144140092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144140117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144140140\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144140164\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144140187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144140211\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144140281\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144140308\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144140331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144140354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140376\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144142114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228144142202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789228144800973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler297)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144801070\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler297)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144801116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144801148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144801175\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x2fa091ec your_disc:0x7e915dec\"\n },\n {\n \"at\": \"1789228144801202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144801231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144801256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144801283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144801328\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144801351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144801373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299798ms\"\n },\n {\n \"at\": \"1789228144801399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +310ms\"\n },\n {\n \"at\": \"1789228144801431\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789228144801460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144801484\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144801508\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144801532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144801556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144801629\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144801698\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144801729\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144801754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144801775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801803\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801827\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler297)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144801851\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144801876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144801995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144802021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144802045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144802078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +310ms\"\n },\n {\n \"at\": \"1789228144802102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789228144802128\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144802149\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144802172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144802194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144802223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802245\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144802294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144802317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144802343\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144802367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802390\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802413\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145085488\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145085763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145085832\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145085876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145085905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145085930\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145085955\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145085979\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +5ms\"\n },\n {\n \"at\": \"1789228145086003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -945ms\"\n },\n {\n \"at\": \"1789228145086026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145086048\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145086088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145086116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228145086139\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086161\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145086206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145086229\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145086252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228145086275\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145086299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086501\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145089687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145089769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145089799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145089821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145089847\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145089875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145089900\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145089923\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228145089945\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -270ms\"\n },\n {\n \"at\": \"1789228145089970\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145089992\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145090012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145090034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228145090056\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090111\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145090135\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145090157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145090180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228145090203\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145090223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090243\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228146132119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00264|bridge|INFO|bridge br-int: added interface veth44cf6ffb on port 34\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:11.263258+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.166, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228143843878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00234|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228143844074\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00235|bridge|INFO|bridge incusovn16: using datapath ID 0000b6aad5427645\"\n },\n {\n \"at\": \"1789228143844089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00236|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228143942029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228143942109\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00238|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228143947034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00239|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228143947076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00240|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228144038874\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00241|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144038918\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144038942\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144038959\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144038969\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144038986\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039005\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039017\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144039049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039060\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039071\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144039087\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144039099\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144039121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144039184\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144039518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144042987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00242|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144043004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144043015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144043026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144043036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144043046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144043056\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144043099\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144043108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144043118\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144043129\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144043139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144043175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144043189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144043204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144043219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144045315\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler305)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144045535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler305)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144045582\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144045627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144045660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x4e9b73c0 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144045693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144045722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144045740\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144045754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144045769\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144045784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144045799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144045818\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525909ms\"\n },\n {\n \"at\": \"1789228144045834\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +974ms\"\n },\n {\n \"at\": \"1789228144045850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144045868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144045883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144045902\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144045932\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144045948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144045963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144045980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144045994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144046012\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144046043\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144046058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046073\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144046089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144046107\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144046122\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144046137\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144046150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144046166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144046181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144046203\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +974ms\"\n },\n {\n \"at\": \"1789228144046218\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144046231\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144046246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144046260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046273\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144046287\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046301\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144046333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144046346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144046375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144049823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00243|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144049854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144049866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144049879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144049894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144049905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144049929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144049978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144049988\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144049997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144050007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144050017\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050033\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144050047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144050062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144050078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144050092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050140\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144146094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler305)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144146224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler305)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144146245\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144146271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144146292\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb2dcf063 your_disc:0x6345f596\"\n },\n {\n \"at\": \"1789228144146307\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144146322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144146345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144146361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146376\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144146391\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591526010ms\"\n },\n {\n \"at\": \"1789228144146446\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +944ms\"\n },\n {\n \"at\": \"1789228144146463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144146478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144146493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144146507\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146522\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144146543\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146573\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144146589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144146610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144146644\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144146659\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146689\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler305)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144146706\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144146721\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144146750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146779\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144146793\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +944ms\"\n },\n {\n \"at\": \"1789228144146808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144146823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144146837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144146851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144146879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146893\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146908\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144146944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147022\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144147111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147145\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler305)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144147158\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler305)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144147169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144147181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144147191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x8e3ceb62 your_disc:0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147202\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144147213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144147223\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144147234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144147262\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147283\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591526010ms\"\n },\n {\n \"at\": \"1789228144147293\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +824ms\"\n },\n {\n \"at\": \"1789228144147309\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144147321\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144147332\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144147342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147353\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147384\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144147423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144147458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144147467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler305)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144147504\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144147515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144147535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147555\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144147565\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +824ms\"\n },\n {\n \"at\": \"1789228144147580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144147589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144147599\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144147609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147619\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147630\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144147663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147673\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147682\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144147692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147701\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145865025\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145865537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145865575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145865601\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145865626\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145865651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145865674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145865699\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +36ms\"\n },\n {\n \"at\": \"1789228145865727\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -844ms\"\n },\n {\n \"at\": \"1789228145865754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145865774\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145865800\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145865817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145865832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865863\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145865878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145865897\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145865925\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145865941\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145865956\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:11.430482+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-before-probe.txt", "router_mac": "10:66:6a:ef:03:ee", "at": "2026-09-12T15:49:11.431111+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.092, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:49:04.83508965Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:49:05.45788577Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:49:05.659809306Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:49:06.209740211Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:11.523121+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 25444, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T15:49:11.647447+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 15.259, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.084 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.084 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"6f1bca4c-008f-4747-b440-da094863ef53\",\"volatile.eth0.host_name\":\"veth4081215f\",\"volatile.eth0.hwaddr\":\"10:66:6a:fa:34:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1500421f-eae8-4703-a5ad-36cccc32d607\",\"volatile.uuid.generation\":\"1500421f-eae8-4703-a5ad-36cccc32d607\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:49:04.83508965Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"6f1bca4c-008f-4747-b440-da094863ef53\",\"volatile.eth0.host_name\":\"veth4081215f\",\"volatile.eth0.hwaddr\":\"10:66:6a:fa:34:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1500421f-eae8-4703-a5ad-36cccc32d607\",\"volatile.uuid.generation\":\"1500421f-eae8-4703-a5ad-36cccc32d607\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:49:05.45788577Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9502720,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fefa:3471\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:fa:34:71\",\"host_name\":\"veth4081215f\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4179249,\"processes\":4,\"cpu\":{\"usage\":525006000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:49:04.480000019Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\"volatile.eth0.host_name\":\"veth44cf6ffb\",\"volatile.eth0.hwaddr\":\"10:66:6a:b5:a6:1d\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\"volatile.uuid.generation\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:49:05.659809306Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\"volatile.eth0.host_name\":\"veth44cf6ffb\",\"volatile.eth0.hwaddr\":\"10:66:6a:b5:a6:1d\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\"volatile.uuid.generation\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:49:06.209740211Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":12464128,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:feb5:a61d\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:b5:a6:1d\",\"host_name\":\"veth44cf6ffb\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":36239,\"processes\":4,\"cpu\":{\"usage\":490076000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:49:06.210000038Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.094 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.230 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.224 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.089 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.698 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.393 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.393/0.726/1.089 ms\nelapsed_seconds=2.239 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.342 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.964 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.364 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.364/0.890/1.342 ms\nelapsed_seconds=2.210 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.471 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.704 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.980 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.980/1.718/2.471 ms\nelapsed_seconds=2.611 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.555 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.698 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.959 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.959/1.404/1.698 ms\nelapsed_seconds=2.496 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.368 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nelapsed_seconds=0.314 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.436 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.440 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.081 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.110704 bytes_per_second=903309726\nelapsed_seconds=0.892 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.496 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.106090 bytes_per_second=942595909\nelapsed_seconds=0.367 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.541 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:26.906756+00:00"} +{"capture": "tcpdump-arp", "pid": 25444, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T15:49:26.909675+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab03\n - nas01\n - lab01\n - lab02\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:26.995511+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.087, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:fa:34:71 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:b5:a6:1d |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:27.082855+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.134, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch e88c8df6-ece6-47fd-a7fe-5b4f27b757a6 (incus-net36-ls-int)\n port incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0\n addresses: [\"10:66:6a:fa:34:71 dynamic\"]\n port incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0\n addresses: [\"10:66:6a:b5:a6:1d dynamic\"]\n port incus-net36-ls-int-lsp-router\n type: router\n router-port: incus-net36-lr-lrp-int\nswitch 2eb3d377-43ac-4726-9d9e-38b2eacd0a32 (incus-net36-ls-ext)\n port incus-net36-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net36-ls-ext-lsp-router\n type: router\n router-port: incus-net36-lr-lrp-ext\nrouter bc73d56b-f557-4331-90a4-674d5b5358d8 (incus-net36-lr)\n port incus-net36-lr-lrp-int\n mac: \"10:66:6a:ef:03:ee\"\n ipv6-lla: \"fe80::1266:6aff:feef:3ee\"\n networks: [\"10.253.73.1/24\"]\n port incus-net36-lr-lrp-ext\n mac: \"10:66:6a:ef:03:ee\"\n ipv6-lla: \"fe80::1266:6aff:feef:3ee\"\n networks: [\"10.10.40.64/24\"]\n nat d1708fa6-e54a-418c-8898-e6418433f6ab\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net36-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : d14f4591-3990-4964-9c05-9c0cee5828be\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ef:03:ee\"\nname : incus-net36-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : fd00ec3f-deb9-4bf5-9d44-e57633fe2062\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ef:03:ee\"\nname : incus-net36-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 2bf3bac8-cfa3-4a1d-84bb-924f1d103157\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : 3316399c-503f-4e27-87f2-a52de668b028\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 9f453b2e-04c6-416c-8ded-750b1a34dfc4\nlogical_port : cr-incus-net36-lr-lrp-ext\nmac : [\"10:66:6a:ef:03:ee 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net36-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e\nexternal_ids : {}\nha_chassis : [35cd8d65-8ba5-4f8b-9266-91a6abef3a86, 75dd6966-985e-48f4-bdd4-bfb54d363e6f, 84eaad05-4254-4156-99ab-8262e0bc85e0, bd15f386-184e-46d8-b32f-0dd0b68470df]\nname : incus-net36\n=== ovn-nbctl list HA_Chassis ===\n_uuid : 84eaad05-4254-4156-99ab-8262e0bc85e0\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 13433\n\n_uuid : 35cd8d65-8ba5-4f8b-9266-91a6abef3a86\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 28146\n\n_uuid : bd15f386-184e-46d8-b32f-0dd0b68470df\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 29916\n\n_uuid : 75dd6966-985e-48f4-bdd4-bfb54d363e6f\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 6914\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:49:27.217558+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.367, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:49:27.585572+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.206, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144049088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84417|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144049912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84418|bridge|INFO|bridge incusovn16: using datapath ID 00002e04465f3d4b\"\n },\n {\n \"at\": \"1789228144049944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84419|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144052199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84420|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144052298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144052339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144052365\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144052386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144052410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144052434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052493\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052522\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144052541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144052559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144052578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144052607\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144052623\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144052670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144052692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144052710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144052728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144052808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84421|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144052837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144052858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144052873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144052890\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144052908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144052927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144053002\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144053064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144053079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144053122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144053179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053197\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144053244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144053266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84422|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144053295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144053317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144053343\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144053364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144053387\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144053401\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053418\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144053475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053517\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144053551\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144053568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144053605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053620\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144053657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144147061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84423|dpif|WARN|Dropped 981 log messages in last 244 seconds (most recently, 243 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228144147147\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84424|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144147186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84425|bridge|WARN|Dropped 55517 log messages in last 270 seconds (most recently, 243 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228144147219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84426|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144147521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84427|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144147549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84428|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144147860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler294)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144147979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler294)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144148022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144148069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144148099\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x6fe320e4 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144148131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144148167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144148195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144148232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144148735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144148814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144148850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144148889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144148934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144148980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144149055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144149096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144149166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149194\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144149267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144149305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144149370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144149398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149436\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144149472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144149526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144149565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144149591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144149629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144149656\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144149692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144149726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144149807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144149835\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144149888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144149965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144149998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144150031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144150066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144150106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144150133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144150160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84429|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144150204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84430|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144151637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84431|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144151679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84432|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144151715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler294)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144151760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler294)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144151793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144151820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144151845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xaf3b4f6c your_disc:0x0\"\n },\n {\n \"at\": \"1789228144151870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144151889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144151913\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144151933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144151958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144151979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144151997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422152ms\"\n },\n {\n \"at\": \"1789228144152048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +820ms\"\n },\n {\n \"at\": \"1789228144152066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144152087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144152114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144152132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144152175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152220\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144152244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144152261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144152311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144152335\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144152374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144152394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144152413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144152435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144152454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144152505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +820ms\"\n },\n {\n \"at\": \"1789228144152526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144152550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144152571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144152589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152603\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144152625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144152683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144152699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144152743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152768\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144153144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler294)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144153250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler294)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144153300\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144153330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144153359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x7e915dec your_disc:0x0\"\n },\n {\n \"at\": \"1789228144153390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144153429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144153456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144153496\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144153537\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144153573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144153609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144153647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422153ms\"\n },\n {\n \"at\": \"1789228144153686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +660ms\"\n },\n {\n \"at\": \"1789228144153726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144153759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144153787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144153822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144153850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144153874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144153902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144153929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144153962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144153997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144154060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144154093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144154184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144154219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144154266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144154289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144154316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144154347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +660ms\"\n },\n {\n \"at\": \"1789228144154376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144154405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144154434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144154457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154476\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144154506\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144154582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144154608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144154653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84433|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144154750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84434|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228144154779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84435|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228145027204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145027273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145027293\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145027308\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145027324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145027335\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145027346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145027360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228145027374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228145027394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145027416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145027437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145027447\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228145027462\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027479\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027499\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145027514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145027532\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145027548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228145027562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145027572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145091711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145091907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145091963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145091974\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145091999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145092017\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145092033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145092045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228145092059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -120ms\"\n },\n {\n \"at\": \"1789228145092073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145092093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145092108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145092128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228145092151\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145092183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145092192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145092202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228145092221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145092236\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145123050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145123132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145123154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145123167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145123182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145123193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145123202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145123212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +520ms\"\n },\n {\n \"at\": \"1789228145123232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -310ms\"\n },\n {\n \"at\": \"1789228145123255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145123275\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145123287\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145123305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228145123314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145123369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145123384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145123399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228145123414\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145123423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145146585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84436|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228145146645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84437|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228145374305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84438|bridge|INFO|bridge br-int: added interface veth4081215f on port 36\"\n },\n {\n \"at\": \"1789228146146775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84439|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228146147014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228146687937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84441|poll_loop|INFO|Dropped 2589 log messages in last 246 seconds (most recently, 244 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228146688040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84442|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146688334\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84443|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146688936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84444|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146689316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84445|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146690041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84446|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146690420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84447|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146691050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84448|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146691390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84449|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146692003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84450|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146692387\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84451|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228147146699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84452|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228147146794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84453|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228148147116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84454|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228148147368\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84455|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228149146894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84456|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228149147000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84457|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228150146746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84458|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228150146954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84459|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228151146945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84460|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228151147153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84461|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228152146815\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84462|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228152146951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84463|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228152687650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84464|poll_loop|INFO|Dropped 12173 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228152687832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84465|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228153146848\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84466|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228153146980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84467|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228154055008\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84468|connmgr|INFO|br-int<->unix#7: 889 flow_mods in the 6 s starting 10 s ago (827 adds, 55 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228154146780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84469|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228154146860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84470|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228155146597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84471|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228155146799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84472|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228156146876\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84473|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228156147064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84474|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228157146729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84475|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228157146840\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84476|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228158146821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84477|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228158147128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84478|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228158687963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84479|poll_loop|INFO|Dropped 12277 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228158688018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84480|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228159146982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84481|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228159147161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84482|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228160146644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84483|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228160146746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84484|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228161146979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84485|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228161147170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84486|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228162146959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84487|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228162147089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84488|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228163146697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84489|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228163146786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84490|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228164146546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84491|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228164146731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84492|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228164687672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84493|poll_loop|INFO|Dropped 12344 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228164687766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84494|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228165146556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84495|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228165146759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84496|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228166146678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84497|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228166146908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84498|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228167146749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84499|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228167146988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84500|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:27.791595+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.249, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144036901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00230|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144037060\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00231|bridge|INFO|bridge incusovn16: using datapath ID 0000d28f4d3fcb4c\"\n },\n {\n \"at\": \"1789228144037081\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00232|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144038884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00233|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144038941\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144038963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144038986\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144039001\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144039015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039081\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144039096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144039142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144039155\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039169\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144039186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039202\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144039231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039262\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144039276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144047179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00234|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144047204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144047215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144047226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144047237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144047247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144047257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144047306\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047328\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144047345\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144047356\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144047377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144047411\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047432\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144047443\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00235|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144047457\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144047466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144047475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144047484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144047495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144047506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144047545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047569\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144047579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144047589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047600\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144047610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144047640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047660\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144132800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00236|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228144132840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228144140016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00238|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228144140087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00239|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789228144820226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler295)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144820362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler295)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144820402\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144820446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144820471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xbaaac142 your_disc:0x8c8504e0\"\n },\n {\n \"at\": \"1789228144820495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144820517\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144820538\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144820559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144820579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144820603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144820628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144820653\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399819ms\"\n },\n {\n \"at\": \"1789228144820678\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +269ms\"\n },\n {\n \"at\": \"1789228144820702\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -681ms\"\n },\n {\n \"at\": \"1789228144820728\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144820750\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144820774\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144820796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144820818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144820838\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144820869\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144820892\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144820919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144820944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144820972\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144820997\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821019\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144821041\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler295)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144821065\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144821086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144821107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144821128\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144821157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144821181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144821206\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +269ms\"\n },\n {\n \"at\": \"1789228144821227\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -681ms\"\n },\n {\n \"at\": \"1789228144821249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144821271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144821292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144821314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144821336\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144821407\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144821431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144821453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144821480\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144960320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler295)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144960444\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler295)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144960477\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144960508\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144960531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x8d32d78d your_disc:0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144960555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144960585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144960607\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144960628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144960650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144960670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144960700\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144960719\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399959ms\"\n },\n {\n \"at\": \"1789228144960745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +109ms\"\n },\n {\n \"at\": \"1789228144960768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -821ms\"\n },\n {\n \"at\": \"1789228144960795\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144960816\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144960837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144960857\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144960884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144960906\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144960927\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144960949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144960971\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144960993\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144961021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144961044\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144961096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler295)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144961125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144961152\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144961171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144961198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144961218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144961239\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144961261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +109ms\"\n },\n {\n \"at\": \"1789228144961285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -821ms\"\n },\n {\n \"at\": \"1789228144961304\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144961325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144961347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144961367\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144961388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961445\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144961465\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144961483\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144961505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144961526\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961549\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler295)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228145015167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler295)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228145015197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228145015218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228145015237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x4cdc18a your_disc:0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145015257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228145015278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228145015298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228145015325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145015369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591400014ms\"\n },\n {\n \"at\": \"1789228145015447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +844ms\"\n },\n {\n \"at\": \"1789228145015472\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -126ms\"\n },\n {\n \"at\": \"1789228145015497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145015521\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228145015543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145015563\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145015586\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145015658\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228145015700\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145015722\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145015742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228145015764\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015783\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015802\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler295)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145015822\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145015841\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145015881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015918\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145015939\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +844ms\"\n },\n {\n \"at\": \"1789228145015958\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -126ms\"\n },\n {\n \"at\": \"1789228145015979\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145016000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228145016021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145016047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145016066\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145016127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228145016147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145016166\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145016187\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228154041803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00240|connmgr|INFO|br-int<->unix#7: 876 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:28.041441+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.174, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144035012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144035571\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge incusovn16: using datapath ID 00001a8092d1f448\"\n },\n {\n \"at\": \"1789228144035615\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00256|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144039766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00257|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144039848\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144039881\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144039904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144039932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144039950\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039974\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144039993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040013\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040032\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144040050\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144040121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144040143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144040179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040219\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144040236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144040294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00258|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144040317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144040334\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144040351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144040368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144040385\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144040404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144040424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144040500\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040535\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144040554\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144040568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040585\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144040601\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144040651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040671\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144048618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00259|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144048708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144048736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144048751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144048759\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144048767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144048774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048785\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144048816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144048824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144048832\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144048839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144048848\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144048863\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144048871\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144048878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144048887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144134204\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00260|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228144134253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00261|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228144134973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler297)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144135089\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler297)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144135432\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144135512\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144135543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x6345f596 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144135574\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144135602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144135626\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144135651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144135675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144135699\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144135723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144135750\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135813\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144135863\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144135893\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144135917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144135940\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144135965\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144135991\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144136014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144136051\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144136116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144136145\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144136198\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144136225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144136248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144136272\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144136299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144136320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144136347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144136381\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144136404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144136428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144136454\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144136477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144136521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144136589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144136610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136638\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144136663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136714\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler297)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144139207\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler297)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144139235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144139260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144139288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x8c8504e0 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144139315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144139338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144139365\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144139388\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139412\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144139436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144139460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144139483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299137ms\"\n },\n {\n \"at\": \"1789228144139509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228144139543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144139572\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144139596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144139619\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144139643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144139668\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144139742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144139763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144139791\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144139821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144139844\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139868\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139889\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144139916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144139945\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144139992\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144140015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144140036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144140057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228144140092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144140117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144140140\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144140164\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144140187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144140211\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144140281\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144140308\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144140331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144140354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140376\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144142114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228144142202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789228144800973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler297)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144801070\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler297)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144801116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144801148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144801175\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x2fa091ec your_disc:0x7e915dec\"\n },\n {\n \"at\": \"1789228144801202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144801231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144801256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144801283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144801328\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144801351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144801373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299798ms\"\n },\n {\n \"at\": \"1789228144801399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +310ms\"\n },\n {\n \"at\": \"1789228144801431\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789228144801460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144801484\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144801508\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144801532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144801556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144801629\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144801698\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144801729\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144801754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144801775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801803\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801827\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler297)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144801851\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144801876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144801995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144802021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144802045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144802078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +310ms\"\n },\n {\n \"at\": \"1789228144802102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789228144802128\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144802149\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144802172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144802194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144802223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802245\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144802294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144802317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144802343\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144802367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802390\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802413\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145085488\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145085763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145085832\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145085876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145085905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145085930\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145085955\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145085979\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +5ms\"\n },\n {\n \"at\": \"1789228145086003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -945ms\"\n },\n {\n \"at\": \"1789228145086026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145086048\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145086088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145086116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228145086139\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086161\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145086206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145086229\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145086252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228145086275\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145086299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086501\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145089687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145089769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145089799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145089821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145089847\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145089875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145089900\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145089923\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228145089945\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -270ms\"\n },\n {\n \"at\": \"1789228145089970\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145089992\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145090012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145090034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228145090056\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090111\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145090135\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145090157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145090180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228145090203\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145090223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090243\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228146132119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00264|bridge|INFO|bridge br-int: added interface veth44cf6ffb on port 34\"\n },\n {\n \"at\": \"1789228154043684\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00265|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:28.215517+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.184, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228143843878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00234|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228143844074\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00235|bridge|INFO|bridge incusovn16: using datapath ID 0000b6aad5427645\"\n },\n {\n \"at\": \"1789228143844089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00236|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228143942029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228143942109\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00238|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228143947034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00239|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228143947076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00240|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228144038874\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00241|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144038918\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144038942\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144038959\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144038969\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144038986\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039005\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039017\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144039049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039060\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039071\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144039087\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144039099\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144039121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144039184\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144039518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144042987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00242|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144043004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144043015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144043026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144043036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144043046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144043056\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144043099\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144043108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144043118\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144043129\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144043139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144043175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144043189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144043204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144043219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144045315\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler305)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144045535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler305)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144045582\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144045627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144045660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x4e9b73c0 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144045693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144045722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144045740\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144045754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144045769\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144045784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144045799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144045818\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525909ms\"\n },\n {\n \"at\": \"1789228144045834\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +974ms\"\n },\n {\n \"at\": \"1789228144045850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144045868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144045883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144045902\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144045932\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144045948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144045963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144045980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144045994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144046012\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144046043\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144046058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046073\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144046089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144046107\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144046122\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144046137\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144046150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144046166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144046181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144046203\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +974ms\"\n },\n {\n \"at\": \"1789228144046218\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144046231\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144046246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144046260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046273\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144046287\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046301\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144046333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144046346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144046375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144049823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00243|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144049854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144049866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144049879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144049894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144049905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144049929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144049978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144049988\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144049997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144050007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144050017\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050033\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144050047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144050062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144050078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144050092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050140\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144146094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler305)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144146224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler305)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144146245\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144146271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144146292\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb2dcf063 your_disc:0x6345f596\"\n },\n {\n \"at\": \"1789228144146307\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144146322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144146345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144146361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146376\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144146391\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591526010ms\"\n },\n {\n \"at\": \"1789228144146446\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +944ms\"\n },\n {\n \"at\": \"1789228144146463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144146478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144146493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144146507\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146522\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144146543\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146573\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144146589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144146610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144146644\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144146659\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146689\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler305)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144146706\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144146721\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144146750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146779\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144146793\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +944ms\"\n },\n {\n \"at\": \"1789228144146808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144146823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144146837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144146851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144146879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146893\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146908\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144146944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147022\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144147111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147145\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler305)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144147158\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler305)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144147169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144147181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144147191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x8e3ceb62 your_disc:0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147202\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144147213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144147223\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144147234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144147262\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147283\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591526010ms\"\n },\n {\n \"at\": \"1789228144147293\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +824ms\"\n },\n {\n \"at\": \"1789228144147309\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144147321\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144147332\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144147342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147353\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147384\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144147423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144147458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144147467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler305)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144147504\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144147515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144147535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147555\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144147565\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +824ms\"\n },\n {\n \"at\": \"1789228144147580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144147589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144147599\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144147609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147619\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147630\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144147663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147673\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147682\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144147692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147701\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145865025\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145865537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145865575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145865601\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145865626\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145865651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145865674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145865699\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +36ms\"\n },\n {\n \"at\": \"1789228145865727\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -844ms\"\n },\n {\n \"at\": \"1789228145865754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145865774\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145865800\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145865817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145865832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865863\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145865878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145865897\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145865925\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145865941\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145865956\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228153849232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00244|connmgr|INFO|br-int<->unix#7: 955 flow_mods in the 6 s starting 10 s ago (865 adds, 88 deletes, 2 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:28.399807+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-probe.txt", "router_mac": "10:66:6a:ef:03:ee", "at": "2026-09-12T15:49:28.400693+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 26443, "ready": true, "ready_signal": "time=\"2026-09-12T08:49:28-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:49:28.483996+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/topology.jsonl", "destroy"], "seconds": 3.841, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:32.325653+00:00"} +{"capture": "monitor-delete", "pid": 26443, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.log", "ready_signal": "time=\"2026-09-12T08:49:28-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:49:32.328083+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.096, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:49:32.424505+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.082, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:49:32.507303+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.145, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ovn-nbctl list HA_Chassis_Group ===\n=== ovn-nbctl list HA_Chassis ===\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:49:32.652640+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.322, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T15:49:32.975096+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.251, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144049088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84417|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144049912\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84418|bridge|INFO|bridge incusovn16: using datapath ID 00002e04465f3d4b\"\n },\n {\n \"at\": \"1789228144049944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84419|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144052199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84420|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144052298\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144052339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144052365\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144052386\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144052410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144052434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052493\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052522\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144052541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144052559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144052578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144052607\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144052623\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144052670\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144052692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144052710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144052728\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144052783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144052808\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84421|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144052837\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144052858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144052873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144052890\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144052908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144052927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052948\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144052981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144053002\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053047\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144053064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144053079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144053122\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144053179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053197\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144053244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144053266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84422|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144053295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144053317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144053343\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144053364\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144053387\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144053401\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053418\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422052ms\"\n },\n {\n \"at\": \"1789228144053454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144053475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053492\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053517\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144053551\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144053568\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144053605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144053620\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144053643\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144053657\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144053690\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144147061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84423|dpif|WARN|Dropped 981 log messages in last 244 seconds (most recently, 243 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228144147147\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84424|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144147186\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84425|bridge|WARN|Dropped 55517 log messages in last 270 seconds (most recently, 243 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228144147219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84426|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144147521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84427|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144147549\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84428|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144147860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler294)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144147979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler294)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144148022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144148069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144148099\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x6fe320e4 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144148131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144148167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144148195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144148232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144148735\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144148814\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144148850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144148889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144148934\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144148980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149026\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144149055\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144149096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144149166\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149194\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149231\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144149267\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144149305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149340\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144149370\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144149398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149436\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144149472\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144149526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144149565\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144149591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144149629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144149656\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144149692\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144149726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149754\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542422148ms\"\n },\n {\n \"at\": \"1789228144149781\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144149807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144149835\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144149858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144149888\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144149938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144149965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144149998\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144150031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144150066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144150106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144150133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144150160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84429|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144150204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84430|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144151637\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84431|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144151679\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84432|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228144151715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler294)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144151760\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler294)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144151793\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144151820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144151845\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xaf3b4f6c your_disc:0x0\"\n },\n {\n \"at\": \"1789228144151870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144151889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144151913\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144151933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144151958\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144151979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144151997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422152ms\"\n },\n {\n \"at\": \"1789228144152048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +820ms\"\n },\n {\n \"at\": \"1789228144152066\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144152087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144152114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144152132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152156\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144152175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152199\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152220\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144152244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144152261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144152311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144152335\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144152374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144152394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144152413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144152435\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144152454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152468\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144152489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144152505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +820ms\"\n },\n {\n \"at\": \"1789228144152526\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144152550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144152571\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144152589\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152603\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144152625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152666\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144152683\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144152699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144152722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144152743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152768\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144152787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144153144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler294)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144153250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler294)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144153300\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144153330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144153359\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x7e915dec your_disc:0x0\"\n },\n {\n \"at\": \"1789228144153390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144153429\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144153456\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144153496\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144153537\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144153573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144153609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144153647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542422153ms\"\n },\n {\n \"at\": \"1789228144153686\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +660ms\"\n },\n {\n \"at\": \"1789228144153726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144153759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144153787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144153822\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144153850\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144153874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144153902\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144153929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144153962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144153997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144154060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144154093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154117\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144154184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144154219\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144154266\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144154289\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144154316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144154347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +660ms\"\n },\n {\n \"at\": \"1789228144154376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144154405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144154434\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144154457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154476\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144154506\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154533\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154559\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144154582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144154608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144154629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144154653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154673\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144154698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144154722\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84433|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228144154750\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84434|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228144154779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84435|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228145027204\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145027273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145027293\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145027308\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145027324\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145027335\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145027346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145027360\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +16ms\"\n },\n {\n \"at\": \"1789228145027374\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -874ms\"\n },\n {\n \"at\": \"1789228145027394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145027416\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145027437\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145027447\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228145027462\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027479\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027499\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145027514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145027532\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145027548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228145027562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145027572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145027582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145091711\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145091907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145091963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145091974\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145091999\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145092017\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145092033\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145092045\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228145092059\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -120ms\"\n },\n {\n \"at\": \"1789228145092073\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145092093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145092108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145092128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228145092151\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145092183\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145092192\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145092202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228145092221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145092236\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145092256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145123050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145123132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145123154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145123167\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145123182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145123193\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145123202\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145123212\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +520ms\"\n },\n {\n \"at\": \"1789228145123232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -310ms\"\n },\n {\n \"at\": \"1789228145123255\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145123275\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145123287\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145123305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228145123314\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123330\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145123369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145123384\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145123399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228145123414\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145123423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145123433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145146585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84436|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228145146645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84437|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228145374305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84438|bridge|INFO|bridge br-int: added interface veth4081215f on port 36\"\n },\n {\n \"at\": \"1789228146146775\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84439|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228146147014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228146687937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84441|poll_loop|INFO|Dropped 2589 log messages in last 246 seconds (most recently, 244 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228146688040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84442|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146688334\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84443|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146688936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84444|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146689316\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84445|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146690041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84446|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146690420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84447|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146691050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84448|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146691390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84449|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146692003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84450|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228146692387\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84451|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)\"\n },\n {\n \"at\": \"1789228147146699\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84452|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228147146794\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84453|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228148147116\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84454|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228148147368\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84455|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228149146894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84456|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228149147000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84457|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228150146746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84458|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228150146954\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84459|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228151146945\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84460|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228151147153\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84461|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228152146815\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84462|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228152146951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84463|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228152687650\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84464|poll_loop|INFO|Dropped 12173 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228152687832\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84465|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228153146848\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84466|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228153146980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84467|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228154055008\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84468|connmgr|INFO|br-int<->unix#7: 889 flow_mods in the 6 s starting 10 s ago (827 adds, 55 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228154146780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84469|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228154146860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84470|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228155146597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84471|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228155146799\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84472|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228156146876\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84473|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228156147064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84474|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228157146729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84475|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228157146840\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84476|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228158146821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84477|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228158147128\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84478|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228158687963\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84479|poll_loop|INFO|Dropped 12277 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228158688018\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84480|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228159146982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84481|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228159147161\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84482|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228160146644\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84483|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228160146746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84484|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228161146979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84485|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228161147170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84486|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228162146959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84487|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228162147089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84488|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228163146697\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84489|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228163146786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84490|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228164146546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84491|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228164146731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84492|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228164687672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84493|poll_loop|INFO|Dropped 12344 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228164687766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84494|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228165146556\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84495|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228165146759\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84496|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228166146678\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84497|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228166146908\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84498|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228167146749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84499|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228167146988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84500|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228168146861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84501|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228168147175\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84502|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228169146967\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84503|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228169147184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84504|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228169283003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84505|bridge|INFO|bridge br-int: deleted interface veth4081215f on port 36\"\n },\n {\n \"at\": \"1789228170146645\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84506|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228170146727\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84507|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228170687562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84508|poll_loop|INFO|Dropped 12309 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228170687751\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84509|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228171146539\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84510|dpif|WARN|Dropped 2135 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228171146605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84511|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228171855521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84512|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228171855719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84513|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228171877232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84514|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228171877283\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:33.227356+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.159, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144036901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00230|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144037060\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00231|bridge|INFO|bridge incusovn16: using datapath ID 0000d28f4d3fcb4c\"\n },\n {\n \"at\": \"1789228144037081\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00232|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144038884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00233|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144038941\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144038963\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144038986\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144039001\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144039015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399038ms\"\n },\n {\n \"at\": \"1789228144039081\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144039096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144039142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144039155\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039169\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144039186\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039202\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144039231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039262\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144039276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144047179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00234|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144047204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144047215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144047226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144047237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144047247\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144047257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144047306\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047328\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144047345\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144047356\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144047377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047400\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144047411\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047432\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144047443\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00235|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144047457\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144047466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144047475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144047484\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144047495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144047506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047514\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591399046ms\"\n },\n {\n \"at\": \"1789228144047534\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144047545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047569\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144047579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144047589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047600\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144047610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144047621\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144047630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144047640\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047651\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144047660\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144132800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00236|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228144132840\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228144140016\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00238|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228144140087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00239|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789228144820226\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler295)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144820362\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler295)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144820402\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144820446\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144820471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xbaaac142 your_disc:0x8c8504e0\"\n },\n {\n \"at\": \"1789228144820495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144820517\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144820538\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144820559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144820579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144820603\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144820628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144820653\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399819ms\"\n },\n {\n \"at\": \"1789228144820678\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +269ms\"\n },\n {\n \"at\": \"1789228144820702\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -681ms\"\n },\n {\n \"at\": \"1789228144820728\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144820750\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144820774\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144820796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144820818\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144820838\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144820869\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144820892\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144820919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144820944\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144820972\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144820997\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821019\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144821041\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler295)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144821065\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144821086\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144821107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144821128\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144821157\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144821181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144821206\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +269ms\"\n },\n {\n \"at\": \"1789228144821227\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -681ms\"\n },\n {\n \"at\": \"1789228144821249\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144821271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144821292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144821314\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144821336\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821379\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144821407\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144821431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144821453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144821480\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821506\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144821528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144960320\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler295)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144960444\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler295)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144960477\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144960508\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144960531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x8d32d78d your_disc:0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144960555\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144960585\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144960607\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144960628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144960650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144960670\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144960700\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144960719\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591399959ms\"\n },\n {\n \"at\": \"1789228144960745\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +109ms\"\n },\n {\n \"at\": \"1789228144960768\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -821ms\"\n },\n {\n \"at\": \"1789228144960795\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144960816\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144960837\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144960857\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144960884\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144960906\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144960927\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144960949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144960971\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144960993\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144961021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144961044\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144961096\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler295)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144961125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144961152\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144961171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144961198\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144961218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144961239\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144961261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +109ms\"\n },\n {\n \"at\": \"1789228144961285\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -821ms\"\n },\n {\n \"at\": \"1789228144961304\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144961325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144961347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144961367\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xaf3b4f6c\"\n },\n {\n \"at\": \"1789228144961388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961445\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144961465\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144961483\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144961505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8d32d78d\"\n },\n {\n \"at\": \"1789228144961526\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961549\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144961573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015082\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler295)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228145015167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler295)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228145015197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228145015218\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228145015237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x4cdc18a your_disc:0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145015257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228145015278\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228145015298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228145015325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145015369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015422\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591400014ms\"\n },\n {\n \"at\": \"1789228145015447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +844ms\"\n },\n {\n \"at\": \"1789228145015472\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -126ms\"\n },\n {\n \"at\": \"1789228145015497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145015521\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228145015543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145015563\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145015586\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015630\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145015658\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228145015700\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145015722\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145015742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228145015764\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145015783\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015802\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler295)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145015822\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145015841\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145015862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145015881\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145015918\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145015939\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +844ms\"\n },\n {\n \"at\": \"1789228145015958\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -126ms\"\n },\n {\n \"at\": \"1789228145015979\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145016000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228145016021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145016047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145016066\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016087\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016107\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145016127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228145016147\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145016166\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145016187\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145016231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228154041803\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00240|connmgr|INFO|br-int<->unix#7: 876 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789228171851340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00241|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228171851475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00242|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228171851489\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00243|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228171868178\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00244|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789228171868369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:33.386954+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.172, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228144035012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228144035571\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge incusovn16: using datapath ID 00001a8092d1f448\"\n },\n {\n \"at\": \"1789228144035615\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00256|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228144039766\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00257|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144039848\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144039881\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144039904\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144039932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144039950\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039974\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144039993\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040013\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040032\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144040050\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144040121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144040143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040162\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144040179\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040219\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144040236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144040294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00258|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144040317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144040334\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144040351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144040368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144040385\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144040404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144040424\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040441\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040461\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299037ms\"\n },\n {\n \"at\": \"1789228144040483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144040500\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040516\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040535\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144040554\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144040568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040585\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144040601\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144040618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144040634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144040651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040671\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144040691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144048618\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00259|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144048708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144048736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144048751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144048759\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144048767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144048774\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048785\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299046ms\"\n },\n {\n \"at\": \"1789228144048808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144048816\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144048824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144048832\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144048839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144048848\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144048863\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144048871\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144048878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144048887\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048895\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144048905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144134204\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00260|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228144134253\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00261|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228144134973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler297)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144135089\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler297)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144135432\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144135512\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144135543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x6345f596 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144135574\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144135602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144135626\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144135651\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144135675\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144135699\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144135723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144135750\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135813\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144135839\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144135863\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144135893\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144135917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144135940\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144135965\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144135991\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144136014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144136051\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144136116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144136145\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144136198\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144136225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144136248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144136272\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144136299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144136320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144136347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144136381\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144136404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50299132ms\"\n },\n {\n \"at\": \"1789228144136428\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144136454\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144136477\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144136521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136545\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136568\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144136589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144136610\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144136638\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144136663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136691\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144136714\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler297)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144139207\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler297)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144139235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144139260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144139288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x8c8504e0 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144139315\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144139338\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144139365\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144139388\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139412\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144139436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144139460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144139483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299137ms\"\n },\n {\n \"at\": \"1789228144139509\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228144139543\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144139572\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144139596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144139619\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144139643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144139668\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144139742\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144139763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144139791\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144139821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144139844\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144139868\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139889\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144139916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144139945\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144139969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144139992\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144140015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144140036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144140057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228144140092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228144140117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144140140\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144140164\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144140187\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228144140211\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140236\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140260\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144140281\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144140308\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144140331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228144140354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140376\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144140397\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144142114\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228144142202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789228144800973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler297)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144801070\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler297)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144801116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144801148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144801175\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x2fa091ec your_disc:0x7e915dec\"\n },\n {\n \"at\": \"1789228144801202\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144801231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144801256\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144801283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801306\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144801328\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144801351\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144801373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50299798ms\"\n },\n {\n \"at\": \"1789228144801399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +310ms\"\n },\n {\n \"at\": \"1789228144801431\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789228144801460\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144801484\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144801508\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144801532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144801556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801579\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144801629\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144801698\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144801729\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144801754\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144801775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144801803\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801827\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler297)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144801851\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144801876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144801968\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144801995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144802021\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144802045\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144802078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +310ms\"\n },\n {\n \"at\": \"1789228144802102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -660ms\"\n },\n {\n \"at\": \"1789228144802128\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144802149\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144802172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144802194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x7e915dec\"\n },\n {\n \"at\": \"1789228144802223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802245\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802271\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144802294\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144802317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144802343\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x2fa091ec\"\n },\n {\n \"at\": \"1789228144802367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802390\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144802413\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145085488\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145085763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145085832\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145085876\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145085905\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145085930\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145085955\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145085979\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +5ms\"\n },\n {\n \"at\": \"1789228145086003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -945ms\"\n },\n {\n \"at\": \"1789228145086026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145086048\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145086088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145086116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228145086139\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086161\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145086206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145086229\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145086252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228145086275\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145086299\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145086501\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145089687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145089769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145089799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145089821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145089847\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145089875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145089900\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145089923\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +680ms\"\n },\n {\n \"at\": \"1789228145089945\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -270ms\"\n },\n {\n \"at\": \"1789228145089970\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145089992\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145090012\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145090034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xbaaac142\"\n },\n {\n \"at\": \"1789228145090056\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090088\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090111\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145090135\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145090157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145090180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8c8504e0\"\n },\n {\n \"at\": \"1789228145090203\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145090223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145090243\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228146132119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00264|bridge|INFO|bridge br-int: added interface veth44cf6ffb on port 34\"\n },\n {\n \"at\": \"1789228154043684\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00265|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789228170426301\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00266|bridge|INFO|bridge br-int: deleted interface veth44cf6ffb on port 34\"\n },\n {\n \"at\": \"1789228171848112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00267|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228171848403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00268|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228171848609\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00269|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228171871163\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00270|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33\"\n },\n {\n \"at\": \"1789228171871503\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:33.559524+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A49%3A01.262086%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.171, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228143843878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00234|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228143844074\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00235|bridge|INFO|bridge incusovn16: using datapath ID 0000b6aad5427645\"\n },\n {\n \"at\": \"1789228143844089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00236|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228143942029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00237|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228143942109\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00238|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228143947034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00239|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228143947076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00240|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789228144038874\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00241|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144038918\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144038942\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144038959\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144038969\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144038986\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144039005\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039017\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525902ms\"\n },\n {\n \"at\": \"1789228144039038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144039049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039060\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039071\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144039087\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144039099\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144039121\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144039131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144039169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144039184\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039197\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144039208\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144039518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228144042987\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00242|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144043004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144043015\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144043026\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144043036\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144043046\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144043056\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525907ms\"\n },\n {\n \"at\": \"1789228144043089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144043099\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144043108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144043118\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144043129\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144043139\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144043175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144043189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144043204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144043219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144043246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144045315\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler305)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144045535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler305)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144045582\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228144045627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144045660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x4e9b73c0 your_disc:0x0\"\n },\n {\n \"at\": \"1789228144045693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144045722\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144045740\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144045754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144045769\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144045784\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144045799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144045818\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525909ms\"\n },\n {\n \"at\": \"1789228144045834\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +974ms\"\n },\n {\n \"at\": \"1789228144045850\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144045868\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144045883\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144045902\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144045932\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144045948\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144045963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144045980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144045994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144046012\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144046043\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144046058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046073\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144046089\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144046107\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144046122\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144046137\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144046150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144046166\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144046181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144046203\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +974ms\"\n },\n {\n \"at\": \"1789228144046218\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144046231\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144046246\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144046260\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046273\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228144046287\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046301\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144046333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228144046346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144046361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228144046375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144046409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144049823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00243|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144049854\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144049866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144049879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144049894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144049905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228144049929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049947\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591525913ms\"\n },\n {\n \"at\": \"1789228144049968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144049978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228144049988\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144049997\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144050007\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144050017\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050033\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144050047\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228144050062\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144050078\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228144050092\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050108\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144050140\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228144146094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler305)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144146224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler305)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144146245\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144146271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144146292\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xb2dcf063 your_disc:0x6345f596\"\n },\n {\n \"at\": \"1789228144146307\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144146322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144146345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144146361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146376\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144146391\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591526010ms\"\n },\n {\n \"at\": \"1789228144146446\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +944ms\"\n },\n {\n \"at\": \"1789228144146463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144146478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144146493\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144146507\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146522\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144146543\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146558\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146573\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144146589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144146610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144146644\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144146659\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146689\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler305)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144146706\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144146721\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144146735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144146750\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146765\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144146779\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144146793\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +944ms\"\n },\n {\n \"at\": \"1789228144146808\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144146823\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144146837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144146851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144146865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6345f596\"\n },\n {\n \"at\": \"1789228144146879\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146893\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144146908\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144146944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147022\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147098\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xb2dcf063\"\n },\n {\n \"at\": \"1789228144147111\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147145\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler305)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228144147158\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler305)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228144147169\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228144147181\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228144147191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x8e3ceb62 your_disc:0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147202\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144147213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228144147223\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228144147234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144147262\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147272\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147283\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591526010ms\"\n },\n {\n \"at\": \"1789228144147293\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +824ms\"\n },\n {\n \"at\": \"1789228144147309\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144147321\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144147332\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144147342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147353\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147384\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144147423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144147458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228144147467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler305)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228144147504\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228144147515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228144147525\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228144147535\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228144147555\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228144147565\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +824ms\"\n },\n {\n \"at\": \"1789228144147580\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789228144147589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228144147599\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228144147609\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147619\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6fe320e4\"\n },\n {\n \"at\": \"1789228144147630\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228144147663\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228144147673\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228144147682\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8e3ceb62\"\n },\n {\n \"at\": \"1789228144147692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147701\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228144147710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145865025\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228145865537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228145865575\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228145865601\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228145865626\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145865651\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228145865674\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228145865699\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +36ms\"\n },\n {\n \"at\": \"1789228145865727\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -844ms\"\n },\n {\n \"at\": \"1789228145865754\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228145865774\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228145865800\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145865817\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x4cdc18a\"\n },\n {\n \"at\": \"1789228145865832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865847\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865863\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228145865878\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228145865897\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228145865925\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x4e9b73c0\"\n },\n {\n \"at\": \"1789228145865941\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228145865956\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228145865972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228153849232\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00244|connmgr|INFO|br-int<->unix#7: 955 flow_mods in the 6 s starting 10 s ago (865 adds, 88 deletes, 2 modifications)\"\n },\n {\n \"at\": \"1789228171854929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789228171857623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00245|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228171857675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228171857693\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00247|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228171879925\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00248|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:49:33.730865+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T15:49:33.731961+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/create.stdout.json new file mode 100644 index 0000000..c09c2cc --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.56, + "first_cross_member_ping_seconds": 2.868, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/cycle.json new file mode 100644 index 0000000..e299d5c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T15:49:01.262086+00:00", + "ended_at": "2026-09-12T15:49:33.732060+00:00", + "seconds": 32.47, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:ef:03:ee", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.56, + "first_cross_member_ping_seconds": 2.868, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.084 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.084 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"6f1bca4c-008f-4747-b440-da094863ef53\",\"volatile.eth0.host_name\":\"veth4081215f\",\"volatile.eth0.hwaddr\":\"10:66:6a:fa:34:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1500421f-eae8-4703-a5ad-36cccc32d607\",\"volatile.uuid.generation\":\"1500421f-eae8-4703-a5ad-36cccc32d607\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:49:04.83508965Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"6f1bca4c-008f-4747-b440-da094863ef53\",\"volatile.eth0.host_name\":\"veth4081215f\",\"volatile.eth0.hwaddr\":\"10:66:6a:fa:34:71\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1500421f-eae8-4703-a5ad-36cccc32d607\",\"volatile.uuid.generation\":\"1500421f-eae8-4703-a5ad-36cccc32d607\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:49:05.45788577Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9502720,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fefa:3471\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:fa:34:71\",\"host_name\":\"veth4081215f\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4179249,\"processes\":4,\"cpu\":{\"usage\":525006000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:49:04.480000019Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\"volatile.eth0.host_name\":\"veth44cf6ffb\",\"volatile.eth0.hwaddr\":\"10:66:6a:b5:a6:1d\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\"volatile.uuid.generation\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:49:05.659809306Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\"volatile.eth0.host_name\":\"veth44cf6ffb\",\"volatile.eth0.hwaddr\":\"10:66:6a:b5:a6:1d\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\"volatile.uuid.generation\":\"7494d1d7-f784-4978-abd8-d8e3cae1414c\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:49:06.209740211Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":12464128,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:feb5:a61d\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:b5:a6:1d\",\"host_name\":\"veth44cf6ffb\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":36239,\"processes\":4,\"cpu\":{\"usage\":490076000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:49:06.210000038Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.094 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.230 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.224 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.089 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.698 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.393 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.393/0.726/1.089 ms\nelapsed_seconds=2.239 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.342 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.964 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.364 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.364/0.890/1.342 ms\nelapsed_seconds=2.210 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.471 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.704 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.980 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.980/1.718/2.471 ms\nelapsed_seconds=2.611 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.555 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.698 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.959 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.959/1.404/1.698 ms\nelapsed_seconds=2.496 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.368 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nelapsed_seconds=0.314 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.436 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.440 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.081 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.110704 bytes_per_second=903309726\nelapsed_seconds=0.892 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.496 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.106090 bytes_per_second=942595909\nelapsed_seconds=0.367 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.541 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 24918, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.log", + "bytes": 174829, + "ready_signal": "time=\"2026-09-12T08:49:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:49:01.944977+00:00", + "stopped_at": "2026-09-12T15:49:10.010417+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 25444, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T15:49:11.523918+00:00", + "stopped_at": "2026-09-12T15:49:26.909627+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 26443, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.log", + "bytes": 40222, + "ready_signal": "time=\"2026-09-12T08:49:28-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:49:28.401222+00:00", + "stopped_at": "2026-09-12T15:49:32.327451+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-probe.txt new file mode 100644 index 0000000..842d280 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-probe.txt @@ -0,0 +1,5718 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab03 + - nas01 + - lab01 + - lab02 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:fa:34:71 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:b5:a6:1d | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch e88c8df6-ece6-47fd-a7fe-5b4f27b757a6 (incus-net36-ls-int) + port incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0 + addresses: ["10:66:6a:fa:34:71 dynamic"] + port incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0 + addresses: ["10:66:6a:b5:a6:1d dynamic"] + port incus-net36-ls-int-lsp-router + type: router + router-port: incus-net36-lr-lrp-int +switch 2eb3d377-43ac-4726-9d9e-38b2eacd0a32 (incus-net36-ls-ext) + port incus-net36-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net36-ls-ext-lsp-router + type: router + router-port: incus-net36-lr-lrp-ext +router bc73d56b-f557-4331-90a4-674d5b5358d8 (incus-net36-lr) + port incus-net36-lr-lrp-int + mac: "10:66:6a:ef:03:ee" + ipv6-lla: "fe80::1266:6aff:feef:3ee" + networks: ["10.253.73.1/24"] + port incus-net36-lr-lrp-ext + mac: "10:66:6a:ef:03:ee" + ipv6-lla: "fe80::1266:6aff:feef:3ee" + networks: ["10.10.40.64/24"] + nat d1708fa6-e54a-418c-8898-e6418433f6ab + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net36-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : d14f4591-3990-4964-9c05-9c0cee5828be +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ef:03:ee" +name : incus-net36-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : fd00ec3f-deb9-4bf5-9d44-e57633fe2062 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ef:03:ee" +name : incus-net36-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 2bf3bac8-cfa3-4a1d-84bb-924f1d103157 +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : 3316399c-503f-4e27-87f2-a52de668b028 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 9f453b2e-04c6-416c-8ded-750b1a34dfc4 +logical_port : cr-incus-net36-lr-lrp-ext +mac : ["10:66:6a:ef:03:ee 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net36-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e +external_ids : {} +ha_chassis : [35cd8d65-8ba5-4f8b-9266-91a6abef3a86, 75dd6966-985e-48f4-bdd4-bfb54d363e6f, 84eaad05-4254-4156-99ab-8262e0bc85e0, bd15f386-184e-46d8-b32f-0dd0b68470df] +name : incus-net36 +=== ovn-nbctl list HA_Chassis === +_uuid : 84eaad05-4254-4156-99ab-8262e0bc85e0 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 13433 + +_uuid : 35cd8d65-8ba5-4f8b-9266-91a6abef3a86 +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 28146 + +_uuid : bd15f386-184e-46d8-b32f-0dd0b68470df +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 29916 + +_uuid : 75dd6966-985e-48f4-bdd4-bfb54d363e6f +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 6914 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144049088", + "member": "lab01.glab.lol", + "message": "ovs|84417|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144049912", + "member": "lab01.glab.lol", + "message": "ovs|84418|bridge|INFO|bridge incusovn16: using datapath ID 00002e04465f3d4b" + }, + { + "at": "1789228144049944", + "member": "lab01.glab.lol", + "message": "ovs|84419|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144052199", + "member": "lab01.glab.lol", + "message": "ovs|84420|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144052298", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144052339", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144052365", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144052386", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144052410", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144052434", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144052466", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144052493", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144052522", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144052541", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144052559", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144052578", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144052607", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144052623", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144052642", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144052670", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144052692", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144052710", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144052728", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144052754", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144052783", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144052808", + "member": "lab01.glab.lol", + "message": "ovs|84421|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144052837", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144052858", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144052873", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144052890", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144052908", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144052927", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144052948", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144052965", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144052981", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144053002", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144053022", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053047", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144053064", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144053079", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053105", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144053122", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144053143", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053161", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144053179", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144053197", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053221", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144053244", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144053266", + "member": "lab01.glab.lol", + "message": "ovs|84422|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144053295", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144053317", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144053343", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144053364", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144053387", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144053401", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144053418", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144053435", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144053454", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144053475", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144053492", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053517", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144053551", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144053568", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053582", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144053605", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144053620", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053643", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144053657", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144053674", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053690", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144147061", + "member": "lab01.glab.lol", + "message": "ovs|84423|dpif|WARN|Dropped 981 log messages in last 244 seconds (most recently, 243 seconds ago) due to excessive rate" + }, + { + "at": "1789228144147147", + "member": "lab01.glab.lol", + "message": "ovs|84424|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144147186", + "member": "lab01.glab.lol", + "message": "ovs|84425|bridge|WARN|Dropped 55517 log messages in last 270 seconds (most recently, 243 seconds ago) due to excessive rate" + }, + { + "at": "1789228144147219", + "member": "lab01.glab.lol", + "message": "ovs|84426|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144147521", + "member": "lab01.glab.lol", + "message": "ovs|84427|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144147549", + "member": "lab01.glab.lol", + "message": "ovs|84428|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144147860", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler294)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144147979", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler294)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228144148022", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144148069", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144148099", + "member": "lab01.glab.lol", + "message": " my_disc:0x6fe320e4 your_disc:0x0" + }, + { + "at": "1789228144148131", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144148167", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144148195", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144148232", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144148735", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144148814", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144148850", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144148889", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422148ms" + }, + { + "at": "1789228144148934", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422148ms" + }, + { + "at": "1789228144148980", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422148ms" + }, + { + "at": "1789228144149026", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144149055", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144149096", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149132", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144149166", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144149194", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149231", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144149267", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144149305", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149340", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144149370", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144149398", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149436", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144149472", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144149526", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144149565", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144149591", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144149629", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144149656", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144149692", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144149726", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422148ms" + }, + { + "at": "1789228144149754", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422148ms" + }, + { + "at": "1789228144149781", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144149807", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144149835", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149858", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144149888", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144149914", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149938", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144149965", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144149998", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144150031", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144150066", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144150106", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144150133", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144150160", + "member": "lab01.glab.lol", + "message": "ovs|84429|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144150204", + "member": "lab01.glab.lol", + "message": "ovs|84430|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144151637", + "member": "lab01.glab.lol", + "message": "ovs|84431|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144151679", + "member": "lab01.glab.lol", + "message": "ovs|84432|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144151715", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler294)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144151760", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler294)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144151793", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144151820", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144151845", + "member": "lab01.glab.lol", + "message": " my_disc:0xaf3b4f6c your_disc:0x0" + }, + { + "at": "1789228144151870", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144151889", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144151913", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144151933", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144151958", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144151979", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144151997", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144152022", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422152ms" + }, + { + "at": "1789228144152048", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +820ms" + }, + { + "at": "1789228144152066", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144152087", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144152114", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144152132", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152156", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144152175", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152199", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152220", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144152244", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144152261", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152285", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144152311", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144152335", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152356", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144152374", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144152394", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144152413", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144152435", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144152454", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144152468", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144152489", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144152505", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +820ms" + }, + { + "at": "1789228144152526", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144152550", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144152571", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144152589", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152603", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144152625", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152646", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152666", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144152683", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144152699", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152722", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144152743", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152768", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152787", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144153144", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler294)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144153250", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler294)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144153300", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144153330", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144153359", + "member": "lab01.glab.lol", + "message": " my_disc:0x7e915dec your_disc:0x0" + }, + { + "at": "1789228144153390", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144153429", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144153456", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144153496", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144153537", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144153573", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144153609", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144153647", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422153ms" + }, + { + "at": "1789228144153686", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +660ms" + }, + { + "at": "1789228144153726", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144153759", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144153787", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144153822", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144153850", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144153874", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144153902", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144153929", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144153962", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144153997", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154021", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228144154060", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144154093", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154117", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144154148", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144154184", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144154219", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144154241", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144154266", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144154289", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144154316", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144154347", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +660ms" + }, + { + "at": "1789228144154376", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144154405", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144154434", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144154457", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154476", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144154506", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144154533", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154559", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144154582", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144154608", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154629", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228144154653", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144154673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154698", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144154722", + "member": "lab01.glab.lol", + "message": "ovs|84433|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144154750", + "member": "lab01.glab.lol", + "message": "ovs|84434|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228144154779", + "member": "lab01.glab.lol", + "message": "ovs|84435|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228145027204", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145027273", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145027293", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145027308", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145027324", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145027335", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145027346", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145027360", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228145027374", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228145027394", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145027416", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145027437", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145027447", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228145027462", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145027479", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145027499", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145027514", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145027532", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145027548", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228145027562", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145027572", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145027582", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145091711", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145091907", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145091963", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145091974", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145091999", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145092017", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145092033", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145092045", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228145092059", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -120ms" + }, + { + "at": "1789228145092073", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145092093", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145092108", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145092128", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228145092151", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145092161", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145092170", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145092183", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145092192", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145092202", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228145092221", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145092236", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145092256", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145123050", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145123132", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145123154", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145123167", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145123182", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145123193", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145123202", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145123212", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +520ms" + }, + { + "at": "1789228145123232", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -310ms" + }, + { + "at": "1789228145123255", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145123275", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145123287", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145123305", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228145123314", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145123330", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145123349", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145123369", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145123384", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145123399", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228145123414", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145123423", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145123433", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145146585", + "member": "lab01.glab.lol", + "message": "ovs|84436|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228145146645", + "member": "lab01.glab.lol", + "message": "ovs|84437|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228145374305", + "member": "lab01.glab.lol", + "message": "ovs|84438|bridge|INFO|bridge br-int: added interface veth4081215f on port 36" + }, + { + "at": "1789228146146775", + "member": "lab01.glab.lol", + "message": "ovs|84439|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228146147014", + "member": "lab01.glab.lol", + "message": "ovs|84440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228146687937", + "member": "lab01.glab.lol", + "message": "ovs|84441|poll_loop|INFO|Dropped 2589 log messages in last 246 seconds (most recently, 244 seconds ago) due to excessive rate" + }, + { + "at": "1789228146688040", + "member": "lab01.glab.lol", + "message": "ovs|84442|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146688334", + "member": "lab01.glab.lol", + "message": "ovs|84443|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146688936", + "member": "lab01.glab.lol", + "message": "ovs|84444|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146689316", + "member": "lab01.glab.lol", + "message": "ovs|84445|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146690041", + "member": "lab01.glab.lol", + "message": "ovs|84446|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146690420", + "member": "lab01.glab.lol", + "message": "ovs|84447|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146691050", + "member": "lab01.glab.lol", + "message": "ovs|84448|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146691390", + "member": "lab01.glab.lol", + "message": "ovs|84449|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146692003", + "member": "lab01.glab.lol", + "message": "ovs|84450|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146692387", + "member": "lab01.glab.lol", + "message": "ovs|84451|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228147146699", + "member": "lab01.glab.lol", + "message": "ovs|84452|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228147146794", + "member": "lab01.glab.lol", + "message": "ovs|84453|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228148147116", + "member": "lab01.glab.lol", + "message": "ovs|84454|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228148147368", + "member": "lab01.glab.lol", + "message": "ovs|84455|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228149146894", + "member": "lab01.glab.lol", + "message": "ovs|84456|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228149147000", + "member": "lab01.glab.lol", + "message": "ovs|84457|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228150146746", + "member": "lab01.glab.lol", + "message": "ovs|84458|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228150146954", + "member": "lab01.glab.lol", + "message": "ovs|84459|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228151146945", + "member": "lab01.glab.lol", + "message": "ovs|84460|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228151147153", + "member": "lab01.glab.lol", + "message": "ovs|84461|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228152146815", + "member": "lab01.glab.lol", + "message": "ovs|84462|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228152146951", + "member": "lab01.glab.lol", + "message": "ovs|84463|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228152687650", + "member": "lab01.glab.lol", + "message": "ovs|84464|poll_loop|INFO|Dropped 12173 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228152687832", + "member": "lab01.glab.lol", + "message": "ovs|84465|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228153146848", + "member": "lab01.glab.lol", + "message": "ovs|84466|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228153146980", + "member": "lab01.glab.lol", + "message": "ovs|84467|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228154055008", + "member": "lab01.glab.lol", + "message": "ovs|84468|connmgr|INFO|br-int<->unix#7: 889 flow_mods in the 6 s starting 10 s ago (827 adds, 55 deletes, 7 modifications)" + }, + { + "at": "1789228154146780", + "member": "lab01.glab.lol", + "message": "ovs|84469|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228154146860", + "member": "lab01.glab.lol", + "message": "ovs|84470|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228155146597", + "member": "lab01.glab.lol", + "message": "ovs|84471|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228155146799", + "member": "lab01.glab.lol", + "message": "ovs|84472|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228156146876", + "member": "lab01.glab.lol", + "message": "ovs|84473|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228156147064", + "member": "lab01.glab.lol", + "message": "ovs|84474|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228157146729", + "member": "lab01.glab.lol", + "message": "ovs|84475|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228157146840", + "member": "lab01.glab.lol", + "message": "ovs|84476|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228158146821", + "member": "lab01.glab.lol", + "message": "ovs|84477|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228158147128", + "member": "lab01.glab.lol", + "message": "ovs|84478|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228158687963", + "member": "lab01.glab.lol", + "message": "ovs|84479|poll_loop|INFO|Dropped 12277 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228158688018", + "member": "lab01.glab.lol", + "message": "ovs|84480|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228159146982", + "member": "lab01.glab.lol", + "message": "ovs|84481|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228159147161", + "member": "lab01.glab.lol", + "message": "ovs|84482|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228160146644", + "member": "lab01.glab.lol", + "message": "ovs|84483|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228160146746", + "member": "lab01.glab.lol", + "message": "ovs|84484|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228161146979", + "member": "lab01.glab.lol", + "message": "ovs|84485|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228161147170", + "member": "lab01.glab.lol", + "message": "ovs|84486|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228162146959", + "member": "lab01.glab.lol", + "message": "ovs|84487|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228162147089", + "member": "lab01.glab.lol", + "message": "ovs|84488|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228163146697", + "member": "lab01.glab.lol", + "message": "ovs|84489|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228163146786", + "member": "lab01.glab.lol", + "message": "ovs|84490|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228164146546", + "member": "lab01.glab.lol", + "message": "ovs|84491|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228164146731", + "member": "lab01.glab.lol", + "message": "ovs|84492|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228164687672", + "member": "lab01.glab.lol", + "message": "ovs|84493|poll_loop|INFO|Dropped 12344 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228164687766", + "member": "lab01.glab.lol", + "message": "ovs|84494|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228165146556", + "member": "lab01.glab.lol", + "message": "ovs|84495|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228165146759", + "member": "lab01.glab.lol", + "message": "ovs|84496|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228166146678", + "member": "lab01.glab.lol", + "message": "ovs|84497|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228166146908", + "member": "lab01.glab.lol", + "message": "ovs|84498|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228167146749", + "member": "lab01.glab.lol", + "message": "ovs|84499|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228167146988", + "member": "lab01.glab.lol", + "message": "ovs|84500|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144036901", + "member": "lab02.glab.lol", + "message": "ovs|00230|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144037060", + "member": "lab02.glab.lol", + "message": "ovs|00231|bridge|INFO|bridge incusovn16: using datapath ID 0000d28f4d3fcb4c" + }, + { + "at": "1789228144037081", + "member": "lab02.glab.lol", + "message": "ovs|00232|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144038884", + "member": "lab02.glab.lol", + "message": "ovs|00233|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144038941", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144038963", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144038986", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144039001", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144039015", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039033", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399038ms" + }, + { + "at": "1789228144039052", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399038ms" + }, + { + "at": "1789228144039067", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399038ms" + }, + { + "at": "1789228144039081", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144039096", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144039111", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039127", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144039142", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144039155", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039169", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144039186", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144039202", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039216", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144039231", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144039247", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039262", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144039276", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144047179", + "member": "lab02.glab.lol", + "message": "ovs|00234|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144047204", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144047215", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144047226", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144047237", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144047247", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144047257", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399046ms" + }, + { + "at": "1789228144047270", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399046ms" + }, + { + "at": "1789228144047284", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399046ms" + }, + { + "at": "1789228144047296", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144047306", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144047317", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047328", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144047345", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144047356", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047366", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144047377", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144047386", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047400", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144047411", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144047420", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047432", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144047443", + "member": "lab02.glab.lol", + "message": "ovs|00235|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144047457", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144047466", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144047475", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144047484", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144047495", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144047506", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399046ms" + }, + { + "at": "1789228144047514", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399046ms" + }, + { + "at": "1789228144047524", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399046ms" + }, + { + "at": "1789228144047534", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144047545", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144047555", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047569", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144047579", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144047589", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047600", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144047610", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144047621", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047630", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144047640", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144047651", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047660", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144132800", + "member": "lab02.glab.lol", + "message": "ovs|00236|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228144132840", + "member": "lab02.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228144140016", + "member": "lab02.glab.lol", + "message": "ovs|00238|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228144140087", + "member": "lab02.glab.lol", + "message": "ovs|00239|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789228144820226", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler295)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144820362", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler295)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144820402", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144820446", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144820471", + "member": "lab02.glab.lol", + "message": " my_disc:0xbaaac142 your_disc:0x8c8504e0" + }, + { + "at": "1789228144820495", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144820517", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144820538", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144820559", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144820579", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144820603", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144820628", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144820653", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399819ms" + }, + { + "at": "1789228144820678", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +269ms" + }, + { + "at": "1789228144820702", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -681ms" + }, + { + "at": "1789228144820728", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144820750", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144820774", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144820796", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144820818", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144820838", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144820869", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144820892", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144820919", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144820944", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbaaac142" + }, + { + "at": "1789228144820972", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144820997", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821019", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144821041", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler295)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144821065", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144821086", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144821107", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144821128", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144821157", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144821181", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144821206", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +269ms" + }, + { + "at": "1789228144821227", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -681ms" + }, + { + "at": "1789228144821249", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144821271", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144821292", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144821314", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144821336", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144821358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821379", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144821407", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144821431", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144821453", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbaaac142" + }, + { + "at": "1789228144821480", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144821506", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821528", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144960320", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler295)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144960444", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler295)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144960477", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144960508", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144960531", + "member": "lab02.glab.lol", + "message": " my_disc:0x8d32d78d your_disc:0xaf3b4f6c" + }, + { + "at": "1789228144960555", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144960585", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144960607", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144960628", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144960650", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144960670", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144960700", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144960719", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399959ms" + }, + { + "at": "1789228144960745", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +109ms" + }, + { + "at": "1789228144960768", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -821ms" + }, + { + "at": "1789228144960795", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144960816", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144960837", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144960857", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144960884", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144960906", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144960927", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144960949", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144960971", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144960993", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144961021", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144961044", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961068", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144961096", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler295)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144961125", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144961152", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144961171", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144961198", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144961218", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144961239", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144961261", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +109ms" + }, + { + "at": "1789228144961285", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -821ms" + }, + { + "at": "1789228144961304", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144961325", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144961347", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144961367", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144961388", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144961422", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961445", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144961465", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144961483", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144961505", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144961526", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144961549", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961573", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145015082", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler295)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228145015167", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler295)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228145015197", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228145015218", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228145015237", + "member": "lab02.glab.lol", + "message": " my_disc:0x4cdc18a your_disc:0x4e9b73c0" + }, + { + "at": "1789228145015257", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228145015278", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228145015298", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228145015325", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145015347", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145015369", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145015389", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145015422", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591400014ms" + }, + { + "at": "1789228145015447", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +844ms" + }, + { + "at": "1789228145015472", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -126ms" + }, + { + "at": "1789228145015497", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145015521", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228145015543", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145015563", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145015586", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145015609", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145015630", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145015658", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228145015700", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145015722", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145015742", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228145015764", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145015783", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145015802", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler295)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145015822", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145015841", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145015862", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145015881", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145015900", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145015918", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145015939", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +844ms" + }, + { + "at": "1789228145015958", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -126ms" + }, + { + "at": "1789228145015979", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145016000", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228145016021", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145016047", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145016066", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145016087", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145016107", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145016127", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228145016147", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145016166", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145016187", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145016209", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145016231", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228154041803", + "member": "lab02.glab.lol", + "message": "ovs|00240|connmgr|INFO|br-int<->unix#7: 876 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 8 modifications)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144035012", + "member": "lab03.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144035571", + "member": "lab03.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge incusovn16: using datapath ID 00001a8092d1f448" + }, + { + "at": "1789228144035615", + "member": "lab03.glab.lol", + "message": "ovs|00256|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144039766", + "member": "lab03.glab.lol", + "message": "ovs|00257|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144039848", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144039881", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144039904", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144039932", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144039950", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039974", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299037ms" + }, + { + "at": "1789228144039993", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299037ms" + }, + { + "at": "1789228144040013", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299037ms" + }, + { + "at": "1789228144040032", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144040050", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144040080", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040102", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144040121", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144040143", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040162", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144040179", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144040202", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040219", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144040236", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144040256", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040274", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144040294", + "member": "lab03.glab.lol", + "message": "ovs|00258|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144040317", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144040334", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144040351", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144040368", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144040385", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144040404", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144040424", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299037ms" + }, + { + "at": "1789228144040441", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299037ms" + }, + { + "at": "1789228144040461", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299037ms" + }, + { + "at": "1789228144040483", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144040500", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144040516", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040535", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144040554", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144040568", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040585", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144040601", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144040618", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040634", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144040651", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144040671", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040691", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144048618", + "member": "lab03.glab.lol", + "message": "ovs|00259|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144048708", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144048736", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144048751", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144048759", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144048767", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144048774", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299046ms" + }, + { + "at": "1789228144048785", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299046ms" + }, + { + "at": "1789228144048799", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299046ms" + }, + { + "at": "1789228144048808", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144048816", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144048824", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144048832", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144048839", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144048848", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144048855", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144048863", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144048871", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144048878", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144048887", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144048895", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144048905", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144134204", + "member": "lab03.glab.lol", + "message": "ovs|00260|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228144134253", + "member": "lab03.glab.lol", + "message": "ovs|00261|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228144134973", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler297)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144135089", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler297)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228144135432", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144135512", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144135543", + "member": "lab03.glab.lol", + "message": " my_disc:0x6345f596 your_disc:0x0" + }, + { + "at": "1789228144135574", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144135602", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144135626", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144135651", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144135675", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144135699", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144135723", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144135750", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299132ms" + }, + { + "at": "1789228144135778", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299132ms" + }, + { + "at": "1789228144135813", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299132ms" + }, + { + "at": "1789228144135839", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144135863", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144135893", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144135917", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144135940", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144135965", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144135991", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144136014", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144136051", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136082", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228144136116", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144136145", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136171", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144136198", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144136225", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144136248", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144136272", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144136299", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144136320", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144136347", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144136381", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299132ms" + }, + { + "at": "1789228144136404", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299132ms" + }, + { + "at": "1789228144136428", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144136454", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144136477", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136498", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144136521", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144136545", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136568", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144136589", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144136610", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136638", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228144136663", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144136691", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136714", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144139158", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler297)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144139207", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler297)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144139235", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144139260", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144139288", + "member": "lab03.glab.lol", + "message": " my_disc:0x8c8504e0 your_disc:0x0" + }, + { + "at": "1789228144139315", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144139338", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144139365", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144139388", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144139412", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144139436", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144139460", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144139483", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299137ms" + }, + { + "at": "1789228144139509", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228144139543", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144139572", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144139596", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144139619", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144139643", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144139668", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144139692", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144139718", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144139742", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144139763", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144139791", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144139821", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144139844", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144139868", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144139889", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144139916", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144139945", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144139969", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144139992", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144140015", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144140036", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144140057", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228144140092", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144140117", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144140140", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144140164", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144140187", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144140211", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144140236", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144140260", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144140281", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144140308", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144140331", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144140354", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144140376", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144140397", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144142114", + "member": "lab03.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228144142202", + "member": "lab03.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789228144800973", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler297)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144801070", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler297)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144801116", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144801148", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144801175", + "member": "lab03.glab.lol", + "message": " my_disc:0x2fa091ec your_disc:0x7e915dec" + }, + { + "at": "1789228144801202", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144801231", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144801256", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144801283", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144801306", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144801328", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144801351", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144801373", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299798ms" + }, + { + "at": "1789228144801399", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +310ms" + }, + { + "at": "1789228144801431", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789228144801460", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144801484", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144801508", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144801532", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144801556", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144801579", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144801606", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144801629", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144801698", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144801729", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144801754", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144801775", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144801803", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144801827", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler297)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144801851", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144801876", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144801968", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144801995", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144802021", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144802045", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144802078", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +310ms" + }, + { + "at": "1789228144802102", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789228144802128", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144802149", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144802172", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144802194", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144802223", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144802245", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144802271", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144802294", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144802317", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144802343", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144802367", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144802390", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144802413", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145085488", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145085763", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145085832", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145085876", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145085905", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145085930", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145085955", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145085979", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +5ms" + }, + { + "at": "1789228145086003", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -945ms" + }, + { + "at": "1789228145086026", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145086048", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145086088", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145086116", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228145086139", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145086161", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145086184", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145086206", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145086229", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145086252", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228145086275", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145086299", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145086501", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145089687", + "member": "lab03.glab.lol", + "message": "ovs|00011|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145089769", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145089799", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145089821", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145089847", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145089875", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145089900", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145089923", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228145089945", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -270ms" + }, + { + "at": "1789228145089970", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145089992", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145090012", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145090034", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228145090056", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145090088", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145090111", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145090135", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145090157", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145090180", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228145090203", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145090223", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145090243", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228146132119", + "member": "lab03.glab.lol", + "message": "ovs|00264|bridge|INFO|bridge br-int: added interface veth44cf6ffb on port 34" + }, + { + "at": "1789228154043684", + "member": "lab03.glab.lol", + "message": "ovs|00265|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228143843878", + "member": "nas01.glab.lol", + "message": "ovs|00234|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228143844074", + "member": "nas01.glab.lol", + "message": "ovs|00235|bridge|INFO|bridge incusovn16: using datapath ID 0000b6aad5427645" + }, + { + "at": "1789228143844089", + "member": "nas01.glab.lol", + "message": "ovs|00236|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228143942029", + "member": "nas01.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228143942109", + "member": "nas01.glab.lol", + "message": "ovs|00238|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228143947034", + "member": "nas01.glab.lol", + "message": "ovs|00239|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228143947076", + "member": "nas01.glab.lol", + "message": "ovs|00240|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228144038874", + "member": "nas01.glab.lol", + "message": "ovs|00241|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144038918", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144038942", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144038959", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144038969", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144038986", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039005", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525902ms" + }, + { + "at": "1789228144039017", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525902ms" + }, + { + "at": "1789228144039029", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525902ms" + }, + { + "at": "1789228144039038", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144039049", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144039060", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039071", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144039087", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144039099", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039108", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144039121", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144039131", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039169", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144039184", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144039197", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039208", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144039518", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144042987", + "member": "nas01.glab.lol", + "message": "ovs|00242|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144043004", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144043015", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144043026", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144043036", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144043046", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144043056", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525907ms" + }, + { + "at": "1789228144043068", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525907ms" + }, + { + "at": "1789228144043079", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525907ms" + }, + { + "at": "1789228144043089", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144043099", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144043108", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144043118", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144043129", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144043139", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144043160", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144043175", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144043189", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144043204", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144043219", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144043232", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144043246", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144045315", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler305)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144045535", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler305)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144045582", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144045627", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144045660", + "member": "nas01.glab.lol", + "message": " my_disc:0x4e9b73c0 your_disc:0x0" + }, + { + "at": "1789228144045693", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144045722", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144045740", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144045754", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144045769", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144045784", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144045799", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144045818", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525909ms" + }, + { + "at": "1789228144045834", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +974ms" + }, + { + "at": "1789228144045850", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144045868", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144045883", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144045902", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144045932", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144045948", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144045963", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144045980", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144045994", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144046012", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046027", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144046043", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144046058", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046073", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144046089", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144046107", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144046122", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144046137", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144046150", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144046166", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144046181", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144046203", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +974ms" + }, + { + "at": "1789228144046218", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144046231", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144046246", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144046260", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046273", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144046287", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144046301", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046318", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144046333", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144046346", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046361", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144046375", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144046394", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046409", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144049823", + "member": "nas01.glab.lol", + "message": "ovs|00243|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144049854", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144049866", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144049879", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144049894", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144049905", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144049929", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525913ms" + }, + { + "at": "1789228144049947", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525913ms" + }, + { + "at": "1789228144049958", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525913ms" + }, + { + "at": "1789228144049968", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144049978", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144049988", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144049997", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144050007", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144050017", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144050033", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144050047", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144050062", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144050078", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144050092", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144050108", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144050140", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144146094", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler305)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144146224", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler305)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144146245", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144146271", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144146292", + "member": "nas01.glab.lol", + "message": " my_disc:0xb2dcf063 your_disc:0x6345f596" + }, + { + "at": "1789228144146307", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144146322", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144146345", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144146361", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144146376", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144146391", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144146407", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144146428", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591526010ms" + }, + { + "at": "1789228144146446", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +944ms" + }, + { + "at": "1789228144146463", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144146478", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144146493", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144146507", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146522", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144146543", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144146558", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146573", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144146589", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144146610", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146623", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144146644", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144146659", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146674", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144146689", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler305)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144146706", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144146721", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144146735", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144146750", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144146765", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144146779", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144146793", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +944ms" + }, + { + "at": "1789228144146808", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144146823", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144146837", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144146851", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146865", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144146879", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144146893", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146908", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144146944", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147022", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147098", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144147111", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147124", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147135", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144147145", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler305)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144147158", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler305)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144147169", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144147181", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144147191", + "member": "nas01.glab.lol", + "message": " my_disc:0x8e3ceb62 your_disc:0x6fe320e4" + }, + { + "at": "1789228144147202", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144147213", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144147223", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144147234", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144147252", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144147262", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144147272", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144147283", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591526010ms" + }, + { + "at": "1789228144147293", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +824ms" + }, + { + "at": "1789228144147309", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144147321", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144147332", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144147342", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147353", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144147363", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147374", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147384", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144147423", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147433", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147443", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144147458", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144147467", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147478", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144147489", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler305)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144147504", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144147515", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144147525", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144147535", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144147545", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144147555", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144147565", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +824ms" + }, + { + "at": "1789228144147580", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144147589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144147599", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144147609", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147619", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144147630", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147639", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147650", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144147663", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147673", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147682", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144147692", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147701", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147710", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145865025", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145865537", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145865575", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145865601", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145865626", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145865651", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145865674", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145865699", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +36ms" + }, + { + "at": "1789228145865727", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -844ms" + }, + { + "at": "1789228145865754", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145865774", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145865800", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145865817", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145865832", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145865847", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145865863", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145865878", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145865897", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145865925", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145865941", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145865956", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145865972", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228153849232", + "member": "nas01.glab.lol", + "message": "ovs|00244|connmgr|INFO|br-int<->unix#7: 955 flow_mods in the 6 s starting 10 s ago (865 adds, 88 deletes, 2 modifications)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-teardown.txt new file mode 100644 index 0000000..7af6e2f --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-after-teardown.txt @@ -0,0 +1,5734 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ovn-nbctl list HA_Chassis_Group === +=== ovn-nbctl list HA_Chassis === +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144049088", + "member": "lab01.glab.lol", + "message": "ovs|84417|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144049912", + "member": "lab01.glab.lol", + "message": "ovs|84418|bridge|INFO|bridge incusovn16: using datapath ID 00002e04465f3d4b" + }, + { + "at": "1789228144049944", + "member": "lab01.glab.lol", + "message": "ovs|84419|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144052199", + "member": "lab01.glab.lol", + "message": "ovs|84420|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144052298", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144052339", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144052365", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144052386", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144052410", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144052434", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144052466", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144052493", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144052522", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144052541", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144052559", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144052578", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144052607", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144052623", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144052642", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144052670", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144052692", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144052710", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144052728", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144052754", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144052783", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144052808", + "member": "lab01.glab.lol", + "message": "ovs|84421|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144052837", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144052858", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144052873", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144052890", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144052908", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144052927", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144052948", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144052965", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144052981", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144053002", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144053022", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053047", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144053064", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144053079", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053105", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144053122", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144053143", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053161", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144053179", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144053197", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053221", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144053244", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144053266", + "member": "lab01.glab.lol", + "message": "ovs|84422|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144053295", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144053317", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144053343", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144053364", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144053387", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144053401", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144053418", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144053435", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144053454", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144053475", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144053492", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053517", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144053551", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144053568", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053582", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144053605", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144053620", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053643", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144053657", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144053674", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053690", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144147061", + "member": "lab01.glab.lol", + "message": "ovs|84423|dpif|WARN|Dropped 981 log messages in last 244 seconds (most recently, 243 seconds ago) due to excessive rate" + }, + { + "at": "1789228144147147", + "member": "lab01.glab.lol", + "message": "ovs|84424|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144147186", + "member": "lab01.glab.lol", + "message": "ovs|84425|bridge|WARN|Dropped 55517 log messages in last 270 seconds (most recently, 243 seconds ago) due to excessive rate" + }, + { + "at": "1789228144147219", + "member": "lab01.glab.lol", + "message": "ovs|84426|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144147521", + "member": "lab01.glab.lol", + "message": "ovs|84427|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144147549", + "member": "lab01.glab.lol", + "message": "ovs|84428|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144147860", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler294)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144147979", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler294)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228144148022", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144148069", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144148099", + "member": "lab01.glab.lol", + "message": " my_disc:0x6fe320e4 your_disc:0x0" + }, + { + "at": "1789228144148131", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144148167", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144148195", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144148232", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144148735", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144148814", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144148850", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144148889", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422148ms" + }, + { + "at": "1789228144148934", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422148ms" + }, + { + "at": "1789228144148980", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422148ms" + }, + { + "at": "1789228144149026", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144149055", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144149096", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149132", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144149166", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144149194", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149231", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144149267", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144149305", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149340", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144149370", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144149398", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149436", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144149472", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144149526", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144149565", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144149591", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144149629", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144149656", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144149692", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144149726", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422148ms" + }, + { + "at": "1789228144149754", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422148ms" + }, + { + "at": "1789228144149781", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144149807", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144149835", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149858", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144149888", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144149914", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149938", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144149965", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144149998", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144150031", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144150066", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144150106", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144150133", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144150160", + "member": "lab01.glab.lol", + "message": "ovs|84429|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144150204", + "member": "lab01.glab.lol", + "message": "ovs|84430|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144151637", + "member": "lab01.glab.lol", + "message": "ovs|84431|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144151679", + "member": "lab01.glab.lol", + "message": "ovs|84432|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144151715", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler294)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144151760", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler294)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144151793", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144151820", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144151845", + "member": "lab01.glab.lol", + "message": " my_disc:0xaf3b4f6c your_disc:0x0" + }, + { + "at": "1789228144151870", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144151889", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144151913", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144151933", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144151958", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144151979", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144151997", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144152022", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422152ms" + }, + { + "at": "1789228144152048", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +820ms" + }, + { + "at": "1789228144152066", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144152087", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144152114", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144152132", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152156", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144152175", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152199", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152220", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144152244", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144152261", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152285", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144152311", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144152335", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152356", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144152374", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144152394", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144152413", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144152435", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144152454", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144152468", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144152489", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144152505", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +820ms" + }, + { + "at": "1789228144152526", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144152550", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144152571", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144152589", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152603", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144152625", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152646", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152666", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144152683", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144152699", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152722", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144152743", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152768", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152787", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144153144", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler294)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144153250", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler294)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144153300", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144153330", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144153359", + "member": "lab01.glab.lol", + "message": " my_disc:0x7e915dec your_disc:0x0" + }, + { + "at": "1789228144153390", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144153429", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144153456", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144153496", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144153537", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144153573", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144153609", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144153647", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422153ms" + }, + { + "at": "1789228144153686", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +660ms" + }, + { + "at": "1789228144153726", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144153759", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144153787", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144153822", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144153850", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144153874", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144153902", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144153929", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144153962", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144153997", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154021", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228144154060", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144154093", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154117", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144154148", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144154184", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144154219", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144154241", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144154266", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144154289", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144154316", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144154347", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +660ms" + }, + { + "at": "1789228144154376", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144154405", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144154434", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144154457", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154476", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144154506", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144154533", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154559", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144154582", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144154608", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154629", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228144154653", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144154673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154698", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144154722", + "member": "lab01.glab.lol", + "message": "ovs|84433|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144154750", + "member": "lab01.glab.lol", + "message": "ovs|84434|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228144154779", + "member": "lab01.glab.lol", + "message": "ovs|84435|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228145027204", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145027273", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145027293", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145027308", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145027324", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145027335", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145027346", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145027360", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228145027374", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228145027394", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145027416", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145027437", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145027447", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228145027462", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145027479", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145027499", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145027514", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145027532", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145027548", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228145027562", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145027572", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145027582", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145091711", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145091907", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145091963", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145091974", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145091999", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145092017", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145092033", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145092045", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228145092059", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -120ms" + }, + { + "at": "1789228145092073", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145092093", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145092108", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145092128", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228145092151", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145092161", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145092170", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145092183", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145092192", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145092202", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228145092221", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145092236", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145092256", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145123050", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145123132", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145123154", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145123167", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145123182", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145123193", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145123202", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145123212", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +520ms" + }, + { + "at": "1789228145123232", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -310ms" + }, + { + "at": "1789228145123255", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145123275", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145123287", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145123305", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228145123314", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145123330", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145123349", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145123369", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145123384", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145123399", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228145123414", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145123423", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145123433", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145146585", + "member": "lab01.glab.lol", + "message": "ovs|84436|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228145146645", + "member": "lab01.glab.lol", + "message": "ovs|84437|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228145374305", + "member": "lab01.glab.lol", + "message": "ovs|84438|bridge|INFO|bridge br-int: added interface veth4081215f on port 36" + }, + { + "at": "1789228146146775", + "member": "lab01.glab.lol", + "message": "ovs|84439|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228146147014", + "member": "lab01.glab.lol", + "message": "ovs|84440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228146687937", + "member": "lab01.glab.lol", + "message": "ovs|84441|poll_loop|INFO|Dropped 2589 log messages in last 246 seconds (most recently, 244 seconds ago) due to excessive rate" + }, + { + "at": "1789228146688040", + "member": "lab01.glab.lol", + "message": "ovs|84442|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146688334", + "member": "lab01.glab.lol", + "message": "ovs|84443|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146688936", + "member": "lab01.glab.lol", + "message": "ovs|84444|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146689316", + "member": "lab01.glab.lol", + "message": "ovs|84445|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146690041", + "member": "lab01.glab.lol", + "message": "ovs|84446|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146690420", + "member": "lab01.glab.lol", + "message": "ovs|84447|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146691050", + "member": "lab01.glab.lol", + "message": "ovs|84448|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146691390", + "member": "lab01.glab.lol", + "message": "ovs|84449|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146692003", + "member": "lab01.glab.lol", + "message": "ovs|84450|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146692387", + "member": "lab01.glab.lol", + "message": "ovs|84451|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228147146699", + "member": "lab01.glab.lol", + "message": "ovs|84452|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228147146794", + "member": "lab01.glab.lol", + "message": "ovs|84453|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228148147116", + "member": "lab01.glab.lol", + "message": "ovs|84454|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228148147368", + "member": "lab01.glab.lol", + "message": "ovs|84455|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228149146894", + "member": "lab01.glab.lol", + "message": "ovs|84456|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228149147000", + "member": "lab01.glab.lol", + "message": "ovs|84457|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228150146746", + "member": "lab01.glab.lol", + "message": "ovs|84458|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228150146954", + "member": "lab01.glab.lol", + "message": "ovs|84459|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228151146945", + "member": "lab01.glab.lol", + "message": "ovs|84460|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228151147153", + "member": "lab01.glab.lol", + "message": "ovs|84461|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228152146815", + "member": "lab01.glab.lol", + "message": "ovs|84462|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228152146951", + "member": "lab01.glab.lol", + "message": "ovs|84463|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228152687650", + "member": "lab01.glab.lol", + "message": "ovs|84464|poll_loop|INFO|Dropped 12173 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228152687832", + "member": "lab01.glab.lol", + "message": "ovs|84465|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228153146848", + "member": "lab01.glab.lol", + "message": "ovs|84466|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228153146980", + "member": "lab01.glab.lol", + "message": "ovs|84467|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228154055008", + "member": "lab01.glab.lol", + "message": "ovs|84468|connmgr|INFO|br-int<->unix#7: 889 flow_mods in the 6 s starting 10 s ago (827 adds, 55 deletes, 7 modifications)" + }, + { + "at": "1789228154146780", + "member": "lab01.glab.lol", + "message": "ovs|84469|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228154146860", + "member": "lab01.glab.lol", + "message": "ovs|84470|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228155146597", + "member": "lab01.glab.lol", + "message": "ovs|84471|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228155146799", + "member": "lab01.glab.lol", + "message": "ovs|84472|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228156146876", + "member": "lab01.glab.lol", + "message": "ovs|84473|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228156147064", + "member": "lab01.glab.lol", + "message": "ovs|84474|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228157146729", + "member": "lab01.glab.lol", + "message": "ovs|84475|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228157146840", + "member": "lab01.glab.lol", + "message": "ovs|84476|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228158146821", + "member": "lab01.glab.lol", + "message": "ovs|84477|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228158147128", + "member": "lab01.glab.lol", + "message": "ovs|84478|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228158687963", + "member": "lab01.glab.lol", + "message": "ovs|84479|poll_loop|INFO|Dropped 12277 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228158688018", + "member": "lab01.glab.lol", + "message": "ovs|84480|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228159146982", + "member": "lab01.glab.lol", + "message": "ovs|84481|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228159147161", + "member": "lab01.glab.lol", + "message": "ovs|84482|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228160146644", + "member": "lab01.glab.lol", + "message": "ovs|84483|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228160146746", + "member": "lab01.glab.lol", + "message": "ovs|84484|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228161146979", + "member": "lab01.glab.lol", + "message": "ovs|84485|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228161147170", + "member": "lab01.glab.lol", + "message": "ovs|84486|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228162146959", + "member": "lab01.glab.lol", + "message": "ovs|84487|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228162147089", + "member": "lab01.glab.lol", + "message": "ovs|84488|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228163146697", + "member": "lab01.glab.lol", + "message": "ovs|84489|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228163146786", + "member": "lab01.glab.lol", + "message": "ovs|84490|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228164146546", + "member": "lab01.glab.lol", + "message": "ovs|84491|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228164146731", + "member": "lab01.glab.lol", + "message": "ovs|84492|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228164687672", + "member": "lab01.glab.lol", + "message": "ovs|84493|poll_loop|INFO|Dropped 12344 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228164687766", + "member": "lab01.glab.lol", + "message": "ovs|84494|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228165146556", + "member": "lab01.glab.lol", + "message": "ovs|84495|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228165146759", + "member": "lab01.glab.lol", + "message": "ovs|84496|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228166146678", + "member": "lab01.glab.lol", + "message": "ovs|84497|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228166146908", + "member": "lab01.glab.lol", + "message": "ovs|84498|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228167146749", + "member": "lab01.glab.lol", + "message": "ovs|84499|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228167146988", + "member": "lab01.glab.lol", + "message": "ovs|84500|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228168146861", + "member": "lab01.glab.lol", + "message": "ovs|84501|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228168147175", + "member": "lab01.glab.lol", + "message": "ovs|84502|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228169146967", + "member": "lab01.glab.lol", + "message": "ovs|84503|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228169147184", + "member": "lab01.glab.lol", + "message": "ovs|84504|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228169283003", + "member": "lab01.glab.lol", + "message": "ovs|84505|bridge|INFO|bridge br-int: deleted interface veth4081215f on port 36" + }, + { + "at": "1789228170146645", + "member": "lab01.glab.lol", + "message": "ovs|84506|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228170146727", + "member": "lab01.glab.lol", + "message": "ovs|84507|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228170687562", + "member": "lab01.glab.lol", + "message": "ovs|84508|poll_loop|INFO|Dropped 12309 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228170687751", + "member": "lab01.glab.lol", + "message": "ovs|84509|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228171146539", + "member": "lab01.glab.lol", + "message": "ovs|84510|dpif|WARN|Dropped 2135 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228171146605", + "member": "lab01.glab.lol", + "message": "ovs|84511|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228171855521", + "member": "lab01.glab.lol", + "message": "ovs|84512|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228171855719", + "member": "lab01.glab.lol", + "message": "ovs|84513|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228171877232", + "member": "lab01.glab.lol", + "message": "ovs|84514|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228171877283", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144036901", + "member": "lab02.glab.lol", + "message": "ovs|00230|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144037060", + "member": "lab02.glab.lol", + "message": "ovs|00231|bridge|INFO|bridge incusovn16: using datapath ID 0000d28f4d3fcb4c" + }, + { + "at": "1789228144037081", + "member": "lab02.glab.lol", + "message": "ovs|00232|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144038884", + "member": "lab02.glab.lol", + "message": "ovs|00233|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144038941", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144038963", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144038986", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144039001", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144039015", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039033", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399038ms" + }, + { + "at": "1789228144039052", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399038ms" + }, + { + "at": "1789228144039067", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399038ms" + }, + { + "at": "1789228144039081", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144039096", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144039111", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039127", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144039142", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144039155", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039169", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144039186", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144039202", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039216", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144039231", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144039247", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039262", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144039276", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144047179", + "member": "lab02.glab.lol", + "message": "ovs|00234|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144047204", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144047215", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144047226", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144047237", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144047247", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144047257", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399046ms" + }, + { + "at": "1789228144047270", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399046ms" + }, + { + "at": "1789228144047284", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399046ms" + }, + { + "at": "1789228144047296", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144047306", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144047317", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047328", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144047345", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144047356", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047366", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144047377", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144047386", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047400", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144047411", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144047420", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047432", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144047443", + "member": "lab02.glab.lol", + "message": "ovs|00235|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144047457", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144047466", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144047475", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144047484", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144047495", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144047506", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399046ms" + }, + { + "at": "1789228144047514", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399046ms" + }, + { + "at": "1789228144047524", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399046ms" + }, + { + "at": "1789228144047534", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144047545", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144047555", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047569", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144047579", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144047589", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047600", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144047610", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144047621", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047630", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144047640", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144047651", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047660", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144132800", + "member": "lab02.glab.lol", + "message": "ovs|00236|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228144132840", + "member": "lab02.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228144140016", + "member": "lab02.glab.lol", + "message": "ovs|00238|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228144140087", + "member": "lab02.glab.lol", + "message": "ovs|00239|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789228144820226", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler295)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144820362", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler295)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144820402", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144820446", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144820471", + "member": "lab02.glab.lol", + "message": " my_disc:0xbaaac142 your_disc:0x8c8504e0" + }, + { + "at": "1789228144820495", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144820517", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144820538", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144820559", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144820579", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144820603", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144820628", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144820653", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399819ms" + }, + { + "at": "1789228144820678", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +269ms" + }, + { + "at": "1789228144820702", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -681ms" + }, + { + "at": "1789228144820728", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144820750", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144820774", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144820796", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144820818", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144820838", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144820869", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144820892", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144820919", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144820944", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbaaac142" + }, + { + "at": "1789228144820972", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144820997", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821019", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144821041", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler295)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144821065", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144821086", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144821107", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144821128", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144821157", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144821181", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144821206", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +269ms" + }, + { + "at": "1789228144821227", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -681ms" + }, + { + "at": "1789228144821249", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144821271", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144821292", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144821314", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144821336", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144821358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821379", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144821407", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144821431", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144821453", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbaaac142" + }, + { + "at": "1789228144821480", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144821506", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821528", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144960320", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler295)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144960444", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler295)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144960477", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144960508", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144960531", + "member": "lab02.glab.lol", + "message": " my_disc:0x8d32d78d your_disc:0xaf3b4f6c" + }, + { + "at": "1789228144960555", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144960585", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144960607", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144960628", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144960650", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144960670", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144960700", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144960719", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399959ms" + }, + { + "at": "1789228144960745", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +109ms" + }, + { + "at": "1789228144960768", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -821ms" + }, + { + "at": "1789228144960795", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144960816", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144960837", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144960857", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144960884", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144960906", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144960927", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144960949", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144960971", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144960993", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144961021", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144961044", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961068", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144961096", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler295)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144961125", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144961152", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144961171", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144961198", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144961218", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144961239", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144961261", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +109ms" + }, + { + "at": "1789228144961285", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -821ms" + }, + { + "at": "1789228144961304", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144961325", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144961347", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144961367", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144961388", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144961422", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961445", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144961465", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144961483", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144961505", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144961526", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144961549", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961573", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145015082", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler295)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228145015167", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler295)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228145015197", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228145015218", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228145015237", + "member": "lab02.glab.lol", + "message": " my_disc:0x4cdc18a your_disc:0x4e9b73c0" + }, + { + "at": "1789228145015257", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228145015278", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228145015298", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228145015325", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145015347", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145015369", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145015389", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145015422", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591400014ms" + }, + { + "at": "1789228145015447", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +844ms" + }, + { + "at": "1789228145015472", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -126ms" + }, + { + "at": "1789228145015497", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145015521", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228145015543", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145015563", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145015586", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145015609", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145015630", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145015658", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228145015700", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145015722", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145015742", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228145015764", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145015783", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145015802", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler295)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145015822", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145015841", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145015862", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145015881", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145015900", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145015918", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145015939", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +844ms" + }, + { + "at": "1789228145015958", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -126ms" + }, + { + "at": "1789228145015979", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145016000", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228145016021", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145016047", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145016066", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145016087", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145016107", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145016127", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228145016147", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145016166", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145016187", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145016209", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145016231", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228154041803", + "member": "lab02.glab.lol", + "message": "ovs|00240|connmgr|INFO|br-int<->unix#7: 876 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 8 modifications)" + }, + { + "at": "1789228171851340", + "member": "lab02.glab.lol", + "message": "ovs|00241|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228171851475", + "member": "lab02.glab.lol", + "message": "ovs|00242|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228171851489", + "member": "lab02.glab.lol", + "message": "ovs|00243|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228171868178", + "member": "lab02.glab.lol", + "message": "ovs|00244|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789228171868369", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144035012", + "member": "lab03.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144035571", + "member": "lab03.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge incusovn16: using datapath ID 00001a8092d1f448" + }, + { + "at": "1789228144035615", + "member": "lab03.glab.lol", + "message": "ovs|00256|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144039766", + "member": "lab03.glab.lol", + "message": "ovs|00257|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144039848", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144039881", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144039904", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144039932", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144039950", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039974", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299037ms" + }, + { + "at": "1789228144039993", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299037ms" + }, + { + "at": "1789228144040013", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299037ms" + }, + { + "at": "1789228144040032", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144040050", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144040080", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040102", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144040121", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144040143", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040162", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144040179", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144040202", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040219", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144040236", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144040256", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040274", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144040294", + "member": "lab03.glab.lol", + "message": "ovs|00258|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144040317", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144040334", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144040351", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144040368", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144040385", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144040404", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144040424", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299037ms" + }, + { + "at": "1789228144040441", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299037ms" + }, + { + "at": "1789228144040461", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299037ms" + }, + { + "at": "1789228144040483", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144040500", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144040516", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040535", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144040554", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144040568", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040585", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144040601", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144040618", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040634", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144040651", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144040671", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040691", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144048618", + "member": "lab03.glab.lol", + "message": "ovs|00259|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144048708", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144048736", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144048751", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144048759", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144048767", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144048774", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299046ms" + }, + { + "at": "1789228144048785", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299046ms" + }, + { + "at": "1789228144048799", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299046ms" + }, + { + "at": "1789228144048808", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144048816", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144048824", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144048832", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144048839", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144048848", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144048855", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144048863", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144048871", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144048878", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144048887", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144048895", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144048905", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144134204", + "member": "lab03.glab.lol", + "message": "ovs|00260|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228144134253", + "member": "lab03.glab.lol", + "message": "ovs|00261|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228144134973", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler297)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144135089", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler297)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228144135432", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144135512", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144135543", + "member": "lab03.glab.lol", + "message": " my_disc:0x6345f596 your_disc:0x0" + }, + { + "at": "1789228144135574", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144135602", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144135626", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144135651", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144135675", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144135699", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144135723", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144135750", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299132ms" + }, + { + "at": "1789228144135778", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299132ms" + }, + { + "at": "1789228144135813", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299132ms" + }, + { + "at": "1789228144135839", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144135863", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144135893", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144135917", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144135940", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144135965", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144135991", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144136014", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144136051", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136082", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228144136116", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144136145", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136171", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144136198", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144136225", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144136248", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144136272", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144136299", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144136320", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144136347", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144136381", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299132ms" + }, + { + "at": "1789228144136404", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299132ms" + }, + { + "at": "1789228144136428", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144136454", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144136477", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136498", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144136521", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144136545", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136568", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144136589", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144136610", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136638", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228144136663", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144136691", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136714", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144139158", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler297)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144139207", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler297)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144139235", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144139260", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144139288", + "member": "lab03.glab.lol", + "message": " my_disc:0x8c8504e0 your_disc:0x0" + }, + { + "at": "1789228144139315", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144139338", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144139365", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144139388", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144139412", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144139436", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144139460", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144139483", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299137ms" + }, + { + "at": "1789228144139509", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228144139543", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144139572", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144139596", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144139619", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144139643", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144139668", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144139692", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144139718", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144139742", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144139763", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144139791", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144139821", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144139844", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144139868", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144139889", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144139916", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144139945", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144139969", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144139992", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144140015", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144140036", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144140057", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228144140092", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144140117", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144140140", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144140164", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144140187", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144140211", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144140236", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144140260", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144140281", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144140308", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144140331", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144140354", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144140376", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144140397", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144142114", + "member": "lab03.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228144142202", + "member": "lab03.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789228144800973", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler297)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144801070", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler297)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144801116", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144801148", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144801175", + "member": "lab03.glab.lol", + "message": " my_disc:0x2fa091ec your_disc:0x7e915dec" + }, + { + "at": "1789228144801202", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144801231", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144801256", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144801283", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144801306", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144801328", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144801351", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144801373", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299798ms" + }, + { + "at": "1789228144801399", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +310ms" + }, + { + "at": "1789228144801431", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789228144801460", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144801484", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144801508", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144801532", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144801556", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144801579", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144801606", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144801629", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144801698", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144801729", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144801754", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144801775", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144801803", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144801827", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler297)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144801851", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144801876", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144801968", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144801995", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144802021", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144802045", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144802078", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +310ms" + }, + { + "at": "1789228144802102", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789228144802128", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144802149", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144802172", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144802194", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144802223", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144802245", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144802271", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144802294", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144802317", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144802343", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144802367", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144802390", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144802413", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145085488", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145085763", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145085832", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145085876", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145085905", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145085930", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145085955", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145085979", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +5ms" + }, + { + "at": "1789228145086003", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -945ms" + }, + { + "at": "1789228145086026", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145086048", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145086088", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145086116", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228145086139", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145086161", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145086184", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145086206", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145086229", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145086252", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228145086275", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145086299", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145086501", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145089687", + "member": "lab03.glab.lol", + "message": "ovs|00011|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145089769", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145089799", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145089821", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145089847", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145089875", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145089900", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145089923", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228145089945", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -270ms" + }, + { + "at": "1789228145089970", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145089992", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145090012", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145090034", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228145090056", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145090088", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145090111", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145090135", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145090157", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145090180", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228145090203", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145090223", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145090243", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228146132119", + "member": "lab03.glab.lol", + "message": "ovs|00264|bridge|INFO|bridge br-int: added interface veth44cf6ffb on port 34" + }, + { + "at": "1789228154043684", + "member": "lab03.glab.lol", + "message": "ovs|00265|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)" + }, + { + "at": "1789228170426301", + "member": "lab03.glab.lol", + "message": "ovs|00266|bridge|INFO|bridge br-int: deleted interface veth44cf6ffb on port 34" + }, + { + "at": "1789228171848112", + "member": "lab03.glab.lol", + "message": "ovs|00267|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228171848403", + "member": "lab03.glab.lol", + "message": "ovs|00268|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228171848609", + "member": "lab03.glab.lol", + "message": "ovs|00269|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228171871163", + "member": "lab03.glab.lol", + "message": "ovs|00270|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789228171871503", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228143843878", + "member": "nas01.glab.lol", + "message": "ovs|00234|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228143844074", + "member": "nas01.glab.lol", + "message": "ovs|00235|bridge|INFO|bridge incusovn16: using datapath ID 0000b6aad5427645" + }, + { + "at": "1789228143844089", + "member": "nas01.glab.lol", + "message": "ovs|00236|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228143942029", + "member": "nas01.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228143942109", + "member": "nas01.glab.lol", + "message": "ovs|00238|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228143947034", + "member": "nas01.glab.lol", + "message": "ovs|00239|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228143947076", + "member": "nas01.glab.lol", + "message": "ovs|00240|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228144038874", + "member": "nas01.glab.lol", + "message": "ovs|00241|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144038918", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144038942", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144038959", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144038969", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144038986", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039005", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525902ms" + }, + { + "at": "1789228144039017", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525902ms" + }, + { + "at": "1789228144039029", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525902ms" + }, + { + "at": "1789228144039038", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144039049", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144039060", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039071", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144039087", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144039099", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039108", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144039121", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144039131", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039169", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144039184", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144039197", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039208", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144039518", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144042987", + "member": "nas01.glab.lol", + "message": "ovs|00242|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144043004", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144043015", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144043026", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144043036", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144043046", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144043056", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525907ms" + }, + { + "at": "1789228144043068", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525907ms" + }, + { + "at": "1789228144043079", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525907ms" + }, + { + "at": "1789228144043089", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144043099", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144043108", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144043118", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144043129", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144043139", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144043160", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144043175", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144043189", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144043204", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144043219", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144043232", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144043246", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144045315", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler305)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144045535", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler305)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144045582", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144045627", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144045660", + "member": "nas01.glab.lol", + "message": " my_disc:0x4e9b73c0 your_disc:0x0" + }, + { + "at": "1789228144045693", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144045722", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144045740", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144045754", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144045769", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144045784", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144045799", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144045818", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525909ms" + }, + { + "at": "1789228144045834", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +974ms" + }, + { + "at": "1789228144045850", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144045868", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144045883", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144045902", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144045932", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144045948", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144045963", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144045980", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144045994", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144046012", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046027", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144046043", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144046058", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046073", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144046089", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144046107", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144046122", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144046137", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144046150", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144046166", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144046181", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144046203", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +974ms" + }, + { + "at": "1789228144046218", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144046231", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144046246", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144046260", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046273", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144046287", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144046301", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046318", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144046333", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144046346", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046361", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144046375", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144046394", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046409", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144049823", + "member": "nas01.glab.lol", + "message": "ovs|00243|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144049854", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144049866", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144049879", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144049894", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144049905", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144049929", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525913ms" + }, + { + "at": "1789228144049947", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525913ms" + }, + { + "at": "1789228144049958", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525913ms" + }, + { + "at": "1789228144049968", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144049978", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144049988", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144049997", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144050007", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144050017", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144050033", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144050047", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144050062", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144050078", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144050092", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144050108", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144050140", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144146094", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler305)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144146224", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler305)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144146245", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144146271", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144146292", + "member": "nas01.glab.lol", + "message": " my_disc:0xb2dcf063 your_disc:0x6345f596" + }, + { + "at": "1789228144146307", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144146322", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144146345", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144146361", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144146376", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144146391", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144146407", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144146428", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591526010ms" + }, + { + "at": "1789228144146446", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +944ms" + }, + { + "at": "1789228144146463", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144146478", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144146493", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144146507", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146522", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144146543", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144146558", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146573", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144146589", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144146610", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146623", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144146644", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144146659", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146674", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144146689", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler305)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144146706", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144146721", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144146735", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144146750", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144146765", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144146779", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144146793", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +944ms" + }, + { + "at": "1789228144146808", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144146823", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144146837", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144146851", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146865", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144146879", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144146893", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146908", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144146944", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147022", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147098", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144147111", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147124", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147135", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144147145", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler305)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144147158", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler305)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144147169", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144147181", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144147191", + "member": "nas01.glab.lol", + "message": " my_disc:0x8e3ceb62 your_disc:0x6fe320e4" + }, + { + "at": "1789228144147202", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144147213", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144147223", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144147234", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144147252", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144147262", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144147272", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144147283", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591526010ms" + }, + { + "at": "1789228144147293", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +824ms" + }, + { + "at": "1789228144147309", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144147321", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144147332", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144147342", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147353", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144147363", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147374", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147384", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144147423", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147433", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147443", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144147458", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144147467", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147478", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144147489", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler305)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144147504", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144147515", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144147525", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144147535", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144147545", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144147555", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144147565", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +824ms" + }, + { + "at": "1789228144147580", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144147589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144147599", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144147609", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147619", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144147630", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147639", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147650", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144147663", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147673", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147682", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144147692", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147701", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147710", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145865025", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145865537", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145865575", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145865601", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145865626", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145865651", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145865674", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145865699", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +36ms" + }, + { + "at": "1789228145865727", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -844ms" + }, + { + "at": "1789228145865754", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145865774", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145865800", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145865817", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145865832", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145865847", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145865863", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145865878", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145865897", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145865925", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145865941", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145865956", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145865972", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228153849232", + "member": "nas01.glab.lol", + "message": "ovs|00244|connmgr|INFO|br-int<->unix#7: 955 flow_mods in the 6 s starting 10 s ago (865 adds, 88 deletes, 2 modifications)" + }, + { + "at": "1789228171854929", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor321)|INFO|monitor thread terminated" + }, + { + "at": "1789228171857623", + "member": "nas01.glab.lol", + "message": "ovs|00245|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228171857675", + "member": "nas01.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228171857693", + "member": "nas01.glab.lol", + "message": "ovs|00247|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228171879925", + "member": "nas01.glab.lol", + "message": "ovs|00248|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-before-probe.txt new file mode 100644 index 0000000..7b9229d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/diagnostics-before-probe.txt @@ -0,0 +1,5498 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:fa:34:71 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:b5:a6:1d | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch e88c8df6-ece6-47fd-a7fe-5b4f27b757a6 (incus-net36-ls-int) + port incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0 + addresses: ["10:66:6a:fa:34:71 dynamic"] + port incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0 + addresses: ["10:66:6a:b5:a6:1d dynamic"] + port incus-net36-ls-int-lsp-router + type: router + router-port: incus-net36-lr-lrp-int +switch 2eb3d377-43ac-4726-9d9e-38b2eacd0a32 (incus-net36-ls-ext) + port incus-net36-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net36-ls-ext-lsp-router + type: router + router-port: incus-net36-lr-lrp-ext +router bc73d56b-f557-4331-90a4-674d5b5358d8 (incus-net36-lr) + port incus-net36-lr-lrp-int + mac: "10:66:6a:ef:03:ee" + ipv6-lla: "fe80::1266:6aff:feef:3ee" + networks: ["10.253.73.1/24"] + port incus-net36-lr-lrp-ext + mac: "10:66:6a:ef:03:ee" + ipv6-lla: "fe80::1266:6aff:feef:3ee" + networks: ["10.10.40.64/24"] + nat d1708fa6-e54a-418c-8898-e6418433f6ab + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net36-instance-7494d1d7-f784-4978-abd8-d8e3cae1414c-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net36-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net36-instance-1500421f-eae8-4703-a5ad-36cccc32d607-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : d14f4591-3990-4964-9c05-9c0cee5828be +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ef:03:ee" +name : incus-net36-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : fd00ec3f-deb9-4bf5-9d44-e57633fe2062 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ef:03:ee" +name : incus-net36-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 2bf3bac8-cfa3-4a1d-84bb-924f1d103157 +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : 3316399c-503f-4e27-87f2-a52de668b028 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 9f453b2e-04c6-416c-8ded-750b1a34dfc4 +logical_port : cr-incus-net36-lr-lrp-ext +mac : ["10:66:6a:ef:03:ee 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net36-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : 69ad8bcb-a0f5-40e0-8d12-f1835c565b6e +external_ids : {} +ha_chassis : [35cd8d65-8ba5-4f8b-9266-91a6abef3a86, 75dd6966-985e-48f4-bdd4-bfb54d363e6f, 84eaad05-4254-4156-99ab-8262e0bc85e0, bd15f386-184e-46d8-b32f-0dd0b68470df] +name : incus-net36 +=== ovn-nbctl list HA_Chassis === +_uuid : 84eaad05-4254-4156-99ab-8262e0bc85e0 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 13433 + +_uuid : 35cd8d65-8ba5-4f8b-9266-91a6abef3a86 +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 28146 + +_uuid : bd15f386-184e-46d8-b32f-0dd0b68470df +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 29916 + +_uuid : 75dd6966-985e-48f4-bdd4-bfb54d363e6f +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 6914 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee DELAY +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144049088", + "member": "lab01.glab.lol", + "message": "ovs|84417|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144049912", + "member": "lab01.glab.lol", + "message": "ovs|84418|bridge|INFO|bridge incusovn16: using datapath ID 00002e04465f3d4b" + }, + { + "at": "1789228144049944", + "member": "lab01.glab.lol", + "message": "ovs|84419|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144052199", + "member": "lab01.glab.lol", + "message": "ovs|84420|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144052298", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144052339", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144052365", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144052386", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144052410", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144052434", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144052466", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144052493", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144052522", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144052541", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144052559", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144052578", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144052607", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144052623", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144052642", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144052670", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144052692", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144052710", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144052728", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144052754", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144052783", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144052808", + "member": "lab01.glab.lol", + "message": "ovs|84421|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144052837", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144052858", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144052873", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144052890", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144052908", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144052927", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144052948", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144052965", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144052981", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144053002", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144053022", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053047", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144053064", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144053079", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053105", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144053122", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144053143", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053161", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144053179", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144053197", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053221", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144053244", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144053266", + "member": "lab01.glab.lol", + "message": "ovs|84422|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144053295", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144053317", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144053343", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144053364", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144053387", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144053401", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422052ms" + }, + { + "at": "1789228144053418", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422052ms" + }, + { + "at": "1789228144053435", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422052ms" + }, + { + "at": "1789228144053454", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144053475", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144053492", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053517", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144053551", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144053568", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053582", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144053605", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144053620", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144053643", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144053657", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144053674", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144053690", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144147061", + "member": "lab01.glab.lol", + "message": "ovs|84423|dpif|WARN|Dropped 981 log messages in last 244 seconds (most recently, 243 seconds ago) due to excessive rate" + }, + { + "at": "1789228144147147", + "member": "lab01.glab.lol", + "message": "ovs|84424|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144147186", + "member": "lab01.glab.lol", + "message": "ovs|84425|bridge|WARN|Dropped 55517 log messages in last 270 seconds (most recently, 243 seconds ago) due to excessive rate" + }, + { + "at": "1789228144147219", + "member": "lab01.glab.lol", + "message": "ovs|84426|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144147521", + "member": "lab01.glab.lol", + "message": "ovs|84427|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144147549", + "member": "lab01.glab.lol", + "message": "ovs|84428|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144147860", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler294)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144147979", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler294)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228144148022", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144148069", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144148099", + "member": "lab01.glab.lol", + "message": " my_disc:0x6fe320e4 your_disc:0x0" + }, + { + "at": "1789228144148131", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144148167", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144148195", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144148232", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144148735", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144148814", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144148850", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144148889", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422148ms" + }, + { + "at": "1789228144148934", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422148ms" + }, + { + "at": "1789228144148980", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422148ms" + }, + { + "at": "1789228144149026", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144149055", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144149096", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149132", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144149166", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144149194", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149231", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144149267", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144149305", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149340", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144149370", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144149398", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149436", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144149472", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144149526", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144149565", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144149591", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144149629", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144149656", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144149692", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144149726", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542422148ms" + }, + { + "at": "1789228144149754", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542422148ms" + }, + { + "at": "1789228144149781", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144149807", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144149835", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144149858", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144149888", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144149914", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144149938", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144149965", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144149998", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144150031", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144150066", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144150106", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144150133", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144150160", + "member": "lab01.glab.lol", + "message": "ovs|84429|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144150204", + "member": "lab01.glab.lol", + "message": "ovs|84430|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144151637", + "member": "lab01.glab.lol", + "message": "ovs|84431|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144151679", + "member": "lab01.glab.lol", + "message": "ovs|84432|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228144151715", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler294)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144151760", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler294)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144151793", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144151820", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144151845", + "member": "lab01.glab.lol", + "message": " my_disc:0xaf3b4f6c your_disc:0x0" + }, + { + "at": "1789228144151870", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144151889", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144151913", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144151933", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144151958", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144151979", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144151997", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144152022", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422152ms" + }, + { + "at": "1789228144152048", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +820ms" + }, + { + "at": "1789228144152066", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144152087", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144152114", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144152132", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152156", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144152175", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152199", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152220", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144152244", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144152261", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152285", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144152311", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144152335", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152356", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144152374", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144152394", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144152413", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144152435", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144152454", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144152468", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144152489", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144152505", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +820ms" + }, + { + "at": "1789228144152526", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144152550", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144152571", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144152589", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152603", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144152625", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152646", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152666", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144152683", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144152699", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144152722", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144152743", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144152768", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144152787", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144153144", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler294)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144153250", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler294)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144153300", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144153330", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144153359", + "member": "lab01.glab.lol", + "message": " my_disc:0x7e915dec your_disc:0x0" + }, + { + "at": "1789228144153390", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144153429", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144153456", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144153496", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144153537", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144153573", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144153609", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144153647", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542422153ms" + }, + { + "at": "1789228144153686", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +660ms" + }, + { + "at": "1789228144153726", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144153759", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144153787", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144153822", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144153850", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144153874", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144153902", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144153929", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144153962", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144153997", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154021", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228144154060", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144154093", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154117", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144154148", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144154184", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144154219", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144154241", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144154266", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144154289", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144154316", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144154347", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +660ms" + }, + { + "at": "1789228144154376", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144154405", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144154434", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144154457", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154476", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144154506", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144154533", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154559", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144154582", + "member": "lab01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144154608", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144154629", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228144154653", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144154673", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144154698", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144154722", + "member": "lab01.glab.lol", + "message": "ovs|84433|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228144154750", + "member": "lab01.glab.lol", + "message": "ovs|84434|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228144154779", + "member": "lab01.glab.lol", + "message": "ovs|84435|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228145027204", + "member": "lab01.glab.lol", + "message": "ovs|00010|bfd(handler294)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145027273", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145027293", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145027308", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145027324", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145027335", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145027346", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145027360", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +16ms" + }, + { + "at": "1789228145027374", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -874ms" + }, + { + "at": "1789228145027394", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145027416", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145027437", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145027447", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228145027462", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145027479", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145027499", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145027514", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145027532", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145027548", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x6fe320e4" + }, + { + "at": "1789228145027562", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145027572", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145027582", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145091711", + "member": "lab01.glab.lol", + "message": "ovs|00011|bfd(handler294)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145091907", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145091963", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145091974", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145091999", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145092017", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145092033", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145092045", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228145092059", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -120ms" + }, + { + "at": "1789228145092073", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145092093", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145092108", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145092128", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8d32d78d" + }, + { + "at": "1789228145092151", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145092161", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145092170", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145092183", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145092192", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145092202", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228145092221", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145092236", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145092256", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145123050", + "member": "lab01.glab.lol", + "message": "ovs|00012|bfd(handler294)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145123132", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145123154", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145123167", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145123182", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145123193", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145123202", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145123212", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +520ms" + }, + { + "at": "1789228145123232", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -310ms" + }, + { + "at": "1789228145123255", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145123275", + "member": "lab01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145123287", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145123305", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x2fa091ec" + }, + { + "at": "1789228145123314", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145123330", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145123349", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145123369", + "member": "lab01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145123384", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145123399", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x7e915dec" + }, + { + "at": "1789228145123414", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145123423", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145123433", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145146585", + "member": "lab01.glab.lol", + "message": "ovs|84436|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228145146645", + "member": "lab01.glab.lol", + "message": "ovs|84437|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228145374305", + "member": "lab01.glab.lol", + "message": "ovs|84438|bridge|INFO|bridge br-int: added interface veth4081215f on port 36" + }, + { + "at": "1789228146146775", + "member": "lab01.glab.lol", + "message": "ovs|84439|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228146147014", + "member": "lab01.glab.lol", + "message": "ovs|84440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228146687937", + "member": "lab01.glab.lol", + "message": "ovs|84441|poll_loop|INFO|Dropped 2589 log messages in last 246 seconds (most recently, 244 seconds ago) due to excessive rate" + }, + { + "at": "1789228146688040", + "member": "lab01.glab.lol", + "message": "ovs|84442|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146688334", + "member": "lab01.glab.lol", + "message": "ovs|84443|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146688936", + "member": "lab01.glab.lol", + "message": "ovs|84444|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146689316", + "member": "lab01.glab.lol", + "message": "ovs|84445|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146690041", + "member": "lab01.glab.lol", + "message": "ovs|84446|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146690420", + "member": "lab01.glab.lol", + "message": "ovs|84447|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146691050", + "member": "lab01.glab.lol", + "message": "ovs|84448|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146691390", + "member": "lab01.glab.lol", + "message": "ovs|84449|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146692003", + "member": "lab01.glab.lol", + "message": "ovs|84450|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228146692387", + "member": "lab01.glab.lol", + "message": "ovs|84451|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (83% CPU usage)" + }, + { + "at": "1789228147146699", + "member": "lab01.glab.lol", + "message": "ovs|84452|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228147146794", + "member": "lab01.glab.lol", + "message": "ovs|84453|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228148147116", + "member": "lab01.glab.lol", + "message": "ovs|84454|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228148147368", + "member": "lab01.glab.lol", + "message": "ovs|84455|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228149146894", + "member": "lab01.glab.lol", + "message": "ovs|84456|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228149147000", + "member": "lab01.glab.lol", + "message": "ovs|84457|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228150146746", + "member": "lab01.glab.lol", + "message": "ovs|84458|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228150146954", + "member": "lab01.glab.lol", + "message": "ovs|84459|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144036901", + "member": "lab02.glab.lol", + "message": "ovs|00230|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144037060", + "member": "lab02.glab.lol", + "message": "ovs|00231|bridge|INFO|bridge incusovn16: using datapath ID 0000d28f4d3fcb4c" + }, + { + "at": "1789228144037081", + "member": "lab02.glab.lol", + "message": "ovs|00232|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144038884", + "member": "lab02.glab.lol", + "message": "ovs|00233|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144038941", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144038963", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144038986", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144039001", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144039015", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039033", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399038ms" + }, + { + "at": "1789228144039052", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399038ms" + }, + { + "at": "1789228144039067", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399038ms" + }, + { + "at": "1789228144039081", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144039096", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144039111", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039127", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144039142", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144039155", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039169", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144039186", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144039202", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039216", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144039231", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144039247", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039262", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144039276", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144047179", + "member": "lab02.glab.lol", + "message": "ovs|00234|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144047204", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144047215", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144047226", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144047237", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144047247", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144047257", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399046ms" + }, + { + "at": "1789228144047270", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399046ms" + }, + { + "at": "1789228144047284", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399046ms" + }, + { + "at": "1789228144047296", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144047306", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144047317", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047328", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144047345", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144047356", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047366", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144047377", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144047386", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047400", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144047411", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144047420", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047432", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144047443", + "member": "lab02.glab.lol", + "message": "ovs|00235|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144047457", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144047466", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144047475", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144047484", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144047495", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144047506", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399046ms" + }, + { + "at": "1789228144047514", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591399046ms" + }, + { + "at": "1789228144047524", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591399046ms" + }, + { + "at": "1789228144047534", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144047545", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144047555", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047569", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144047579", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144047589", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047600", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144047610", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144047621", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144047630", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144047640", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144047651", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144047660", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144132800", + "member": "lab02.glab.lol", + "message": "ovs|00236|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228144132840", + "member": "lab02.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228144140016", + "member": "lab02.glab.lol", + "message": "ovs|00238|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228144140087", + "member": "lab02.glab.lol", + "message": "ovs|00239|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789228144820226", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler295)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144820362", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler295)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144820402", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144820446", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144820471", + "member": "lab02.glab.lol", + "message": " my_disc:0xbaaac142 your_disc:0x8c8504e0" + }, + { + "at": "1789228144820495", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144820517", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144820538", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144820559", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144820579", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144820603", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144820628", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144820653", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399819ms" + }, + { + "at": "1789228144820678", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +269ms" + }, + { + "at": "1789228144820702", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -681ms" + }, + { + "at": "1789228144820728", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144820750", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144820774", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144820796", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144820818", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144820838", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144820869", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144820892", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144820919", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144820944", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbaaac142" + }, + { + "at": "1789228144820972", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144820997", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821019", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144821041", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler295)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144821065", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144821086", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144821107", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144821128", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144821157", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144821181", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144821206", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +269ms" + }, + { + "at": "1789228144821227", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -681ms" + }, + { + "at": "1789228144821249", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144821271", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144821292", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144821314", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144821336", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144821358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821379", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144821407", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144821431", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144821453", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xbaaac142" + }, + { + "at": "1789228144821480", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144821506", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144821528", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144960320", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler295)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144960444", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler295)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144960477", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144960508", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144960531", + "member": "lab02.glab.lol", + "message": " my_disc:0x8d32d78d your_disc:0xaf3b4f6c" + }, + { + "at": "1789228144960555", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144960585", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144960607", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144960628", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144960650", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144960670", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144960700", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144960719", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591399959ms" + }, + { + "at": "1789228144960745", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +109ms" + }, + { + "at": "1789228144960768", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -821ms" + }, + { + "at": "1789228144960795", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144960816", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144960837", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144960857", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144960884", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144960906", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144960927", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144960949", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144960971", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144960993", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144961021", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144961044", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961068", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144961096", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler295)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144961125", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144961152", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144961171", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144961198", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144961218", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144961239", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144961261", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +109ms" + }, + { + "at": "1789228144961285", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -821ms" + }, + { + "at": "1789228144961304", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144961325", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144961347", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144961367", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xaf3b4f6c" + }, + { + "at": "1789228144961388", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144961422", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961445", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144961465", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144961483", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144961505", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8d32d78d" + }, + { + "at": "1789228144961526", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144961549", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144961573", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145015082", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler295)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228145015167", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler295)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228145015197", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228145015218", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228145015237", + "member": "lab02.glab.lol", + "message": " my_disc:0x4cdc18a your_disc:0x4e9b73c0" + }, + { + "at": "1789228145015257", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228145015278", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228145015298", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228145015325", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145015347", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145015369", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145015389", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145015422", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591400014ms" + }, + { + "at": "1789228145015447", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +844ms" + }, + { + "at": "1789228145015472", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -126ms" + }, + { + "at": "1789228145015497", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145015521", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228145015543", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145015563", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145015586", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145015609", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145015630", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145015658", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228145015700", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145015722", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145015742", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228145015764", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145015783", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145015802", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler295)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145015822", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145015841", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145015862", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145015881", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145015900", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145015918", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145015939", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +844ms" + }, + { + "at": "1789228145015958", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -126ms" + }, + { + "at": "1789228145015979", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145016000", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228145016021", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145016047", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145016066", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145016087", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145016107", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145016127", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228145016147", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145016166", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145016187", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145016209", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145016231", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228144035012", + "member": "lab03.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228144035571", + "member": "lab03.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge incusovn16: using datapath ID 00001a8092d1f448" + }, + { + "at": "1789228144035615", + "member": "lab03.glab.lol", + "message": "ovs|00256|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228144039766", + "member": "lab03.glab.lol", + "message": "ovs|00257|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144039848", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144039881", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144039904", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144039932", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144039950", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039974", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299037ms" + }, + { + "at": "1789228144039993", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299037ms" + }, + { + "at": "1789228144040013", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299037ms" + }, + { + "at": "1789228144040032", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144040050", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144040080", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040102", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144040121", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144040143", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040162", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144040179", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144040202", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040219", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144040236", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144040256", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040274", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144040294", + "member": "lab03.glab.lol", + "message": "ovs|00258|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144040317", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144040334", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144040351", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144040368", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144040385", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144040404", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144040424", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299037ms" + }, + { + "at": "1789228144040441", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299037ms" + }, + { + "at": "1789228144040461", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299037ms" + }, + { + "at": "1789228144040483", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144040500", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144040516", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040535", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144040554", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144040568", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040585", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144040601", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144040618", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144040634", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144040651", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144040671", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144040691", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144048618", + "member": "lab03.glab.lol", + "message": "ovs|00259|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144048708", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144048736", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144048751", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144048759", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144048767", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144048774", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299046ms" + }, + { + "at": "1789228144048785", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299046ms" + }, + { + "at": "1789228144048799", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299046ms" + }, + { + "at": "1789228144048808", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144048816", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144048824", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144048832", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144048839", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144048848", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144048855", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144048863", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144048871", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144048878", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144048887", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144048895", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144048905", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144134204", + "member": "lab03.glab.lol", + "message": "ovs|00260|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228144134253", + "member": "lab03.glab.lol", + "message": "ovs|00261|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228144134973", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler297)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144135089", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler297)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228144135432", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144135512", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144135543", + "member": "lab03.glab.lol", + "message": " my_disc:0x6345f596 your_disc:0x0" + }, + { + "at": "1789228144135574", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144135602", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144135626", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144135651", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144135675", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144135699", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144135723", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144135750", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299132ms" + }, + { + "at": "1789228144135778", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299132ms" + }, + { + "at": "1789228144135813", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299132ms" + }, + { + "at": "1789228144135839", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144135863", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144135893", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144135917", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144135940", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144135965", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144135991", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144136014", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144136051", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136082", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228144136116", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144136145", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136171", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144136198", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144136225", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144136248", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144136272", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144136299", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144136320", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144136347", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144136381", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50299132ms" + }, + { + "at": "1789228144136404", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50299132ms" + }, + { + "at": "1789228144136428", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144136454", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144136477", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136498", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144136521", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144136545", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136568", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144136589", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144136610", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144136638", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228144136663", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144136691", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144136714", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144139158", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler297)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144139207", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler297)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144139235", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144139260", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144139288", + "member": "lab03.glab.lol", + "message": " my_disc:0x8c8504e0 your_disc:0x0" + }, + { + "at": "1789228144139315", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144139338", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144139365", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144139388", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144139412", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144139436", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144139460", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144139483", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299137ms" + }, + { + "at": "1789228144139509", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228144139543", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144139572", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144139596", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144139619", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144139643", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144139668", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144139692", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144139718", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144139742", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144139763", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144139791", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144139821", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144139844", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144139868", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144139889", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144139916", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144139945", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144139969", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144139992", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144140015", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144140036", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144140057", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228144140092", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228144140117", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144140140", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144140164", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144140187", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228144140211", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144140236", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144140260", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144140281", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144140308", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144140331", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228144140354", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144140376", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144140397", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144142114", + "member": "lab03.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228144142202", + "member": "lab03.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 33" + }, + { + "at": "1789228144800973", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler297)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144801070", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler297)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144801116", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144801148", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144801175", + "member": "lab03.glab.lol", + "message": " my_disc:0x2fa091ec your_disc:0x7e915dec" + }, + { + "at": "1789228144801202", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144801231", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144801256", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144801283", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144801306", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144801328", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144801351", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144801373", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50299798ms" + }, + { + "at": "1789228144801399", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +310ms" + }, + { + "at": "1789228144801431", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789228144801460", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144801484", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144801508", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144801532", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144801556", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144801579", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144801606", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144801629", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144801698", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144801729", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144801754", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144801775", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144801803", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144801827", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler297)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144801851", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144801876", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144801968", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144801995", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144802021", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144802045", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144802078", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +310ms" + }, + { + "at": "1789228144802102", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -660ms" + }, + { + "at": "1789228144802128", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144802149", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144802172", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144802194", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x7e915dec" + }, + { + "at": "1789228144802223", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144802245", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144802271", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144802294", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144802317", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144802343", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x2fa091ec" + }, + { + "at": "1789228144802367", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144802390", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144802413", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145085488", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler297)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145085763", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145085832", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145085876", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145085905", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145085930", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145085955", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145085979", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +5ms" + }, + { + "at": "1789228145086003", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -945ms" + }, + { + "at": "1789228145086026", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145086048", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145086088", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145086116", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xb2dcf063" + }, + { + "at": "1789228145086139", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145086161", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145086184", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145086206", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145086229", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145086252", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x6345f596" + }, + { + "at": "1789228145086275", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145086299", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145086501", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145089687", + "member": "lab03.glab.lol", + "message": "ovs|00011|bfd(handler297)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145089769", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145089799", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145089821", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145089847", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145089875", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145089900", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145089923", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +680ms" + }, + { + "at": "1789228145089945", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -270ms" + }, + { + "at": "1789228145089970", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145089992", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145090012", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145090034", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xbaaac142" + }, + { + "at": "1789228145090056", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145090088", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145090111", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145090135", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145090157", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145090180", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x8c8504e0" + }, + { + "at": "1789228145090203", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145090223", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145090243", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228146132119", + "member": "lab03.glab.lol", + "message": "ovs|00264|bridge|INFO|bridge br-int: added interface veth44cf6ffb on port 34" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228143843878", + "member": "nas01.glab.lol", + "message": "ovs|00234|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228143844074", + "member": "nas01.glab.lol", + "message": "ovs|00235|bridge|INFO|bridge incusovn16: using datapath ID 0000b6aad5427645" + }, + { + "at": "1789228143844089", + "member": "nas01.glab.lol", + "message": "ovs|00236|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228143942029", + "member": "nas01.glab.lol", + "message": "ovs|00237|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228143942109", + "member": "nas01.glab.lol", + "message": "ovs|00238|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228143947034", + "member": "nas01.glab.lol", + "message": "ovs|00239|bridge|INFO|bridge incusovn16: added interface patch-incus-net36-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228143947076", + "member": "nas01.glab.lol", + "message": "ovs|00240|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net36-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789228144038874", + "member": "nas01.glab.lol", + "message": "ovs|00241|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144038918", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144038942", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144038959", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144038969", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144038986", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144039005", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525902ms" + }, + { + "at": "1789228144039017", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525902ms" + }, + { + "at": "1789228144039029", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525902ms" + }, + { + "at": "1789228144039038", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144039049", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144039060", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039071", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144039087", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144039099", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039108", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144039121", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144039131", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144039169", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144039184", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144039197", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144039208", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144039518", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor321)|INFO|monitor thread created" + }, + { + "at": "1789228144042987", + "member": "nas01.glab.lol", + "message": "ovs|00242|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144043004", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144043015", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144043026", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144043036", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144043046", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144043056", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525907ms" + }, + { + "at": "1789228144043068", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525907ms" + }, + { + "at": "1789228144043079", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525907ms" + }, + { + "at": "1789228144043089", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144043099", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144043108", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144043118", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144043129", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144043139", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144043160", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144043175", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144043189", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144043204", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144043219", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144043232", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144043246", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144045315", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler305)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144045535", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler305)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228144045582", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228144045627", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144045660", + "member": "nas01.glab.lol", + "message": " my_disc:0x4e9b73c0 your_disc:0x0" + }, + { + "at": "1789228144045693", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144045722", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144045740", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144045754", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144045769", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144045784", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144045799", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144045818", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525909ms" + }, + { + "at": "1789228144045834", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +974ms" + }, + { + "at": "1789228144045850", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144045868", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144045883", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144045902", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144045932", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144045948", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144045963", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144045980", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144045994", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144046012", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046027", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144046043", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144046058", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046073", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144046089", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144046107", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144046122", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144046137", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144046150", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144046166", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144046181", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144046203", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +974ms" + }, + { + "at": "1789228144046218", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144046231", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144046246", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144046260", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046273", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228144046287", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144046301", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046318", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144046333", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228144046346", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144046361", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228144046375", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144046394", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144046409", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144049823", + "member": "nas01.glab.lol", + "message": "ovs|00243|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144049854", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144049866", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144049879", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144049894", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144049905", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228144049929", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591525913ms" + }, + { + "at": "1789228144049947", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591525913ms" + }, + { + "at": "1789228144049958", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591525913ms" + }, + { + "at": "1789228144049968", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144049978", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228144049988", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144049997", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144050007", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144050017", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228144050033", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144050047", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228144050062", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144050078", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228144050092", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144050108", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228144050140", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228144146094", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler305)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144146224", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler305)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228144146245", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144146271", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144146292", + "member": "nas01.glab.lol", + "message": " my_disc:0xb2dcf063 your_disc:0x6345f596" + }, + { + "at": "1789228144146307", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144146322", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144146345", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144146361", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144146376", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144146391", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144146407", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144146428", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591526010ms" + }, + { + "at": "1789228144146446", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +944ms" + }, + { + "at": "1789228144146463", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144146478", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144146493", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144146507", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146522", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144146543", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144146558", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146573", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144146589", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144146610", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146623", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144146644", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144146659", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146674", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144146689", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler305)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144146706", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144146721", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144146735", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144146750", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144146765", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144146779", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144146793", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +944ms" + }, + { + "at": "1789228144146808", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144146823", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144146837", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144146851", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144146865", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6345f596" + }, + { + "at": "1789228144146879", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144146893", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144146908", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144146944", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147022", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147098", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xb2dcf063" + }, + { + "at": "1789228144147111", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147124", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147135", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144147145", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler305)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228144147158", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler305)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228144147169", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228144147181", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228144147191", + "member": "nas01.glab.lol", + "message": " my_disc:0x8e3ceb62 your_disc:0x6fe320e4" + }, + { + "at": "1789228144147202", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228144147213", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228144147223", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228144147234", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144147252", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144147262", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144147272", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144147283", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591526010ms" + }, + { + "at": "1789228144147293", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +824ms" + }, + { + "at": "1789228144147309", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144147321", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144147332", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144147342", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147353", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144147363", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147374", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147384", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144147423", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147433", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147443", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144147458", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228144147467", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147478", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228144147489", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler305)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228144147504", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228144147515", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228144147525", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228144147535", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228144147545", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228144147555", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228144147565", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +824ms" + }, + { + "at": "1789228144147580", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789228144147589", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228144147599", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228144147609", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147619", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x6fe320e4" + }, + { + "at": "1789228144147630", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147639", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147650", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228144147663", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228144147673", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228144147682", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8e3ceb62" + }, + { + "at": "1789228144147692", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228144147701", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228144147710", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228145865025", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler305)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228145865537", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228145865575", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228145865601", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228145865626", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228145865651", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228145865674", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228145865699", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +36ms" + }, + { + "at": "1789228145865727", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -844ms" + }, + { + "at": "1789228145865754", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228145865774", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228145865800", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228145865817", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x4cdc18a" + }, + { + "at": "1789228145865832", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228145865847", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145865863", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228145865878", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228145865897", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228145865925", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x4e9b73c0" + }, + { + "at": "1789228145865941", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228145865956", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228145865972", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.debug.log new file mode 100644 index 0000000..d09b4b4 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:49:02-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.log new file mode 100644 index 0000000..d00db3c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-create.log @@ -0,0 +1,535 @@ +time="2026-09-12T15:49:02Z" level=debug msg="[nas01] Event listener server handler started" id=8eb04e1e-a320-4447-b04e-768882028520 local="10.10.10.14:8443" remote="100.122.142.76:56116" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56134" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56135" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56136" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56137" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56138" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56139" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56140" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56141" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56142" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56143" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:ef:03:ee" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.36 +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:49:03Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net36 driver=ovn memberID=1 network=default priority=29916 project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56144" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56145" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56146" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56147" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56148" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56149" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56150" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56151" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56152" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Event listener server handler started" id=2f673bce-829e-4c48-a5bf-d9f26fac45c9 local="10.10.10.14:8443" remote="100.122.142.76:56152" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56153" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=d0f2dc33-69a3-4e2a-84ba-768a9966cc80 project=image-build +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=d0f2dc33-69a3-4e2a-84ba-768a9966cc80 project=image-build +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56165" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Event listener server handler started" id=e51fa62c-ec18-4d13-a2f8-31ee0a525eff local="10.10.10.14:8443" remote="100.122.142.76:56165" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56166" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=f28b6273-fc1d-4023-8148-5771e85b4d98 project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=f28b6273-fc1d-4023-8148-5771e85b4d98 project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56167" method=GET protocol=tls url="/1.0/operations/f28b6273-fc1d-4023-8148-5771e85b4d98?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=f28b6273-fc1d-4023-8148-5771e85b4d98 project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=f28b6273-fc1d-4023-8148-5771e85b4d98 project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2f673bce-829e-4c48-a5bf-d9f26fac45c9 local="10.10.10.14:8443" remote="100.122.142.76:56152" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e51fa62c-ec18-4d13-a2f8-31ee0a525eff local="10.10.10.14:8443" remote="100.122.142.76:56165" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56168" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56169" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"2122af4a-1888-412c-8023-643133619b15\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:49:04.810643049Z\",\n\t\t\"updated_at\": \"2026-09-12T15:49:04.810643049Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56170" method=GET protocol=tls url="/1.0/operations/2122af4a-1888-412c-8023-643133619b15/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:04Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:49:04Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56171" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56172" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56173" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Event listener server handler started" id=35ba0e4c-1fd4-4bb8-a9c1-4377e8453f99 local="10.10.10.14:8443" remote="100.122.142.76:56173" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56174" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:05Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 15:49:04.83508965 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56175" method=GET protocol=tls url="/1.0/operations/d95148fd-4e09-493a-8e5a-8c6043562be0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:05Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 15:49:04.83508965 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Event listener server handler stopped" listener=35ba0e4c-1fd4-4bb8-a9c1-4377e8453f99 local="10.10.10.14:8443" remote="100.122.142.76:56173" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56176" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56177" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"20d03355-19af-4c6a-939d-75485db45b09\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:49:05.645835514Z\",\n\t\t\"updated_at\": \"2026-09-12T15:49:05.645835514Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56178" method=GET protocol=tls url="/1.0/operations/20d03355-19af-4c6a-939d-75485db45b09/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:05Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:49:05Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:49:05Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.64 network=default project=ac-ovn-spike +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56179" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56180" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56181" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Event listener server handler started" id=22b016ac-f663-4458-b17a-c67f64697efb local="10.10.10.14:8443" remote="100.122.142.76:56181" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56182" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:06Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 15:49:05.659809306 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56183" method=GET protocol=tls url="/1.0/operations/6e20023d-cf22-4e71-b752-7cdf252d72dd?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 15:49:05.659809306 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Event listener server handler stopped" listener=22b016ac-f663-4458-b17a-c67f64697efb local="10.10.10.14:8443" remote="100.122.142.76:56181" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56184" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56185" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56186" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56187" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56247" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56249" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56252" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56253" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56254" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56255" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Event listener server handler started" id=76192b78-d0fb-4758-8494-5ebcaecfa926 local="10.10.10.14:8443" remote="100.122.142.76:56255" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56256" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:06Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56257" method=GET protocol=tls url="/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=08cfd255c885a234c2e1559ea5bea0a714bf5a68cb50750b7c406e4a10d64320" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56257" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=08cfd255c885a234c2e1559ea5bea0a714bf5a68cb50750b7c406e4a10d64320" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56258" method=GET protocol=tls url="/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=407652ac9ff197633c5fc34aac3778d06bbe100cc83dfefb4b106afe2454aeaa" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56258" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=407652ac9ff197633c5fc34aac3778d06bbe100cc83dfefb4b106afe2454aeaa" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56259" method=GET protocol=tls url="/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=b7571b4e7383e5e75ddb0c08ae34deb429f80402beab0a3317091d9a9f78dfd5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56259" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=b7571b4e7383e5e75ddb0c08ae34deb429f80402beab0a3317091d9a9f78dfd5" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56260" method=GET protocol=tls url="/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=13f404ea8d4bed19de576a2eec7a4f26fd3e2edd96227e6b1155191b4ba97d39" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56260" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6/websocket?secret=13f404ea8d4bed19de576a2eec7a4f26fd3e2edd96227e6b1155191b4ba97d39" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56258" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56261" method=GET protocol=tls url="/1.0/operations/53a2b1b4-02a9-491a-a023-2a37df6a80f6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56259" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56257" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56260" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Event listener server handler stopped" listener=76192b78-d0fb-4758-8494-5ebcaecfa926 local="10.10.10.14:8443" remote="100.122.142.76:56255" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56262" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56263" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56264" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56265" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Event listener server handler started" id=0f4d16f6-810d-43b1-807f-5885823ffa71 local="10.10.10.14:8443" remote="100.122.142.76:56265" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56266" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56267" method=GET protocol=tls url="/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=510569fc9dad2d45e9837e99a8c19d28f8e49ab1a3efc67efdd2d8279cd2dfe2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56267" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=510569fc9dad2d45e9837e99a8c19d28f8e49ab1a3efc67efdd2d8279cd2dfe2" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56268" method=GET protocol=tls url="/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=3e4b5090462b52e86ad14fcebb1f4f87a974371b20139e78eebce1716bfda397" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56268" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=3e4b5090462b52e86ad14fcebb1f4f87a974371b20139e78eebce1716bfda397" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56269" method=GET protocol=tls url="/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=995d4b32e1b443ad5c5e095054ed02c5672c16d226c0089a7217deb4c568a759" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56269" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=995d4b32e1b443ad5c5e095054ed02c5672c16d226c0089a7217deb4c568a759" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56270" method=GET protocol=tls url="/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=6be9f7af122b9b6288b6d65ddcc1178058fa3bce67d07a8bfcd35285268766b0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180/websocket?secret=6be9f7af122b9b6288b6d65ddcc1178058fa3bce67d07a8bfcd35285268766b0" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56270" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56268" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56271" method=GET protocol=tls url="/1.0/operations/2ea72c09-057f-4007-a426-237337fc2180?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56267" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56269" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56270" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Event listener server handler stopped" listener=0f4d16f6-810d-43b1-807f-5885823ffa71 local="10.10.10.14:8443" remote="100.122.142.76:56265" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56272" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56273" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Event listener server handler started" id=cdba2b1e-31c4-4e97-bbe8-8d43579e4f82 local="10.10.10.14:8443" remote="100.122.142.76:56273" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56274" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56275" method=GET protocol=tls url="/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=4d044cfd0383895e4c0d1983e847fa3be47017af5aabcbbc2b35139319bf4db6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=4d044cfd0383895e4c0d1983e847fa3be47017af5aabcbbc2b35139319bf4db6" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56275" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56276" method=GET protocol=tls url="/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=80210c3ff5920f4126333e982d351995aaccca96cf6d5ea891432ac058d20494" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56276" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=80210c3ff5920f4126333e982d351995aaccca96cf6d5ea891432ac058d20494" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56277" method=GET protocol=tls url="/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=c674e5e412abf9506329fce2565b4a045d48ce6cf096aad349df4a45d38d4739" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=c674e5e412abf9506329fce2565b4a045d48ce6cf096aad349df4a45d38d4739" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56277" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56278" method=GET protocol=tls url="/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=d5cba4b096e031339294ef638cbbc9f819c40eacfddcc0ea2bc7f68489a4d0e7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56278" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856/websocket?secret=d5cba4b096e031339294ef638cbbc9f819c40eacfddcc0ea2bc7f68489a4d0e7" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56276" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56279" method=GET protocol=tls url="/1.0/operations/c3a46bc6-b736-455d-9c53-76e94165d856?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56275" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56278" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56277" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Event listener server handler stopped" listener=cdba2b1e-31c4-4e97-bbe8-8d43579e4f82 local="10.10.10.14:8443" remote="100.122.142.76:56273" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56280" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56281" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56282" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56283" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Event listener server handler started" id=67209d13-70eb-4ff5-a8cb-15469953630e local="10.10.10.14:8443" remote="100.122.142.76:56283" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56284" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56285" method=GET protocol=tls url="/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=5a14b8ae275835b4f674c666a5f915bfd9b3b09338ebee6b4154e7ee07bdba2b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56285" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=5a14b8ae275835b4f674c666a5f915bfd9b3b09338ebee6b4154e7ee07bdba2b" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56286" method=GET protocol=tls url="/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=24a9660a04c73b32d0da489bbe8413b1f15e9e8470e7476a819b5ef7cf86174c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=24a9660a04c73b32d0da489bbe8413b1f15e9e8470e7476a819b5ef7cf86174c" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56286" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56287" method=GET protocol=tls url="/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=b43e010697cce9f7e380416609b9cf80d9108384d2c0e6a802e8ef0e1dba0bdf" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56287" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=b43e010697cce9f7e380416609b9cf80d9108384d2c0e6a802e8ef0e1dba0bdf" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56288" method=GET protocol=tls url="/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=0580e8e3705cefc99b76f85486d9c1735460aee9a886ddce7a30dc85c74bb07d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56288" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1/websocket?secret=0580e8e3705cefc99b76f85486d9c1735460aee9a886ddce7a30dc85c74bb07d" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56286" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56289" method=GET protocol=tls url="/1.0/operations/5b603efb-9f61-4097-a9f4-ea6fba7a89a1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56287" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56285" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56288" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Event listener server handler stopped" listener=67209d13-70eb-4ff5-a8cb-15469953630e local="10.10.10.14:8443" remote="100.122.142.76:56283" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56290" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56291" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Event listener server handler started" id=8e48a22e-2eb7-48a8-a423-8d402ed43923 local="10.10.10.14:8443" remote="100.122.142.76:56291" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56292" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56293" method=GET protocol=tls url="/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=5df5ae7a1c6eb7767d3fcec391b061c2b025a541f877c4858330dfbe584531f2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56293" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=5df5ae7a1c6eb7767d3fcec391b061c2b025a541f877c4858330dfbe584531f2" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56294" method=GET protocol=tls url="/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=c0786e5d67ed5b2f57d24ac1f30f563c4f14aef8f5813143c3cc965a8771e6f2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56294" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=c0786e5d67ed5b2f57d24ac1f30f563c4f14aef8f5813143c3cc965a8771e6f2" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56295" method=GET protocol=tls url="/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=73d3ed6c600bdab9e766abb222c9aad33edbe6c58ab1bbac4a6256554a83a8aa" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56295" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=73d3ed6c600bdab9e766abb222c9aad33edbe6c58ab1bbac4a6256554a83a8aa" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56296" method=GET protocol=tls url="/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=f067833339f482c75a9cc066970ff6272dad66ae16fedf5f20f04efdf1ab9d22" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56296" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5/websocket?secret=f067833339f482c75a9cc066970ff6272dad66ae16fedf5f20f04efdf1ab9d22" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56294" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56297" method=GET protocol=tls url="/1.0/operations/798efdea-66d3-4560-aff4-61befd6f21b5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56295" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56296" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56293" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8e48a22e-2eb7-48a8-a423-8d402ed43923 local="10.10.10.14:8443" remote="100.122.142.76:56291" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56298" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56299" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Event listener server handler started" id=08f17f2c-8237-4c9e-8227-fab04b4d1522 local="10.10.10.14:8443" remote="100.122.142.76:56299" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56300" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56301" method=GET protocol=tls url="/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=4eba696dda005375db029caff62266be7d79094878c7ed7eb4bff0a28f6167f6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56301" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=4eba696dda005375db029caff62266be7d79094878c7ed7eb4bff0a28f6167f6" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56302" method=GET protocol=tls url="/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=863e437bef9212ad61c06b2fdecac222329c6be57b6ad145402358c8cfc38435" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56302" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=863e437bef9212ad61c06b2fdecac222329c6be57b6ad145402358c8cfc38435" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56303" method=GET protocol=tls url="/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=9f9c45685f91537f863486703f04ba0c352c22218594c6d45821e53ba5569e16" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56303" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=9f9c45685f91537f863486703f04ba0c352c22218594c6d45821e53ba5569e16" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56304" method=GET protocol=tls url="/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=d2c53e90195e1e5f0abb1ab6fa1b310b7b40513848a799f1510b90c0c4bf35ce" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d/websocket?secret=d2c53e90195e1e5f0abb1ab6fa1b310b7b40513848a799f1510b90c0c4bf35ce" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:56304" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56302" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56305" method=GET protocol=tls url="/1.0/operations/8974f4c8-e5aa-4f59-9e57-6dae6ce6f00d?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56303" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56304" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:56301" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Event listener server handler stopped" listener=08f17f2c-8237-4c9e-8227-fab04b4d1522 local="10.10.10.14:8443" remote="100.122.142.76:56299" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56306" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56307" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Event listener server handler started" id=b7641de8-1e1e-4878-962c-4755c15f8979 local="10.10.10.14:8443" remote="100.122.142.76:56307" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56308" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56309" method=GET protocol=tls url="/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=392921406c17d07bfb8215adaaad87d7bc7efbf381a3a040d73ce83ed3fe501f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56309" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=392921406c17d07bfb8215adaaad87d7bc7efbf381a3a040d73ce83ed3fe501f" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56310" method=GET protocol=tls url="/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=e73266700a0ac216562706a4694ac6cbcc6a5662c81301ab3ac547a68d211fbb" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56310" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=e73266700a0ac216562706a4694ac6cbcc6a5662c81301ab3ac547a68d211fbb" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56311" method=GET protocol=tls url="/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=872235fb0ba16e74cc1b440a002d7b80d840e71663a3f6a8cd4667c79c870682" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=872235fb0ba16e74cc1b440a002d7b80d840e71663a3f6a8cd4667c79c870682" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56311" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56312" method=GET protocol=tls url="/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=bfd7e5190e2eac9c03fdf7f47b92c4809682ffecb73803355d4df9bfc53aeb51" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:56312" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f/websocket?secret=bfd7e5190e2eac9c03fdf7f47b92c4809682ffecb73803355d4df9bfc53aeb51" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56310" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56313" method=GET protocol=tls url="/1.0/operations/78d82e55-8ab3-4eec-b73c-fe85921cbf5f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56309" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56312" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:56311" +time="2026-09-12T15:49:09Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b7641de8-1e1e-4878-962c-4755c15f8979 local="10.10.10.14:8443" remote="100.122.142.76:56307" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56314" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56315" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:49:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.debug.log new file mode 100644 index 0000000..2833865 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:49:28-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.log new file mode 100644 index 0000000..4da59cd --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/monitor-delete.log @@ -0,0 +1,164 @@ +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Event listener server handler started" id=42284c98-4d0e-4ae0-a2d9-730ba6757ad7 local="10.10.10.14:8443" remote="100.122.142.76:56477" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56478" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56479" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56480" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56481" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:49:05.659809306Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:49:06.209740211Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:49:04.83508965Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:49:05.45788577Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56482" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56483" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56484" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Event listener server handler started" id=2193d8e9-1640-42ae-b0a0-1d006077b7f3 local="10.10.10.14:8443" remote="100.122.142.76:56484" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56485" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:28Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:29Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 15:49:04.83508965 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:49:05.45788577 +0000 UTC" +time="2026-09-12T15:49:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:29Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:29Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56486" method=GET protocol=tls url="/1.0/operations/436b4f1c-2383-4269-a85f-bddaeba40797?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:29Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56487" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:30Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 15:49:04.83508965 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:49:05.45788577 +0000 UTC" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56488" method=GET protocol=tls url="/1.0/operations/40f930e1-f3cf-453d-b93e-9c39fb7c3c48?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:30Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 15:49:04.83508965 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:49:05.45788577 +0000 UTC" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2193d8e9-1640-42ae-b0a0-1d006077b7f3 local="10.10.10.14:8443" remote="100.122.142.76:56484" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56489" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56490" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56491" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Event listener server handler started" id=abdf5004-8aa1-4bde-84e5-2d23bffd7c94 local="10.10.10.14:8443" remote="100.122.142.76:56491" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56492" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:30Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 15:49:05.659809306 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:49:06.209740211 +0000 UTC" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56493" method=GET protocol=tls url="/1.0/operations/e095012f-824b-4d51-b55e-22bfe7e6fca5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:30Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56494" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 15:49:05.659809306 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:49:06.209740211 +0000 UTC" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56495" method=GET protocol=tls url="/1.0/operations/213bed3a-dd4d-4340-9c4d-0599c134c55e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:31Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 15:49:05.659809306 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:49:06.209740211 +0000 UTC" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Event listener server handler stopped" listener=abdf5004-8aa1-4bde-84e5-2d23bffd7c94 local="10.10.10.14:8443" remote="100.122.142.76:56491" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56496" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56497" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56498" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56499" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56500" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56501" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56502" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56503" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56504" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:31Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56505" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56506" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56507" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56508" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56509" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56510" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56511" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56512" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Event listener server handler started" id=383b1ce8-fbec-440d-9580-714590009eb1 local="10.10.10.14:8443" remote="100.122.142.76:56512" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56513" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=8892bf4b-5656-400d-9439-b4680ce355fb project=ac-ovn-spike +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=8892bf4b-5656-400d-9439-b4680ce355fb project=ac-ovn-spike +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=8892bf4b-5656-400d-9439-b4680ce355fb project=ac-ovn-spike +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56514" method=GET protocol=tls url="/1.0/operations/8892bf4b-5656-400d-9439-b4680ce355fb?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Event listener server handler stopped" listener=383b1ce8-fbec-440d-9580-714590009eb1 local="10.10.10.14:8443" remote="100.122.142.76:56512" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56516" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:56517" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:49:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/probe.stdout.txt new file mode 100644 index 0000000..caff53e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/probe.stdout.txt @@ -0,0 +1,137 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.084 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.084 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"6f1bca4c-008f-4747-b440-da094863ef53","volatile.eth0.host_name":"veth4081215f","volatile.eth0.hwaddr":"10:66:6a:fa:34:71","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"1500421f-eae8-4703-a5ad-36cccc32d607","volatile.uuid.generation":"1500421f-eae8-4703-a5ad-36cccc32d607"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:49:04.83508965Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"6f1bca4c-008f-4747-b440-da094863ef53","volatile.eth0.host_name":"veth4081215f","volatile.eth0.hwaddr":"10:66:6a:fa:34:71","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"1500421f-eae8-4703-a5ad-36cccc32d607","volatile.uuid.generation":"1500421f-eae8-4703-a5ad-36cccc32d607"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:49:05.45788577Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9502720,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fefa:3471","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:fa:34:71","host_name":"veth4081215f","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4179249,"processes":4,"cpu":{"usage":525006000,"allocated_time":24000000000},"started_at":"2026-09-12T15:49:04.480000019Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"2a85b9cc-2a71-4735-8327-c1dfca20700f","volatile.eth0.host_name":"veth44cf6ffb","volatile.eth0.hwaddr":"10:66:6a:b5:a6:1d","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"7494d1d7-f784-4978-abd8-d8e3cae1414c","volatile.uuid.generation":"7494d1d7-f784-4978-abd8-d8e3cae1414c"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:49:05.659809306Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"2a85b9cc-2a71-4735-8327-c1dfca20700f","volatile.eth0.host_name":"veth44cf6ffb","volatile.eth0.hwaddr":"10:66:6a:b5:a6:1d","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"7494d1d7-f784-4978-abd8-d8e3cae1414c","volatile.uuid.generation":"7494d1d7-f784-4978-abd8-d8e3cae1414c"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:49:06.209740211Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":12464128,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:feb5:a61d","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:b5:a6:1d","host_name":"veth44cf6ffb","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":36239,"processes":4,"cpu":{"usage":490076000,"allocated_time":24000000000},"started_at":"2026-09-12T15:49:06.210000038Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.094 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.230 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.224 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.089 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.698 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.393 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.393/0.726/1.089 ms +elapsed_seconds=2.239 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.342 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.964 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.364 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.364/0.890/1.342 ms +elapsed_seconds=2.210 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.471 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.704 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.980 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.980/1.718/2.471 ms +elapsed_seconds=2.611 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.555 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.698 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.959 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.959/1.404/1.698 ms +elapsed_seconds=2.496 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Non-authoritative answer: +Name: example.com +Address: 104.20.23.154 +Name: example.com +Address: 172.66.147.243 + +Non-authoritative answer: +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +elapsed_seconds=0.368 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +Name: example.com +Address: 104.20.23.154 +Name: example.com +Address: 172.66.147.243 + +elapsed_seconds=0.314 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.436 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.440 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.081 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.110704 bytes_per_second=903309726 +elapsed_seconds=0.892 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.496 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.106090 bytes_per_second=942595909 +elapsed_seconds=0.367 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.541 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/tcpdump-arp.log new file mode 100644 index 0000000..7a66f76 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +15:49:12.814191 10:66:6a:ef:03:ee > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +15:49:20.816246 10:66:6a:ef:03:ee > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/topology.jsonl new file mode 100644 index 0000000..c5eba44 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-5/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.122, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.142, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.559, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.254, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.414, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:49:04.810643049Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"2122af4a-1888-412c-8023-643133619b15\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:49:04.810643049Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.422, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.362, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:49:05.645835514Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"20d03355-19af-4c6a-939d-75485db45b09\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:49:05.645835514Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.37, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.219, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 176335000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 5935104,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fefa:3471\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth4081215f\",\n\t\t\t\"hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4179249,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:49:04.480000019Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.205, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 128728000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6770688,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:feb5:a61d\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"veth44cf6ffb\",\n\t\t\t\"hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 36239,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:49:06.210000038Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t},\n\t\"created_at\": \"2026-09-12T15:49:04.83508965Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:49:05.45788577Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t},\n\t\"created_at\": \"2026-09-12T15:49:05.659809306Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:49:06.209740211Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.231, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.721 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.721/1.721/1.721 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.315, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.201, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.276, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.326, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-y68untev/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.204, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.291, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.538, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.031043 seconds, 3.0GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.571, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.023994 seconds, 3.9GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.223, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.101, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:49:04.83508965Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"6f1bca4c-008f-4747-b440-da094863ef53\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4081215f\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:fa:34:71\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1500421f-eae8-4703-a5ad-36cccc32d607\",\n\t\t\t\"volatile.uuid.generation\": \"1500421f-eae8-4703-a5ad-36cccc32d607\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:49:05.45788577Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:49:05.659809306Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"2a85b9cc-2a71-4735-8327-c1dfca20700f\",\n\t\t\t\"volatile.eth0.host_name\": \"veth44cf6ffb\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b5:a6:1d\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\",\n\t\t\t\"volatile.uuid.generation\": \"7494d1d7-f784-4978-abd8-d8e3cae1414c\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:49:06.209740211Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.342, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.182, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"lab03\",\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.191, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.147, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.075, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.077, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T15:49:05.699225181Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T15:49:04.688578764Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.16, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.093, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/commands.jsonl new file mode 100644 index 0000000..44d5923 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.101, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:54:36.742237+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.283, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T15:54:37.025386+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.192, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T15:54:37.217532+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 45007, "ready": true, "ready_signal": "time=\"2026-09-12T08:54:37-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:54:37.315687+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/topology.jsonl", "create"], "seconds": 8.783, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.569,\n \"first_cross_member_ping_seconds\": 3.363,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:46.099178+00:00"} +{"capture": "monitor-create", "pid": 45007, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.log", "ready_signal": "time=\"2026-09-12T08:54:37-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:54:46.103401+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.101, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:46.205112+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.085, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:42:ab:f9 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:7e:16:81 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:46.290546+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.139, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch fd4b631c-81c0-4c8e-9e92-dc7cf9a33c9d (incus-net37-ls-ext)\n port incus-net37-ls-ext-lsp-router\n type: router\n router-port: incus-net37-lr-lrp-ext\n port incus-net37-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 684fbd9a-01fc-43aa-a171-d322d63e6887 (incus-net37-ls-int)\n port incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0\n addresses: [\"10:66:6a:7e:16:81 dynamic\"]\n port incus-net37-ls-int-lsp-router\n type: router\n router-port: incus-net37-lr-lrp-int\n port incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0\n addresses: [\"10:66:6a:42:ab:f9 dynamic\"]\nrouter acd84fae-7dea-4d77-b555-dae888322639 (incus-net37-lr)\n port incus-net37-lr-lrp-ext\n mac: \"10:66:6a:b2:7a:65\"\n ipv6-lla: \"fe80::1266:6aff:feb2:7a65\"\n networks: [\"10.10.40.64/24\"]\n port incus-net37-lr-lrp-int\n mac: \"10:66:6a:b2:7a:65\"\n ipv6-lla: \"fe80::1266:6aff:feb2:7a65\"\n networks: [\"10.253.73.1/24\"]\n nat a10b55e2-fd03-497a-b507-27de4d11b529\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net37-lr-lrp-ext\n Port_Binding incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : d629ff1d-a504-49fe-a7c8-f0323ee49c93\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : de608431-0186-4362-86d7-cac077dd05e7\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:b2:7a:65\"\nname : incus-net37-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : e04baf95-5323-4806-8837-59c9e0fbc892\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:b2:7a:65\"\nname : incus-net37-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 70a417e5-7e57-4de0-8d05-1cd489841205\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 62a237be-632c-48ed-8a7b-8844743cd71b\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : ce09c18b-41bd-4255-a48e-d5595868baa0\nlogical_port : cr-incus-net37-lr-lrp-ext\nmac : [\"10:66:6a:b2:7a:65 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net37-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : de608431-0186-4362-86d7-cac077dd05e7\nexternal_ids : {}\nha_chassis : [093d581f-a240-48d1-8523-23f1f4332ef2, 6bae3c80-717c-4b0f-82a0-035c6921b222, aeacbaee-6168-4a6d-ba97-359ec9f0230c, e68ec4f2-be40-49bb-9a54-454bc30f38e8]\nname : incus-net37\n=== ovn-nbctl list HA_Chassis ===\n_uuid : 6bae3c80-717c-4b0f-82a0-035c6921b222\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 30102\n\n_uuid : e68ec4f2-be40-49bb-9a54-454bc30f38e8\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 31425\n\n_uuid : aeacbaee-6168-4a6d-ba97-359ec9f0230c\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 5868\n\n_uuid : 093d581f-a240-48d1-8523-23f1f4332ef2\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 6746\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:54:46.430106+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.294, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee PROBE \n", "stderr": "", "error": null, "at": "2026-09-12T15:54:46.724145+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.198, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479484425\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84516|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479484766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84517|bridge|INFO|bridge incusovn16: using datapath ID 0000fecb28f30f44\"\n },\n {\n \"at\": \"1789228479484807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84518|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479486903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84519|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479486961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479486992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479487020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479487041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479487068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479487089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487152\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479487177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479487239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479487251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487275\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479487293\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479487354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487391\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479487413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84520|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479487444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479487461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479487488\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479487504\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479487520\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479487545\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479487617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479487668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479487682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479487713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479487755\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479487796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479494185\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84521|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479494228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479494250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479494269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479494282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479494299\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479494312\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479494388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479494400\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479494422\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479494442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479494470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479494498\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479494521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479494542\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479494561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494587\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479581012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84522|dpif|WARN|Dropped 1500 log messages in last 308 seconds (most recently, 308 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228479581112\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84523|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479581149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84524|bridge|WARN|Dropped 56686 log messages in last 335 seconds (most recently, 308 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228479581190\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84525|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479581341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479581371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84527|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479582706\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479582786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84529|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479583949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479584037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84531|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479585060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479585181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84533|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479588143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84534|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228479588235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84535|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228480327229\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler327)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480327347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler327)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480327378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480327412\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480327440\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xe975fdaf your_disc:0x8fe124e2\"\n },\n {\n \"at\": \"1789228480327458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480327475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480327497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480327512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480327547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758327ms\"\n },\n {\n \"at\": \"1789228480327599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +90ms\"\n },\n {\n \"at\": \"1789228480327614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -740ms\"\n },\n {\n \"at\": \"1789228480327647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480327659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480327672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480327682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480327700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480327741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480327764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480327838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480327857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480327868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler327)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480327916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480327931\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327942\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480327952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480327996\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +90ms\"\n },\n {\n \"at\": \"1789228480328013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -740ms\"\n },\n {\n \"at\": \"1789228480328022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480328038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480328049\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480328067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480328079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328098\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480328123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480328133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480328144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480328158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403421\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler327)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480403541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler327)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480403572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480403585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480403608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x9b9bc62f your_disc:0x6bc64e34\"\n },\n {\n \"at\": \"1789228480403624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480403636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480403646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480403658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480403685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480403705\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480403725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758403ms\"\n },\n {\n \"at\": \"1789228480403748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -136ms\"\n },\n {\n \"at\": \"1789228480403768\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -916ms\"\n },\n {\n \"at\": \"1789228480403788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480403798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480403809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480403826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480403838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480403878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480403889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480403904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480403926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480403944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403974\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler327)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480403991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480404003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480404021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480404031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480404075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -136ms\"\n },\n {\n \"at\": \"1789228480404087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -916ms\"\n },\n {\n \"at\": \"1789228480404096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480404113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480404126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480404140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480404159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480404191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480404208\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480404217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480404232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler327)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480474355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler327)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480474376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480474392\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480474415\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x45468bf5 your_disc:0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480474448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480474457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480474478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480474512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474523\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474538\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758474ms\"\n },\n {\n \"at\": \"1789228480474560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +713ms\"\n },\n {\n \"at\": \"1789228480474591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -147ms\"\n },\n {\n \"at\": \"1789228480474615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480474636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480474647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474676\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480474717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480474730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228480474762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480474773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474792\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler327)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480474829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480474843\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474853\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480474863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480474893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +713ms\"\n },\n {\n \"at\": \"1789228480474911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -147ms\"\n },\n {\n \"at\": \"1789228480474923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480474933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480474952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480475015\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480475024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480475034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228480475050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480580957\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84536|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228480581107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84537|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228480782390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84538|bridge|INFO|bridge br-int: added interface veth4711b759 on port 38\"\n },\n {\n \"at\": \"1789228481580858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84539|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228481580995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228482580818\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84541|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228482580919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228483316767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84543|poll_loop|INFO|Dropped 2526 log messages in last 313 seconds (most recently, 310 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228483317034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84544|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483317290\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84545|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483317798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84546|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483318477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84547|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483318772\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84548|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483319274\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84549|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483319853\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84550|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483320368\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84551|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483320882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84552|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483321398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483580552\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84554|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228483580617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228484580669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84556|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228484580860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228485580915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84558|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228485581160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228486581159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84560|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228486581417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:46.923263+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.189, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479472013\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479472164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00247|bridge|INFO|bridge incusovn16: using datapath ID 0000b2f8733c5b4e\"\n },\n {\n \"at\": \"1789228479472179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00248|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479474127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00249|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474282\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474299\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474335\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479474347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474391\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474442\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00250|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474467\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474477\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474486\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474519\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474529\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474538\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474548\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474570\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479474590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474635\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474653\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00251|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474718\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474728\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474755\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474787\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474811\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479474833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474853\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474868\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474886\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474897\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474917\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479570181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00252|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479570275\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00253|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228479570389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler328)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479570610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler328)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479570644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228479570673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479570696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x24fed059 your_disc:0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479570720\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479570742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479570765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479570786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479570808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479571070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571124\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571151\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734570ms\"\n },\n {\n \"at\": \"1789228479571176\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789228479571205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789228479571228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479571250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479571273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571321\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479571345\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571391\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479571420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228479571449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479571495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479571524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479571566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler328)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479571595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479571617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479571641\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479571662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571682\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479571737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789228479571758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789228479571779\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479571800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479571821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571841\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479571862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571885\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479571928\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228479571949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479571988\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572034\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479572480\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler328)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479572510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler328)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479572535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479572562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479572584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xfe8ea320 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479572609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479572628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479572649\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479572674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479572697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479572717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479572736\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479572756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734572ms\"\n },\n {\n \"at\": \"1789228479572777\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +691ms\"\n },\n {\n \"at\": \"1789228479572799\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789228479572824\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479572845\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479572866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479572887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479572911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572932\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572953\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479572973\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479572996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573017\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479573038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479573058\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573077\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479573095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479573114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479573132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479573153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479573175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479573196\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479573216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479573237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +691ms\"\n },\n {\n \"at\": \"1789228479573257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789228479573276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479573296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479573317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479573360\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573405\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479573427\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479573447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479573490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575013\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler328)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479575076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler328)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479575104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479575127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479575148\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x8fe124e2 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479575171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479575192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479575215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479575236\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479575282\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575301\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575319\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734574ms\"\n },\n {\n \"at\": \"1789228479575341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228479575364\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228479575390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479575420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479575441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479575487\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479575546\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479575609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575632\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479575654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479575675\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575695\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479575739\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479575758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479575796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575823\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479575864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228479575887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228479575907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479575928\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479575948\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479575988\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479576047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479576068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479576091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479576110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576130\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479577332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479577420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789228480404701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480404846\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480404878\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480404901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480404924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404975\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480405000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +760ms\"\n },\n {\n \"at\": \"1789228480405035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -90ms\"\n },\n {\n \"at\": \"1789228480405059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480405079\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480405106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480405129\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480405151\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480405219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480405246\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480405271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480405296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480405315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405335\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480442870\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480442960\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480442985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480443005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480443030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480443052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480443072\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480443093\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +741ms\"\n },\n {\n \"at\": \"1789228480443116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -179ms\"\n },\n {\n \"at\": \"1789228480443139\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480443161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480443185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480443205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480443231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443251\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480443293\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480443315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480443337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480443356\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480443377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:47.112729+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.192, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479468990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00272|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479469117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00273|bridge|INFO|bridge incusovn16: using datapath ID 0000de68b8cf5447\"\n },\n {\n \"at\": \"1789228479469132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00274|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479470916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00275|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479470975\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479470995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479471010\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479471023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479471034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479471053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471068\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471083\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479471112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471123\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479471148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479471158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479471185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471198\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479471223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471237\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479471261\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00276|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479471274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479471288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479471300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479471311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479471320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479471331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479471375\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471388\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479471414\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479471425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479471447\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471458\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471468\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479471481\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471502\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479471513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479473763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler324)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479473807\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler324)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479473825\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479473845\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479473860\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xf1d4b82 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479473875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479473888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479473899\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479473911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479473921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479473931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479473943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479473959\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634471ms\"\n },\n {\n \"at\": \"1789228479473974\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +987ms\"\n },\n {\n \"at\": \"1789228479473986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479473999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479474023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479474046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474055\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474083\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479474097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474109\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479474121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474155\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474170\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474192\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474207\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479474243\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +987ms\"\n },\n {\n \"at\": \"1789228479474255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479474265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474275\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479474287\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474298\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479474309\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474330\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479474353\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479474373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474391\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00277|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478631\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478677\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479478690\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478706\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478746\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478757\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479478778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478798\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478807\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478829\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479478840\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478859\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479567283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479567423\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228479575196\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00280|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479575289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00281|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228480263720\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler324)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480263821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler324)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480263855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480263888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480263912\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xc6336142 your_disc:0xfe8ea320\"\n },\n {\n \"at\": \"1789228480263939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480263964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480263989\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480264015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480264072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264134\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50635261ms\"\n },\n {\n \"at\": \"1789228480264160\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228480264186\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -692ms\"\n },\n {\n \"at\": \"1789228480264210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480264237\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480264261\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480264308\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480264376\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480264403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264427\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480264451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480264472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler324)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480264540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480264562\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264585\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480264663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480264736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228480264758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -692ms\"\n },\n {\n \"at\": \"1789228480264779\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480264801\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480264824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480264914\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264934\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264958\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480264981\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480265003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480265026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480265047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480265080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480265101\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480469217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler324)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480469493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler324)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480469532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480469561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480469586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x126453c1 your_disc:0x894972dc\"\n },\n {\n \"at\": \"1789228480469615\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480469639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480469663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480469692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480469722\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480469747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480469777\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480469800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50635467ms\"\n },\n {\n \"at\": \"1789228480469825\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +841ms\"\n },\n {\n \"at\": \"1789228480469851\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -159ms\"\n },\n {\n \"at\": \"1789228480469882\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480469907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480469931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480469953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228480469978\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470027\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480470052\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480470096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228480470347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480470373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470395\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480470425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler324)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480470458\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480470483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480470510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480470532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480470556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480470582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480470606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +841ms\"\n },\n {\n \"at\": \"1789228480470628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -159ms\"\n },\n {\n \"at\": \"1789228480470655\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480470679\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480470704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470728\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228480470750\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470776\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480470820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480470844\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470869\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228480470893\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470942\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481173387\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228481173475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228481173491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481173506\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228481173518\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481173530\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481173540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228481173551\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +117ms\"\n },\n {\n \"at\": \"1789228481173563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -713ms\"\n },\n {\n \"at\": \"1789228481173575\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228481173586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228481173602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481173612\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228481173622\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173647\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228481173657\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228481173666\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481173678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228481173689\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228481173706\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481573327\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00282|bridge|INFO|bridge br-int: added interface veth0f727b81 on port 36\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:47.305117+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.209, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479280841\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00250|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479281159\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00251|bridge|INFO|bridge incusovn16: using datapath ID 0000120a87fe924e\"\n },\n {\n \"at\": \"1789228479281182\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00252|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479378655\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00253|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479378758\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228479384238\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479384295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00256|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789228479474399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00257|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474441\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474495\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474512\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474532\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474556\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474603\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479474614\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474644\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474726\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474738\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474752\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00258|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474773\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474787\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474815\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474835\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474845\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474875\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474893\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479474905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474939\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474949\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474989\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474998\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479477553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler337)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479477697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler337)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479477721\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479477749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479477768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x894972dc your_disc:0x0\"\n },\n {\n \"at\": \"1789228479477785\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479477806\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479477822\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479477837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479477852\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479477866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479477886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479477912\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861341ms\"\n },\n {\n \"at\": \"1789228479477934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +997ms\"\n },\n {\n \"at\": \"1789228479477951\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479477972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479477985\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479478004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478019\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479478034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479478097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478112\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479478132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478186\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478203\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478284\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479478333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +997ms\"\n },\n {\n \"at\": \"1789228479478347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479478363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478377\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479478392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479478421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479478480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479478509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478542\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478790\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00259|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478819\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478829\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478848\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479478860\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478907\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478921\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478933\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479478945\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478988\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478999\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479479010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479479022\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479479031\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479479040\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479480002\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler337)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479480053\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler337)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479480068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479480079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479480094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x8ec6ef2f your_disc:0x0\"\n },\n {\n \"at\": \"1789228479480104\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479480135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480144\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480155\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480178\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480201\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480221\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480231\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480242\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479480252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479480310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479480318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479480355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479480364\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479480411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480431\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480440\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480449\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479480468\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479480527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler337)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479480577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler337)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479480588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479480598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479480608\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x6bc64e34 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479480618\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479480647\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480681\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480700\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +915ms\"\n },\n {\n \"at\": \"1789228479480711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228479480730\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480740\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480759\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479480768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480778\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480786\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480796\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480805\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480813\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479480824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479480833\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480842\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480852\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479480867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479480876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479480934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +915ms\"\n },\n {\n \"at\": \"1789228479480944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228479480954\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480982\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479480991\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481001\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479481019\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479481029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479481039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479481052\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481070\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480291060\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480291346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480291370\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480291385\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480291394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480291407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480291417\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480291428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +84ms\"\n },\n {\n \"at\": \"1789228480291439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789228480291453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480291473\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480291499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480291510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228480291523\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291533\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291546\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480291557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480291568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480291578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228480291590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480291601\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291611\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480410199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480410414\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480410443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480410463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480410479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480410498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480410515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480410533\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +985ms\"\n },\n {\n \"at\": \"1789228480410551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -15ms\"\n },\n {\n \"at\": \"1789228480410570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480410588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480410606\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480410623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480410641\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480410714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480410732\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480410749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480410767\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480410783\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481317295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228481317728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228481317780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481317824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228481317859\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481317904\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481317980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228481318038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +58ms\"\n },\n {\n \"at\": \"1789228481318072\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -842ms\"\n },\n {\n \"at\": \"1789228481318102\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228481318131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228481318161\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481318189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228481318217\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318257\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228481318276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228481318296\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481318314\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228481318332\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228481318351\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318371\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:47.515324+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-before-probe.txt", "router_mac": "10:66:6a:b2:7a:65", "at": "2026-09-12T15:54:47.516349+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.111, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:54:40.291942629Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:54:40.866490778Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:54:41.080263333Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:54:41.65195342Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:54:47.627562+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 45763, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T15:54:47.795847+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 43.008, "exit_code": 1, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.113 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.097 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\"volatile.eth0.host_name\":\"veth4711b759\",\"volatile.eth0.hwaddr\":\"10:66:6a:42:ab:f9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\"volatile.uuid.generation\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:54:40.291942629Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\"volatile.eth0.host_name\":\"veth4711b759\",\"volatile.eth0.hwaddr\":\"10:66:6a:42:ab:f9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\"volatile.uuid.generation\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:54:40.866490778Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9662464,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe42:abf9\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:42:ab:f9\",\"host_name\":\"veth4711b759\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4180780,\"processes\":4,\"cpu\":{\"usage\":482073000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:54:39.880000114Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"d35024e8-a62e-4076-b972-b0649f082bcc\",\"volatile.eth0.host_name\":\"veth0f727b81\",\"volatile.eth0.hwaddr\":\"10:66:6a:7e:16:81\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\"volatile.uuid.generation\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:54:41.080263333Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"d35024e8-a62e-4076-b972-b0649f082bcc\",\"volatile.eth0.host_name\":\"veth0f727b81\",\"volatile.eth0.hwaddr\":\"10:66:6a:7e:16:81\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\"volatile.uuid.generation\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:54:41.65195342Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":10747904,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe7e:1681\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:7e:16:81\",\"host_name\":\"veth0f727b81\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":37065,\"processes\":4,\"cpu\":{\"usage\":488402000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:54:41.660000085Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.266 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.201 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.261 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.075 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.707 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.340 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.340/0.707/1.075 ms\nelapsed_seconds=2.260 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.025 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.807 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.413 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.413/0.748/1.025 ms\nelapsed_seconds=2.242 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.409 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.276 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.256 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.239 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.253 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5001 milliseconds\nelapsed_seconds=5.298 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5003 ms: Timeout was reached\nelapsed_seconds=5.030 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.108883 bytes_per_second=918417016\nelapsed_seconds=0.556 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.491 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.142853 bytes_per_second=700020300\nelapsed_seconds=0.393 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.558 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n", "error": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed", "at": "2026-09-12T15:55:30.803387+00:00"} +{"capture": "tcpdump-arp", "pid": 45763, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T15:55:30.805851+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.102, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:30.907784+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.101, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:42:ab:f9 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:7e:16:81 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:31.008746+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.152, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch fd4b631c-81c0-4c8e-9e92-dc7cf9a33c9d (incus-net37-ls-ext)\n port incus-net37-ls-ext-lsp-router\n type: router\n router-port: incus-net37-lr-lrp-ext\n port incus-net37-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 684fbd9a-01fc-43aa-a171-d322d63e6887 (incus-net37-ls-int)\n port incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0\n addresses: [\"10:66:6a:7e:16:81 dynamic\"]\n port incus-net37-ls-int-lsp-router\n type: router\n router-port: incus-net37-lr-lrp-int\n port incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0\n addresses: [\"10:66:6a:42:ab:f9 dynamic\"]\nrouter acd84fae-7dea-4d77-b555-dae888322639 (incus-net37-lr)\n port incus-net37-lr-lrp-ext\n mac: \"10:66:6a:b2:7a:65\"\n ipv6-lla: \"fe80::1266:6aff:feb2:7a65\"\n networks: [\"10.10.40.64/24\"]\n port incus-net37-lr-lrp-int\n mac: \"10:66:6a:b2:7a:65\"\n ipv6-lla: \"fe80::1266:6aff:feb2:7a65\"\n networks: [\"10.253.73.1/24\"]\n nat a10b55e2-fd03-497a-b507-27de4d11b529\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net37-lr-lrp-ext\n Port_Binding incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : d629ff1d-a504-49fe-a7c8-f0323ee49c93\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : de608431-0186-4362-86d7-cac077dd05e7\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:b2:7a:65\"\nname : incus-net37-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : e04baf95-5323-4806-8837-59c9e0fbc892\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:b2:7a:65\"\nname : incus-net37-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 70a417e5-7e57-4de0-8d05-1cd489841205\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 62a237be-632c-48ed-8a7b-8844743cd71b\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : ce09c18b-41bd-4255-a48e-d5595868baa0\nlogical_port : cr-incus-net37-lr-lrp-ext\nmac : [\"10:66:6a:b2:7a:65 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net37-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : de608431-0186-4362-86d7-cac077dd05e7\nexternal_ids : {}\nha_chassis : [093d581f-a240-48d1-8523-23f1f4332ef2, 6bae3c80-717c-4b0f-82a0-035c6921b222, aeacbaee-6168-4a6d-ba97-359ec9f0230c, e68ec4f2-be40-49bb-9a54-454bc30f38e8]\nname : incus-net37\n=== ovn-nbctl list HA_Chassis ===\n_uuid : 6bae3c80-717c-4b0f-82a0-035c6921b222\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 30102\n\n_uuid : e68ec4f2-be40-49bb-9a54-454bc30f38e8\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 31425\n\n_uuid : aeacbaee-6168-4a6d-ba97-359ec9f0230c\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 5868\n\n_uuid : 093d581f-a240-48d1-8523-23f1f4332ef2\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 6746\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:55:31.160807+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.306, "exit_code": 0, "stdout": "10.10.40.64 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T15:55:31.467132+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.204, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479484425\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84516|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479484766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84517|bridge|INFO|bridge incusovn16: using datapath ID 0000fecb28f30f44\"\n },\n {\n \"at\": \"1789228479484807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84518|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479486903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84519|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479486961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479486992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479487020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479487041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479487068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479487089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487152\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479487177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479487239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479487251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487275\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479487293\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479487354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487391\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479487413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84520|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479487444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479487461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479487488\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479487504\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479487520\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479487545\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479487617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479487668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479487682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479487713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479487755\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479487796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479494185\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84521|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479494228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479494250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479494269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479494282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479494299\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479494312\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479494388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479494400\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479494422\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479494442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479494470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479494498\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479494521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479494542\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479494561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494587\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479581012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84522|dpif|WARN|Dropped 1500 log messages in last 308 seconds (most recently, 308 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228479581112\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84523|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479581149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84524|bridge|WARN|Dropped 56686 log messages in last 335 seconds (most recently, 308 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228479581190\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84525|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479581341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479581371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84527|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479582706\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479582786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84529|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479583949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479584037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84531|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479585060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479585181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84533|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479588143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84534|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228479588235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84535|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228480327229\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler327)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480327347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler327)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480327378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480327412\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480327440\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xe975fdaf your_disc:0x8fe124e2\"\n },\n {\n \"at\": \"1789228480327458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480327475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480327497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480327512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480327547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758327ms\"\n },\n {\n \"at\": \"1789228480327599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +90ms\"\n },\n {\n \"at\": \"1789228480327614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -740ms\"\n },\n {\n \"at\": \"1789228480327647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480327659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480327672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480327682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480327700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480327741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480327764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480327838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480327857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480327868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler327)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480327916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480327931\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327942\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480327952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480327996\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +90ms\"\n },\n {\n \"at\": \"1789228480328013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -740ms\"\n },\n {\n \"at\": \"1789228480328022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480328038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480328049\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480328067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480328079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328098\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480328123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480328133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480328144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480328158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403421\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler327)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480403541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler327)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480403572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480403585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480403608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x9b9bc62f your_disc:0x6bc64e34\"\n },\n {\n \"at\": \"1789228480403624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480403636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480403646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480403658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480403685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480403705\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480403725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758403ms\"\n },\n {\n \"at\": \"1789228480403748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -136ms\"\n },\n {\n \"at\": \"1789228480403768\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -916ms\"\n },\n {\n \"at\": \"1789228480403788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480403798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480403809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480403826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480403838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480403878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480403889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480403904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480403926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480403944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403974\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler327)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480403991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480404003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480404021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480404031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480404075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -136ms\"\n },\n {\n \"at\": \"1789228480404087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -916ms\"\n },\n {\n \"at\": \"1789228480404096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480404113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480404126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480404140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480404159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480404191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480404208\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480404217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480404232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler327)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480474355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler327)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480474376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480474392\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480474415\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x45468bf5 your_disc:0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480474448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480474457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480474478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480474512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474523\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474538\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758474ms\"\n },\n {\n \"at\": \"1789228480474560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +713ms\"\n },\n {\n \"at\": \"1789228480474591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -147ms\"\n },\n {\n \"at\": \"1789228480474615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480474636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480474647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474676\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480474717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480474730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228480474762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480474773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474792\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler327)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480474829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480474843\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474853\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480474863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480474893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +713ms\"\n },\n {\n \"at\": \"1789228480474911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -147ms\"\n },\n {\n \"at\": \"1789228480474923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480474933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480474952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480475015\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480475024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480475034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228480475050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480580957\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84536|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228480581107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84537|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228480782390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84538|bridge|INFO|bridge br-int: added interface veth4711b759 on port 38\"\n },\n {\n \"at\": \"1789228481580858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84539|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228481580995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228482580818\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84541|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228482580919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228483316767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84543|poll_loop|INFO|Dropped 2526 log messages in last 313 seconds (most recently, 310 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228483317034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84544|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483317290\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84545|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483317798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84546|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483318477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84547|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483318772\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84548|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483319274\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84549|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483319853\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84550|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483320368\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84551|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483320882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84552|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483321398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483580552\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84554|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228483580617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228484580669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84556|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228484580860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228485580915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84558|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228485581160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228486581159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84560|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228486581417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228487580730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84562|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228487580823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84563|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228488580936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84564|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228488581132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84565|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228489316770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84566|poll_loop|INFO|Dropped 12178 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228489316895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84567|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228489488874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84568|connmgr|INFO|br-int<->unix#7: 911 flow_mods in the 6 s starting 10 s ago (845 adds, 58 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789228489581052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84569|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228489581223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228490580965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84571|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228490581071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228491580787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84573|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228491580926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228492580903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84575|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228492581165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228493580892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84577|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228493581040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228494580810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84579|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228494580951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228495316892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84581|poll_loop|INFO|Dropped 12420 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228495317132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228495580847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84583|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228495580949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228496581037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84585|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228496581261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228497580977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84587|dpif|WARN|Dropped 1989 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228497581118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228498581013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84589|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228498581149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228499580774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84591|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228499580921\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228500580849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84593|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228500581063\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228501316812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84595|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228501316949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228501581171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84597|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228501581346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228502580732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84599|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228502608575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84600|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228503580703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84601|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228503580851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84602|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228504581109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84603|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228504581455\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84604|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228505580957\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84605|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228505581107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84606|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228506580801\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84607|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228506581004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84608|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228507317107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84609|poll_loop|INFO|Dropped 12249 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228507317238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84610|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228507580972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84611|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228507581182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84612|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228508581077\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84613|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228508581320\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84614|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228509580584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84615|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228509580802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84616|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228510580847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84617|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228510581094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84618|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228511581014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84619|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228511581249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84620|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228512580997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84621|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228512581108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84622|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228513316982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84623|poll_loop|INFO|Dropped 12233 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228513317141\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84624|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228513580746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84625|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228513580805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84626|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228514580992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84627|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228514581249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84628|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228515580631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84629|dpif|WARN|Dropped 2104 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228515580773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84630|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228516580917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84631|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228516581123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84632|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228517580978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84633|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228517581216\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84634|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228518580786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84635|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228518580904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84636|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228519316796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84637|poll_loop|INFO|Dropped 12367 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228519317027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84638|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228519580709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84639|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228519580779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84640|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228520580597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84641|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228520580836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84642|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228521580730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84643|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228521580973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84644|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228522580887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84645|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228522581093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84646|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228523580573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84647|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228523580669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84648|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228524580898\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84649|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228524581131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84650|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228525316757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84651|poll_loop|INFO|Dropped 12482 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228525316919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84652|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228525580739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84653|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228525580821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84654|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228526580988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84655|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228526581243\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84656|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228527580971\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84657|dpif|WARN|Dropped 2105 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228527581076\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84658|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228528581119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84659|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228528581356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84660|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228529580979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84661|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228529581077\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84662|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228530581094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84663|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228530581362\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228531316980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84665|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228531317093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84666|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228531581110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84667|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228531581280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:31.671701+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.185, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479472013\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479472164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00247|bridge|INFO|bridge incusovn16: using datapath ID 0000b2f8733c5b4e\"\n },\n {\n \"at\": \"1789228479472179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00248|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479474127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00249|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474282\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474299\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474335\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479474347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474391\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474442\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00250|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474467\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474477\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474486\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474519\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474529\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474538\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474548\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474570\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479474590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474635\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474653\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00251|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474718\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474728\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474755\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474787\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474811\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479474833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474853\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474868\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474886\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474897\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474917\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479570181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00252|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479570275\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00253|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228479570389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler328)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479570610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler328)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479570644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228479570673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479570696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x24fed059 your_disc:0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479570720\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479570742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479570765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479570786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479570808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479571070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571124\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571151\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734570ms\"\n },\n {\n \"at\": \"1789228479571176\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789228479571205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789228479571228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479571250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479571273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571321\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479571345\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571391\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479571420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228479571449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479571495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479571524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479571566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler328)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479571595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479571617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479571641\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479571662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571682\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479571737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789228479571758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789228479571779\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479571800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479571821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571841\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479571862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571885\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479571928\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228479571949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479571988\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572034\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479572480\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler328)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479572510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler328)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479572535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479572562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479572584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xfe8ea320 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479572609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479572628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479572649\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479572674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479572697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479572717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479572736\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479572756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734572ms\"\n },\n {\n \"at\": \"1789228479572777\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +691ms\"\n },\n {\n \"at\": \"1789228479572799\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789228479572824\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479572845\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479572866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479572887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479572911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572932\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572953\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479572973\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479572996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573017\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479573038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479573058\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573077\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479573095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479573114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479573132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479573153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479573175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479573196\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479573216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479573237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +691ms\"\n },\n {\n \"at\": \"1789228479573257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789228479573276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479573296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479573317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479573360\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573405\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479573427\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479573447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479573490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575013\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler328)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479575076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler328)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479575104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479575127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479575148\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x8fe124e2 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479575171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479575192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479575215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479575236\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479575282\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575301\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575319\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734574ms\"\n },\n {\n \"at\": \"1789228479575341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228479575364\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228479575390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479575420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479575441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479575487\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479575546\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479575609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575632\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479575654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479575675\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575695\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479575739\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479575758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479575796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575823\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479575864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228479575887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228479575907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479575928\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479575948\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479575988\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479576047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479576068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479576091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479576110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576130\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479577332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479577420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789228480404701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480404846\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480404878\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480404901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480404924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404975\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480405000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +760ms\"\n },\n {\n \"at\": \"1789228480405035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -90ms\"\n },\n {\n \"at\": \"1789228480405059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480405079\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480405106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480405129\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480405151\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480405219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480405246\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480405271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480405296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480405315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405335\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480442870\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480442960\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480442985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480443005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480443030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480443052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480443072\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480443093\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +741ms\"\n },\n {\n \"at\": \"1789228480443116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -179ms\"\n },\n {\n \"at\": \"1789228480443139\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480443161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480443185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480443205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480443231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443251\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480443293\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480443315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480443337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480443356\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480443377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228489476199\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00256|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (812 adds, 56 deletes, 7 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:31.858182+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.184, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479468990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00272|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479469117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00273|bridge|INFO|bridge incusovn16: using datapath ID 0000de68b8cf5447\"\n },\n {\n \"at\": \"1789228479469132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00274|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479470916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00275|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479470975\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479470995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479471010\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479471023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479471034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479471053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471068\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471083\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479471112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471123\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479471148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479471158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479471185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471198\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479471223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471237\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479471261\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00276|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479471274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479471288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479471300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479471311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479471320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479471331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479471375\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471388\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479471414\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479471425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479471447\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471458\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471468\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479471481\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471502\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479471513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479473763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler324)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479473807\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler324)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479473825\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479473845\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479473860\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xf1d4b82 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479473875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479473888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479473899\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479473911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479473921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479473931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479473943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479473959\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634471ms\"\n },\n {\n \"at\": \"1789228479473974\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +987ms\"\n },\n {\n \"at\": \"1789228479473986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479473999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479474023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479474046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474055\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474083\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479474097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474109\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479474121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474155\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474170\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474192\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474207\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479474243\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +987ms\"\n },\n {\n \"at\": \"1789228479474255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479474265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474275\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479474287\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474298\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479474309\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474330\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479474353\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479474373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474391\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00277|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478631\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478677\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479478690\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478706\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478746\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478757\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479478778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478798\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478807\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478829\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479478840\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478859\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479567283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479567423\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228479575196\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00280|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479575289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00281|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228480263720\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler324)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480263821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler324)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480263855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480263888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480263912\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xc6336142 your_disc:0xfe8ea320\"\n },\n {\n \"at\": \"1789228480263939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480263964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480263989\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480264015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480264072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264134\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50635261ms\"\n },\n {\n \"at\": \"1789228480264160\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228480264186\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -692ms\"\n },\n {\n \"at\": \"1789228480264210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480264237\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480264261\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480264308\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480264376\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480264403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264427\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480264451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480264472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler324)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480264540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480264562\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264585\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480264663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480264736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228480264758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -692ms\"\n },\n {\n \"at\": \"1789228480264779\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480264801\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480264824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480264914\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264934\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264958\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480264981\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480265003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480265026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480265047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480265080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480265101\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480469217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler324)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480469493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler324)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480469532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480469561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480469586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x126453c1 your_disc:0x894972dc\"\n },\n {\n \"at\": \"1789228480469615\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480469639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480469663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480469692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480469722\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480469747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480469777\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480469800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50635467ms\"\n },\n {\n \"at\": \"1789228480469825\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +841ms\"\n },\n {\n \"at\": \"1789228480469851\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -159ms\"\n },\n {\n \"at\": \"1789228480469882\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480469907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480469931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480469953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228480469978\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470027\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480470052\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480470096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228480470347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480470373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470395\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480470425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler324)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480470458\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480470483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480470510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480470532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480470556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480470582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480470606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +841ms\"\n },\n {\n \"at\": \"1789228480470628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -159ms\"\n },\n {\n \"at\": \"1789228480470655\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480470679\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480470704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470728\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228480470750\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470776\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480470820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480470844\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470869\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228480470893\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470942\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481173387\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228481173475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228481173491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481173506\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228481173518\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481173530\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481173540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228481173551\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +117ms\"\n },\n {\n \"at\": \"1789228481173563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -713ms\"\n },\n {\n \"at\": \"1789228481173575\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228481173586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228481173602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481173612\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228481173622\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173647\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228481173657\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228481173666\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481173678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228481173689\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228481173706\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481573327\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00282|bridge|INFO|bridge br-int: added interface veth0f727b81 on port 36\"\n },\n {\n \"at\": \"1789228489473008\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00283|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (844 adds, 76 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:32.043418+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.202, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479280841\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00250|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479281159\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00251|bridge|INFO|bridge incusovn16: using datapath ID 0000120a87fe924e\"\n },\n {\n \"at\": \"1789228479281182\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00252|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479378655\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00253|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479378758\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228479384238\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479384295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00256|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789228479474399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00257|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474441\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474495\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474512\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474532\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474556\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474603\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479474614\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474644\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474726\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474738\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474752\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00258|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474773\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474787\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474815\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474835\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474845\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474875\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474893\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479474905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474939\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474949\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474989\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474998\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479477553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler337)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479477697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler337)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479477721\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479477749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479477768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x894972dc your_disc:0x0\"\n },\n {\n \"at\": \"1789228479477785\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479477806\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479477822\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479477837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479477852\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479477866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479477886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479477912\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861341ms\"\n },\n {\n \"at\": \"1789228479477934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +997ms\"\n },\n {\n \"at\": \"1789228479477951\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479477972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479477985\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479478004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478019\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479478034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479478097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478112\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479478132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478186\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478203\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478284\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479478333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +997ms\"\n },\n {\n \"at\": \"1789228479478347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479478363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478377\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479478392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479478421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479478480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479478509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478542\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478790\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00259|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478819\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478829\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478848\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479478860\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478907\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478921\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478933\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479478945\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478988\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478999\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479479010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479479022\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479479031\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479479040\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479480002\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler337)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479480053\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler337)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479480068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479480079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479480094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x8ec6ef2f your_disc:0x0\"\n },\n {\n \"at\": \"1789228479480104\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479480135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480144\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480155\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480178\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480201\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480221\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480231\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480242\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479480252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479480310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479480318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479480355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479480364\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479480411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480431\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480440\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480449\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479480468\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479480527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler337)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479480577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler337)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479480588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479480598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479480608\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x6bc64e34 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479480618\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479480647\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480681\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480700\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +915ms\"\n },\n {\n \"at\": \"1789228479480711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228479480730\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480740\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480759\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479480768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480778\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480786\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480796\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480805\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480813\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479480824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479480833\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480842\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480852\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479480867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479480876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479480934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +915ms\"\n },\n {\n \"at\": \"1789228479480944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228479480954\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480982\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479480991\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481001\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479481019\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479481029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479481039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479481052\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481070\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480291060\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480291346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480291370\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480291385\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480291394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480291407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480291417\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480291428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +84ms\"\n },\n {\n \"at\": \"1789228480291439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789228480291453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480291473\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480291499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480291510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228480291523\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291533\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291546\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480291557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480291568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480291578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228480291590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480291601\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291611\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480410199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480410414\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480410443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480410463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480410479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480410498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480410515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480410533\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +985ms\"\n },\n {\n \"at\": \"1789228480410551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -15ms\"\n },\n {\n \"at\": \"1789228480410570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480410588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480410606\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480410623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480410641\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480410714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480410732\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480410749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480410767\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480410783\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481317295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228481317728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228481317780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481317824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228481317859\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481317904\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481317980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228481318038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +58ms\"\n },\n {\n \"at\": \"1789228481318072\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -842ms\"\n },\n {\n \"at\": \"1789228481318102\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228481318131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228481318161\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481318189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228481318217\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318257\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228481318276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228481318296\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481318314\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228481318332\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228481318351\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318371\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228489286016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00260|connmgr|INFO|br-int<->unix#7: 969 flow_mods in the 6 s starting 10 s ago (862 adds, 106 deletes, 1 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:32.246075+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-probe.txt", "router_mac": "10:66:6a:b2:7a:65", "at": "2026-09-12T15:55:32.247504+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 48364, "ready": true, "ready_signal": "time=\"2026-09-12T08:55:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:55:32.347866+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/topology.jsonl", "destroy"], "seconds": 3.587, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:35.935522+00:00"} +{"capture": "monitor-delete", "pid": 48364, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.log", "ready_signal": "time=\"2026-09-12T08:55:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T15:55:35.940135+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.088, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:55:36.029309+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.088, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T15:55:36.118023+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.166, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ovn-nbctl list HA_Chassis_Group ===\n=== ovn-nbctl list HA_Chassis ===\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE \n", "stderr": "", "error": null, "at": "2026-09-12T15:55:36.284628+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.306, "exit_code": 0, "stdout": "10.10.40.64 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T15:55:36.591226+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.238, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479484425\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84516|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479484766\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84517|bridge|INFO|bridge incusovn16: using datapath ID 0000fecb28f30f44\"\n },\n {\n \"at\": \"1789228479484807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84518|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479486903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84519|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479486961\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479486992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479487020\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479487041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479487068\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479487089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487104\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487152\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479487177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487195\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487218\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479487239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479487251\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487275\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479487293\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487311\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479487354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487372\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487391\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479487413\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84520|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479487444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479487461\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479487488\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479487504\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479487520\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479487545\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487582\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757487ms\"\n },\n {\n \"at\": \"1789228479487605\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479487617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487632\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479487668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479487682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487698\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479487713\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479487729\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479487741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479487755\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479487783\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479487796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479494185\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84521|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479494228\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479494250\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479494269\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479494282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479494299\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479494312\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494333\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494349\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1542757494ms\"\n },\n {\n \"at\": \"1789228479494371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479494388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479494400\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479494422\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479494442\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479494470\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494483\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479494498\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479494521\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479494542\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479494561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479494587\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479581012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84522|dpif|WARN|Dropped 1500 log messages in last 308 seconds (most recently, 308 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228479581112\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84523|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479581149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84524|bridge|WARN|Dropped 56686 log messages in last 335 seconds (most recently, 308 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228479581190\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84525|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479581341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479581371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84527|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479582706\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479582786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84529|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479583949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479584037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84531|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479585060\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228479585181\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84533|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789228479588143\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84534|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228479588235\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84535|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228480327229\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler327)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480327347\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler327)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480327378\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480327412\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480327440\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xe975fdaf your_disc:0x8fe124e2\"\n },\n {\n \"at\": \"1789228480327458\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480327475\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480327497\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480327512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327530\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480327547\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758327ms\"\n },\n {\n \"at\": \"1789228480327599\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +90ms\"\n },\n {\n \"at\": \"1789228480327614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -740ms\"\n },\n {\n \"at\": \"1789228480327647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480327659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480327672\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480327682\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480327700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327714\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480327741\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480327764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480327838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480327857\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480327868\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480327889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327899\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler327)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480327916\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480327931\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480327942\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480327952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480327981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480327996\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +90ms\"\n },\n {\n \"at\": \"1789228480328013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -740ms\"\n },\n {\n \"at\": \"1789228480328022\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480328038\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480328049\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480328067\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480328079\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328098\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328114\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480328123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480328133\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480328144\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480328158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328169\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480328184\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403421\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler327)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480403541\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler327)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480403572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480403585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480403608\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x9b9bc62f your_disc:0x6bc64e34\"\n },\n {\n \"at\": \"1789228480403624\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480403636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480403646\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480403658\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403674\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480403685\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480403705\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480403725\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758403ms\"\n },\n {\n \"at\": \"1789228480403748\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -136ms\"\n },\n {\n \"at\": \"1789228480403768\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -916ms\"\n },\n {\n \"at\": \"1789228480403788\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480403798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480403809\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480403826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480403838\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480403878\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480403889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480403904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480403926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480403944\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480403959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480403974\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler327)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480403991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480404003\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480404021\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480404031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404048\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480404075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -136ms\"\n },\n {\n \"at\": \"1789228480404087\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -916ms\"\n },\n {\n \"at\": \"1789228480404096\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480404113\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480404126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480404140\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480404159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404170\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480404191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480404208\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480404217\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480404232\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404244\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480404261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474245\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler327)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480474355\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler327)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480474376\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480474392\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480474415\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x45468bf5 your_disc:0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480474448\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480474457\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480474478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474500\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480474512\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474523\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474538\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -1542758474ms\"\n },\n {\n \"at\": \"1789228480474560\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +713ms\"\n },\n {\n \"at\": \"1789228480474591\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -147ms\"\n },\n {\n \"at\": \"1789228480474615\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480474636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480474647\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474659\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474676\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474691\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480474717\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480474730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474743\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228480474762\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480474773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474792\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474807\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler327)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480474829\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480474843\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480474853\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480474863\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480474884\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480474893\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +713ms\"\n },\n {\n \"at\": \"1789228480474911\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -147ms\"\n },\n {\n \"at\": \"1789228480474923\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480474933\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480474952\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480474962\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228480474981\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480474991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475006\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480475015\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480475024\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480475034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228480475050\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475061\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480475072\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480580957\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84536|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228480581107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84537|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228480782390\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84538|bridge|INFO|bridge br-int: added interface veth4711b759 on port 38\"\n },\n {\n \"at\": \"1789228481580858\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84539|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228481580995\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228482580818\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84541|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228482580919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228483316767\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84543|poll_loop|INFO|Dropped 2526 log messages in last 313 seconds (most recently, 310 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228483317034\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84544|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483317290\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84545|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483317798\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84546|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483318477\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84547|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483318772\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84548|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483319274\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84549|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483319853\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84550|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483320368\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84551|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483320882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84552|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483321398\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789228483580552\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84554|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228483580617\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228484580669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84556|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228484580860\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228485580915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84558|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228485581160\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228486581159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84560|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228486581417\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228487580730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84562|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228487580823\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84563|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228488580936\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84564|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228488581132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84565|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228489316770\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84566|poll_loop|INFO|Dropped 12178 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228489316895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84567|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228489488874\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84568|connmgr|INFO|br-int<->unix#7: 911 flow_mods in the 6 s starting 10 s ago (845 adds, 58 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789228489581052\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84569|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228489581223\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228490580965\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84571|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228490581071\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228491580787\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84573|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228491580926\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228492580903\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84575|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228492581165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228493580892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84577|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228493581040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228494580810\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84579|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228494580951\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228495316892\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84581|poll_loop|INFO|Dropped 12420 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228495317132\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228495580847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84583|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228495580949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228496581037\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84585|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228496581261\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228497580977\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84587|dpif|WARN|Dropped 1989 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228497581118\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228498581013\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84589|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228498581149\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228499580774\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84591|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228499580921\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228500580849\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84593|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228500581063\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228501316812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84595|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228501316949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228501581171\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84597|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228501581346\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228502580732\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84599|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228502608575\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84600|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228503580703\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84601|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228503580851\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84602|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228504581109\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84603|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228504581455\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84604|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228505580957\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84605|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228505581107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84606|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228506580801\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84607|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228506581004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84608|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228507317107\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84609|poll_loop|INFO|Dropped 12249 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228507317238\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84610|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228507580972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84611|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228507581182\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84612|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228508581077\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84613|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228508581320\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84614|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228509580584\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84615|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228509580802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84616|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228510580847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84617|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228510581094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84618|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228511581014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84619|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228511581249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84620|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228512580997\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84621|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228512581108\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84622|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228513316982\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84623|poll_loop|INFO|Dropped 12233 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228513317141\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84624|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228513580746\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84625|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228513580805\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84626|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228514580992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84627|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228514581249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84628|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228515580631\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84629|dpif|WARN|Dropped 2104 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228515580773\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84630|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228516580917\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84631|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228516581123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84632|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228517580978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84633|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228517581216\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84634|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228518580786\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84635|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228518580904\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84636|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228519316796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84637|poll_loop|INFO|Dropped 12367 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228519317027\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84638|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228519580709\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84639|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228519580779\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84640|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228520580597\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84641|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228520580836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84642|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228521580730\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84643|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228521580973\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84644|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228522580887\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84645|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228522581093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84646|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228523580573\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84647|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228523580669\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84648|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228524580898\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84649|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228524581131\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84650|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228525316757\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84651|poll_loop|INFO|Dropped 12482 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228525316919\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84652|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228525580739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84653|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228525580821\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84654|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228526580988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84655|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228526581243\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84656|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228527580971\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84657|dpif|WARN|Dropped 2105 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228527581076\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84658|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228528581119\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84659|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228528581356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84660|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228529580979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84661|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228529581077\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84662|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228530581094\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84663|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228530581362\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228531316980\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84665|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228531317093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84666|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789228531581110\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84667|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228531581280\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228532580841\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84669|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228532580969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228533085629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84671|bridge|INFO|bridge br-int: deleted interface veth4711b759 on port 38\"\n },\n {\n \"at\": \"1789228533580803\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84672|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228533580895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84673|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228534580716\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84674|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789228534580906\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84675|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789228535390191\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84676|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228535390246\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84677|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1\"\n },\n {\n \"at\": \"1789228535409940\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|84678|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37\"\n },\n {\n \"at\": \"1789228535410120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:36.829656+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.206, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479472013\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00246|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479472164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00247|bridge|INFO|bridge incusovn16: using datapath ID 0000b2f8733c5b4e\"\n },\n {\n \"at\": \"1789228479472179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00248|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479474127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00249|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474189\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474209\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474243\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474254\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474282\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474299\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474335\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479474347\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474358\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474368\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474391\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474431\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474442\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474453\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00250|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474467\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474477\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474486\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474497\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474519\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474529\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474538\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474548\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474559\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474570\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474579\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479474590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474624\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474635\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474653\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474663\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474683\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00251|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474718\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474728\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474744\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474755\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1591734473ms\"\n },\n {\n \"at\": \"1789228479474787\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474811\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479474833\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474853\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474868\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474877\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474886\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474897\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474917\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474926\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479570181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00252|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479570275\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00253|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789228479570389\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler328)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479570610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler328)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479570644\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228479570673\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479570696\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x24fed059 your_disc:0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479570720\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479570742\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479570765\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479570786\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479570808\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479571070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571124\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571151\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734570ms\"\n },\n {\n \"at\": \"1789228479571176\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789228479571205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789228479571228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479571250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479571273\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571321\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479571345\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571391\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479571420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228479571449\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571471\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479571495\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479571524\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571545\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479571566\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler328)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479571595\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479571617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479571641\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479571662\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571682\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479571712\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479571737\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +714ms\"\n },\n {\n \"at\": \"1789228479571758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -96ms\"\n },\n {\n \"at\": \"1789228479571779\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479571800\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479571821\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571841\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479571862\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571885\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479571907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479571928\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228479571949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479571969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479571988\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572034\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479572480\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler328)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479572510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler328)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479572535\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479572562\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479572584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xfe8ea320 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479572609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479572628\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479572649\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479572674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479572697\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479572717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479572736\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479572756\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734572ms\"\n },\n {\n \"at\": \"1789228479572777\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +691ms\"\n },\n {\n \"at\": \"1789228479572799\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789228479572824\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479572845\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479572866\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479572887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479572911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572932\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479572953\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479572973\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479572996\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573017\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479573038\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479573058\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573077\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479573095\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479573114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479573132\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479573153\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479573175\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479573196\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479573216\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479573237\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +691ms\"\n },\n {\n \"at\": \"1789228479573257\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789228479573276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479573296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479573317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228479573360\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573380\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573405\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479573427\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479573447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479573469\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479573490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479573531\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575013\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler328)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479575076\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler328)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479575104\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479575127\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479575148\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x8fe124e2 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479575171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479575192\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479575215\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479575236\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575261\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479575282\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575301\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575319\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1591734574ms\"\n },\n {\n \"at\": \"1789228479575341\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228479575364\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228479575390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479575420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479575441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575466\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479575487\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575507\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479575546\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479575609\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575632\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479575654\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479575675\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479575695\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575716\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479575739\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479575758\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479575776\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479575796\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575823\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479575844\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479575864\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +740ms\"\n },\n {\n \"at\": \"1789228479575887\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -100ms\"\n },\n {\n \"at\": \"1789228479575907\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479575928\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479575948\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479575969\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228479575988\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576006\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479576047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479576068\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479576091\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228479576110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576130\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479576156\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479577332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479577420\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789228480404701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480404846\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480404878\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480404901\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480404924\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480404975\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480405000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +760ms\"\n },\n {\n \"at\": \"1789228480405035\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -90ms\"\n },\n {\n \"at\": \"1789228480405059\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480405079\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480405106\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480405129\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xe975fdaf\"\n },\n {\n \"at\": \"1789228480405151\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405174\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405197\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480405219\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480405246\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480405271\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8fe124e2\"\n },\n {\n \"at\": \"1789228480405296\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480405315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480405335\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480442870\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480442960\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480442985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480443005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480443030\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480443052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480443072\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480443093\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +741ms\"\n },\n {\n \"at\": \"1789228480443116\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -179ms\"\n },\n {\n \"at\": \"1789228480443139\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480443161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480443185\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480443205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480443231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443251\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480443293\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480443315\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480443337\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480443356\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480443377\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480443408\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228489476199\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00256|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (812 adds, 56 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789228535381614\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00257|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228535381949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00258|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228535382297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00259|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228535397981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00260|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22\"\n },\n {\n \"at\": \"1789228535398032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:37.036550+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.21, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479468990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00272|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479469117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00273|bridge|INFO|bridge incusovn16: using datapath ID 0000de68b8cf5447\"\n },\n {\n \"at\": \"1789228479469132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00274|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479470916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00275|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479470975\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479470995\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479471010\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479471023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479471034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479471053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471068\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471083\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479471112\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471123\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471136\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479471148\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479471158\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479471185\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471198\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471208\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479471223\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471237\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471248\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479471261\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00276|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479471274\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479471288\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479471300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479471311\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479471320\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479471331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634468ms\"\n },\n {\n \"at\": \"1789228479471363\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479471375\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471388\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471399\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479471414\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479471425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479471447\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479471458\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479471468\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479471481\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479471502\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479471513\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479473763\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler324)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479473807\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler324)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479473825\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479473845\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479473860\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xf1d4b82 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479473875\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479473888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479473899\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479473911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479473921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479473931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479473943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479473959\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634471ms\"\n },\n {\n \"at\": \"1789228479473974\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +987ms\"\n },\n {\n \"at\": \"1789228479473986\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479473999\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479474023\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474034\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479474046\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474055\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474083\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479474097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474109\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479474121\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474131\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474155\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474170\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474192\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474207\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474228\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479474243\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +987ms\"\n },\n {\n \"at\": \"1789228479474255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479474265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474275\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479474287\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474298\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228479474309\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474321\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474330\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474342\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479474353\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474364\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228479474373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474391\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474404\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00277|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478631\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478645\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478667\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478677\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479478690\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478706\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478723\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -50634476ms\"\n },\n {\n \"at\": \"1789228479478733\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478746\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478757\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478767\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228479478778\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478788\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478798\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478807\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478829\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479478840\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478849\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478859\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479567283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479567423\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789228479575196\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00280|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479575289\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00281|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228480263720\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler324)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480263821\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler324)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480263855\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480263888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480263912\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xc6336142 your_disc:0xfe8ea320\"\n },\n {\n \"at\": \"1789228480263939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480263964\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480263989\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480264015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264039\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480264072\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264102\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264134\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50635261ms\"\n },\n {\n \"at\": \"1789228480264160\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228480264186\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -692ms\"\n },\n {\n \"at\": \"1789228480264210\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480264237\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480264261\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264283\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480264308\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264331\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264354\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480264376\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480264403\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264427\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480264451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480264472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264492\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler324)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480264540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480264562\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480264585\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480264663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264686\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480264708\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480264736\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +108ms\"\n },\n {\n \"at\": \"1789228480264758\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -692ms\"\n },\n {\n \"at\": \"1789228480264779\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480264801\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480264824\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480264892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xfe8ea320\"\n },\n {\n \"at\": \"1789228480264914\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264934\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480264958\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480264981\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480265003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480265026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc6336142\"\n },\n {\n \"at\": \"1789228480265047\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480265080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480265101\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480469217\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler324)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228480469493\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler324)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228480469532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789228480469561\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228480469586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0x126453c1 your_disc:0x894972dc\"\n },\n {\n \"at\": \"1789228480469615\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480469639\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228480469663\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228480469692\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480469722\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480469747\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480469777\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480469800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -50635467ms\"\n },\n {\n \"at\": \"1789228480469825\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +841ms\"\n },\n {\n \"at\": \"1789228480469851\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -159ms\"\n },\n {\n \"at\": \"1789228480469882\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480469907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480469931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480469953\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228480469978\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470027\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480470052\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480470096\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470317\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228480470347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228480470373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470395\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480470425\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler324)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480470458\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480470483\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480470510\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480470532\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480470556\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480470582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480470606\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +841ms\"\n },\n {\n \"at\": \"1789228480470628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -159ms\"\n },\n {\n \"at\": \"1789228480470655\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480470679\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228480470704\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470728\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228480470750\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470776\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470799\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480470820\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789228480470844\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480470869\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228480470893\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470917\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480470942\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481173387\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228481173475\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228481173491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481173506\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228481173518\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481173530\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481173540\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228481173551\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +117ms\"\n },\n {\n \"at\": \"1789228481173563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -713ms\"\n },\n {\n \"at\": \"1789228481173575\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228481173586\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228481173602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481173612\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x45468bf5\"\n },\n {\n \"at\": \"1789228481173622\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173634\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173647\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228481173657\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228481173666\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481173678\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf1d4b82\"\n },\n {\n \"at\": \"1789228481173689\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228481173706\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481173718\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481573327\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00282|bridge|INFO|bridge br-int: added interface veth0f727b81 on port 36\"\n },\n {\n \"at\": \"1789228489473008\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00283|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (844 adds, 76 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789228534060745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00284|bridge|INFO|bridge br-int: deleted interface veth0f727b81 on port 36\"\n },\n {\n \"at\": \"1789228535381056\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228535381368\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228535381596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228535403359\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00288|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35\"\n },\n {\n \"at\": \"1789228535403582\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:37.246972+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T15%3A54%3A36.640301%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.209, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228479280841\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00250|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228479281159\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00251|bridge|INFO|bridge incusovn16: using datapath ID 0000120a87fe924e\"\n },\n {\n \"at\": \"1789228479281182\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00252|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789228479378655\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00253|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228479378758\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00254|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789228479384238\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00255|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228479384295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00256|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789228479474399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00257|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474441\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474495\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474512\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474532\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474545\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474556\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474603\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479474614\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474644\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474675\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474726\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474738\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474752\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00258|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479474773\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479474787\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479474803\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479474815\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479474825\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479474835\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474845\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474856\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861338ms\"\n },\n {\n \"at\": \"1789228479474865\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479474875\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474893\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479474905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479474919\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474929\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479474939\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479474949\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479474958\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479474968\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474978\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479474989\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479474998\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789228479477553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler337)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479477697\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler337)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479477721\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479477749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479477768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x894972dc your_disc:0x0\"\n },\n {\n \"at\": \"1789228479477785\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479477806\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479477822\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479477837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479477852\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479477866\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479477886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479477912\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861341ms\"\n },\n {\n \"at\": \"1789228479477934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +997ms\"\n },\n {\n \"at\": \"1789228479477951\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479477972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479477985\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479478004\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478019\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479478034\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478049\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478065\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479478097\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478112\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479478132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478186\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478203\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478284\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478298\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478311\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479478333\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +997ms\"\n },\n {\n \"at\": \"1789228479478347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789228479478363\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478377\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479478392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478406\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228479478421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478436\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478451\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479478480\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478494\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228479478509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478542\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478790\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00259|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479478809\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479478819\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479478829\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479478837\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479478848\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789228479478860\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478873\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478884\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861342ms\"\n },\n {\n \"at\": \"1789228479478896\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479478907\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478921\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479478933\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479478945\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479478962\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479478975\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479478988\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789228479478999\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479479010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789228479479022\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479479031\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479479040\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789228479480002\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler337)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479480053\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler337)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479480068\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479480079\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479480094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x8ec6ef2f your_disc:0x0\"\n },\n {\n \"at\": \"1789228479480104\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480114\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479480135\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480144\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480155\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480163\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480178\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480201\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480211\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480221\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480231\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480242\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479480252\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480299\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479480310\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479480318\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479480355\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479480364\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480374\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480383\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480392\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480401\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479480411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480431\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480440\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480449\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228479480468\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480490\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480509\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228479480527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480547\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480566\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler337)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789228479480577\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler337)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789228479480588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789228479480598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789228479480608\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x6bc64e34 your_disc:0x0\"\n },\n {\n \"at\": \"1789228479480618\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480627\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789228479480637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789228479480647\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480656\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480681\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480690\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1591861344ms\"\n },\n {\n \"at\": \"1789228479480700\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +915ms\"\n },\n {\n \"at\": \"1789228479480711\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228479480730\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480740\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480759\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479480768\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480778\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480786\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479480796\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479480805\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480813\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479480824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789228479480833\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479480842\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480852\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228479480867\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228479480876\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228479480886\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228479480894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480905\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228479480920\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228479480934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +915ms\"\n },\n {\n \"at\": \"1789228479480944\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789228479480954\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228479480963\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789228479480972\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479480982\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228479480991\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481001\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481011\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228479481019\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789228479481029\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228479481039\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228479481052\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228479481070\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480291060\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480291346\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480291370\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480291385\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480291394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480291407\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480291417\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480291428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +84ms\"\n },\n {\n \"at\": \"1789228480291439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -716ms\"\n },\n {\n \"at\": \"1789228480291453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480291473\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480291499\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480291510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x24fed059\"\n },\n {\n \"at\": \"1789228480291523\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291533\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291546\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480291557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480291568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480291578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8ec6ef2f\"\n },\n {\n \"at\": \"1789228480291590\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480291601\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480291611\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480410199\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228480410414\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228480410443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228480410463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228480410479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480410498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228480410515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228480410533\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +985ms\"\n },\n {\n \"at\": \"1789228480410551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -15ms\"\n },\n {\n \"at\": \"1789228480410570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228480410588\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228480410606\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480410623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x9b9bc62f\"\n },\n {\n \"at\": \"1789228480410641\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410692\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228480410714\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228480410732\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228480410749\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x6bc64e34\"\n },\n {\n \"at\": \"1789228480410767\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228480410783\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228480410799\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481317295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00012|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789228481317728\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789228481317780\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228481317824\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789228481317859\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481317904\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789228481317980\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789228481318038\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +58ms\"\n },\n {\n \"at\": \"1789228481318072\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -842ms\"\n },\n {\n \"at\": \"1789228481318102\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789228481318131\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789228481318161\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481318189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x126453c1\"\n },\n {\n \"at\": \"1789228481318217\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318257\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789228481318276\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789228481318296\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789228481318314\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x894972dc\"\n },\n {\n \"at\": \"1789228481318332\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789228481318351\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789228481318371\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789228489286016\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00260|connmgr|INFO|br-int<->unix#7: 969 flow_mods in the 6 s starting 10 s ago (862 adds, 106 deletes, 1 modifications)\"\n },\n {\n \"at\": \"1789228535389567\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789228535390481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00261|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789228535390527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00262|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789228535390553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00263|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789228535419894\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00264|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:55:37.456545+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T15:55:37.457673+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/create.stdout.json new file mode 100644 index 0000000..de0e6ae --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.569, + "first_cross_member_ping_seconds": 3.363, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/cycle.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/cycle.json new file mode 100644 index 0000000..046ac2d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/cycle.json @@ -0,0 +1,121 @@ +{ + "ok": false, + "datapath_ok": false, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 1, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T15:54:36.640301+00:00", + "ended_at": "2026-09-12T15:55:37.457798+00:00", + "seconds": 60.817, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:b2:7a:65", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.569, + "first_cross_member_ping_seconds": 3.363, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": false, + "exit_code": 1, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.113 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.097 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\"volatile.eth0.host_name\":\"veth4711b759\",\"volatile.eth0.hwaddr\":\"10:66:6a:42:ab:f9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\"volatile.uuid.generation\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:54:40.291942629Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\"volatile.eth0.host_name\":\"veth4711b759\",\"volatile.eth0.hwaddr\":\"10:66:6a:42:ab:f9\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\"volatile.uuid.generation\":\"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:54:40.866490778Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9662464,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe42:abf9\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:42:ab:f9\",\"host_name\":\"veth4711b759\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4180780,\"processes\":4,\"cpu\":{\"usage\":482073000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:54:39.880000114Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"d35024e8-a62e-4076-b972-b0649f082bcc\",\"volatile.eth0.host_name\":\"veth0f727b81\",\"volatile.eth0.hwaddr\":\"10:66:6a:7e:16:81\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\"volatile.uuid.generation\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T15:54:41.080263333Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"d35024e8-a62e-4076-b972-b0649f082bcc\",\"volatile.eth0.host_name\":\"veth0f727b81\",\"volatile.eth0.hwaddr\":\"10:66:6a:7e:16:81\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\"volatile.uuid.generation\":\"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T15:54:41.65195342Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":10747904,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe7e:1681\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:7e:16:81\",\"host_name\":\"veth0f727b81\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":37065,\"processes\":4,\"cpu\":{\"usage\":488402000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T15:54:41.660000085Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.266 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.201 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.261 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.075 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.707 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.340 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.340/0.707/1.075 ms\nelapsed_seconds=2.260 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.025 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.807 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.413 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.413/0.748/1.025 ms\nelapsed_seconds=2.242 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.409 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.276 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.256 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.239 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.253 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5001 milliseconds\nelapsed_seconds=5.298 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5003 ms: Timeout was reached\nelapsed_seconds=5.030 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.108883 bytes_per_second=918417016\nelapsed_seconds=0.556 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.491 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.142853 bytes_per_second=700020300\nelapsed_seconds=0.393 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.558 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", + "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 45007, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.log", + "bytes": 175516, + "ready_signal": "time=\"2026-09-12T08:54:37-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:54:37.217943+00:00", + "stopped_at": "2026-09-12T15:54:46.103278+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 45763, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/tcpdump-arp.log", + "bytes": 188, + "ready_signal": "listening on", + "started_at": "2026-09-12T15:54:47.628810+00:00", + "stopped_at": "2026-09-12T15:55:30.805795+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 48364, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.log", + "bytes": 40523, + "ready_signal": "time=\"2026-09-12T08:55:32-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T15:55:32.247764+00:00", + "stopped_at": "2026-09-12T15:55:35.939805+00:00" + } + ], + "failures": { + "checks": [ + "probe: probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed" + ], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-probe.txt new file mode 100644 index 0000000..23da6e1 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-probe.txt @@ -0,0 +1,6063 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:42:ab:f9 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:7e:16:81 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch fd4b631c-81c0-4c8e-9e92-dc7cf9a33c9d (incus-net37-ls-ext) + port incus-net37-ls-ext-lsp-router + type: router + router-port: incus-net37-lr-lrp-ext + port incus-net37-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 684fbd9a-01fc-43aa-a171-d322d63e6887 (incus-net37-ls-int) + port incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0 + addresses: ["10:66:6a:7e:16:81 dynamic"] + port incus-net37-ls-int-lsp-router + type: router + router-port: incus-net37-lr-lrp-int + port incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0 + addresses: ["10:66:6a:42:ab:f9 dynamic"] +router acd84fae-7dea-4d77-b555-dae888322639 (incus-net37-lr) + port incus-net37-lr-lrp-ext + mac: "10:66:6a:b2:7a:65" + ipv6-lla: "fe80::1266:6aff:feb2:7a65" + networks: ["10.10.40.64/24"] + port incus-net37-lr-lrp-int + mac: "10:66:6a:b2:7a:65" + ipv6-lla: "fe80::1266:6aff:feb2:7a65" + networks: ["10.253.73.1/24"] + nat a10b55e2-fd03-497a-b507-27de4d11b529 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net37-lr-lrp-ext + Port_Binding incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : d629ff1d-a504-49fe-a7c8-f0323ee49c93 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : de608431-0186-4362-86d7-cac077dd05e7 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:b2:7a:65" +name : incus-net37-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : e04baf95-5323-4806-8837-59c9e0fbc892 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:b2:7a:65" +name : incus-net37-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 70a417e5-7e57-4de0-8d05-1cd489841205 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 62a237be-632c-48ed-8a7b-8844743cd71b +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : ce09c18b-41bd-4255-a48e-d5595868baa0 +logical_port : cr-incus-net37-lr-lrp-ext +mac : ["10:66:6a:b2:7a:65 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net37-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : de608431-0186-4362-86d7-cac077dd05e7 +external_ids : {} +ha_chassis : [093d581f-a240-48d1-8523-23f1f4332ef2, 6bae3c80-717c-4b0f-82a0-035c6921b222, aeacbaee-6168-4a6d-ba97-359ec9f0230c, e68ec4f2-be40-49bb-9a54-454bc30f38e8] +name : incus-net37 +=== ovn-nbctl list HA_Chassis === +_uuid : 6bae3c80-717c-4b0f-82a0-035c6921b222 +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 30102 + +_uuid : e68ec4f2-be40-49bb-9a54-454bc30f38e8 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 31425 + +_uuid : aeacbaee-6168-4a6d-ba97-359ec9f0230c +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 5868 + +_uuid : 093d581f-a240-48d1-8523-23f1f4332ef2 +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 6746 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479484425", + "member": "lab01.glab.lol", + "message": "ovs|84516|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479484766", + "member": "lab01.glab.lol", + "message": "ovs|84517|bridge|INFO|bridge incusovn16: using datapath ID 0000fecb28f30f44" + }, + { + "at": "1789228479484807", + "member": "lab01.glab.lol", + "message": "ovs|84518|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479486903", + "member": "lab01.glab.lol", + "message": "ovs|84519|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479486961", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479486992", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479487020", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479487041", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479487068", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479487089", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757487ms" + }, + { + "at": "1789228479487104", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757487ms" + }, + { + "at": "1789228479487126", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757487ms" + }, + { + "at": "1789228479487152", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479487177", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479487195", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487218", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479487239", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479487251", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487275", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479487293", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479487311", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487333", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479487354", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479487372", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487391", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479487413", + "member": "lab01.glab.lol", + "message": "ovs|84520|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479487444", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479487461", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479487488", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479487504", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479487520", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479487545", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757487ms" + }, + { + "at": "1789228479487560", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757487ms" + }, + { + "at": "1789228479487582", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757487ms" + }, + { + "at": "1789228479487605", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479487617", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479487632", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487647", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479487668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479487682", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487698", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479487713", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479487729", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487741", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479487755", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479487770", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487783", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479487796", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479494185", + "member": "lab01.glab.lol", + "message": "ovs|84521|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479494228", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479494250", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479494269", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479494282", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479494299", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479494312", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757494ms" + }, + { + "at": "1789228479494333", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757494ms" + }, + { + "at": "1789228479494349", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757494ms" + }, + { + "at": "1789228479494371", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479494388", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479494400", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479494422", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479494442", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479494470", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479494483", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479494498", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479494521", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479494542", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479494561", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479494573", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479494587", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479581012", + "member": "lab01.glab.lol", + "message": "ovs|84522|dpif|WARN|Dropped 1500 log messages in last 308 seconds (most recently, 308 seconds ago) due to excessive rate" + }, + { + "at": "1789228479581112", + "member": "lab01.glab.lol", + "message": "ovs|84523|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479581149", + "member": "lab01.glab.lol", + "message": "ovs|84524|bridge|WARN|Dropped 56686 log messages in last 335 seconds (most recently, 308 seconds ago) due to excessive rate" + }, + { + "at": "1789228479581190", + "member": "lab01.glab.lol", + "message": "ovs|84525|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479581341", + "member": "lab01.glab.lol", + "message": "ovs|84526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479581371", + "member": "lab01.glab.lol", + "message": "ovs|84527|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479582706", + "member": "lab01.glab.lol", + "message": "ovs|84528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479582786", + "member": "lab01.glab.lol", + "message": "ovs|84529|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479583949", + "member": "lab01.glab.lol", + "message": "ovs|84530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479584037", + "member": "lab01.glab.lol", + "message": "ovs|84531|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479585060", + "member": "lab01.glab.lol", + "message": "ovs|84532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479585181", + "member": "lab01.glab.lol", + "message": "ovs|84533|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479588143", + "member": "lab01.glab.lol", + "message": "ovs|84534|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228479588235", + "member": "lab01.glab.lol", + "message": "ovs|84535|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228480327229", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler327)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480327347", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler327)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228480327378", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480327412", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480327440", + "member": "lab01.glab.lol", + "message": " my_disc:0xe975fdaf your_disc:0x8fe124e2" + }, + { + "at": "1789228480327458", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480327475", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480327497", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480327512", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480327530", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480327547", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480327561", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480327577", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758327ms" + }, + { + "at": "1789228480327599", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +90ms" + }, + { + "at": "1789228480327614", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -740ms" + }, + { + "at": "1789228480327647", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480327659", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480327672", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480327682", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480327700", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480327714", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480327731", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480327741", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480327764", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480327838", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480327857", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480327868", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480327889", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480327899", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler327)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480327916", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480327931", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480327942", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480327952", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480327962", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480327981", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480327996", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +90ms" + }, + { + "at": "1789228480328013", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -740ms" + }, + { + "at": "1789228480328022", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480328038", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480328049", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480328067", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480328079", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480328098", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480328114", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480328123", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480328133", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480328144", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480328158", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480328169", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480328184", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480403421", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler327)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480403541", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler327)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228480403572", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480403585", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480403608", + "member": "lab01.glab.lol", + "message": " my_disc:0x9b9bc62f your_disc:0x6bc64e34" + }, + { + "at": "1789228480403624", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480403636", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480403646", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480403658", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480403674", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480403685", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480403705", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480403725", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758403ms" + }, + { + "at": "1789228480403748", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -136ms" + }, + { + "at": "1789228480403768", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -916ms" + }, + { + "at": "1789228480403788", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480403798", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480403809", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480403826", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480403838", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480403851", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480403861", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480403878", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480403889", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480403904", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480403926", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480403944", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480403959", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480403974", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler327)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480403991", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480404003", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480404021", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480404031", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480404048", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480404065", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480404075", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -136ms" + }, + { + "at": "1789228480404087", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -916ms" + }, + { + "at": "1789228480404096", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480404113", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480404126", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480404140", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480404159", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480404170", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480404180", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480404191", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480404208", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480404217", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480404232", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480404244", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480404261", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480474245", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler327)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480474355", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler327)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228480474376", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480474392", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480474415", + "member": "lab01.glab.lol", + "message": " my_disc:0x45468bf5 your_disc:0xf1d4b82" + }, + { + "at": "1789228480474433", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480474448", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480474457", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480474478", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480474500", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480474512", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480474523", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480474538", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758474ms" + }, + { + "at": "1789228480474560", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +713ms" + }, + { + "at": "1789228480474591", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -147ms" + }, + { + "at": "1789228480474615", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480474636", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480474647", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474659", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228480474676", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480474691", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480474703", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480474717", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480474730", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474743", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x45468bf5" + }, + { + "at": "1789228480474762", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480474773", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480474792", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480474807", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler327)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480474829", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480474843", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480474853", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480474863", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480474872", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480474884", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480474893", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +713ms" + }, + { + "at": "1789228480474911", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -147ms" + }, + { + "at": "1789228480474923", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480474933", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480474952", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474962", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228480474981", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480474991", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480475006", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480475015", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480475024", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480475034", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x45468bf5" + }, + { + "at": "1789228480475050", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480475061", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480475072", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480580957", + "member": "lab01.glab.lol", + "message": "ovs|84536|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228480581107", + "member": "lab01.glab.lol", + "message": "ovs|84537|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228480782390", + "member": "lab01.glab.lol", + "message": "ovs|84538|bridge|INFO|bridge br-int: added interface veth4711b759 on port 38" + }, + { + "at": "1789228481580858", + "member": "lab01.glab.lol", + "message": "ovs|84539|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228481580995", + "member": "lab01.glab.lol", + "message": "ovs|84540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228482580818", + "member": "lab01.glab.lol", + "message": "ovs|84541|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228482580919", + "member": "lab01.glab.lol", + "message": "ovs|84542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228483316767", + "member": "lab01.glab.lol", + "message": "ovs|84543|poll_loop|INFO|Dropped 2526 log messages in last 313 seconds (most recently, 310 seconds ago) due to excessive rate" + }, + { + "at": "1789228483317034", + "member": "lab01.glab.lol", + "message": "ovs|84544|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483317290", + "member": "lab01.glab.lol", + "message": "ovs|84545|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483317798", + "member": "lab01.glab.lol", + "message": "ovs|84546|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483318477", + "member": "lab01.glab.lol", + "message": "ovs|84547|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483318772", + "member": "lab01.glab.lol", + "message": "ovs|84548|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483319274", + "member": "lab01.glab.lol", + "message": "ovs|84549|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483319853", + "member": "lab01.glab.lol", + "message": "ovs|84550|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483320368", + "member": "lab01.glab.lol", + "message": "ovs|84551|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483320882", + "member": "lab01.glab.lol", + "message": "ovs|84552|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483321398", + "member": "lab01.glab.lol", + "message": "ovs|84553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483580552", + "member": "lab01.glab.lol", + "message": "ovs|84554|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228483580617", + "member": "lab01.glab.lol", + "message": "ovs|84555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228484580669", + "member": "lab01.glab.lol", + "message": "ovs|84556|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228484580860", + "member": "lab01.glab.lol", + "message": "ovs|84557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228485580915", + "member": "lab01.glab.lol", + "message": "ovs|84558|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228485581160", + "member": "lab01.glab.lol", + "message": "ovs|84559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228486581159", + "member": "lab01.glab.lol", + "message": "ovs|84560|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228486581417", + "member": "lab01.glab.lol", + "message": "ovs|84561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228487580730", + "member": "lab01.glab.lol", + "message": "ovs|84562|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228487580823", + "member": "lab01.glab.lol", + "message": "ovs|84563|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228488580936", + "member": "lab01.glab.lol", + "message": "ovs|84564|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228488581132", + "member": "lab01.glab.lol", + "message": "ovs|84565|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228489316770", + "member": "lab01.glab.lol", + "message": "ovs|84566|poll_loop|INFO|Dropped 12178 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228489316895", + "member": "lab01.glab.lol", + "message": "ovs|84567|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228489488874", + "member": "lab01.glab.lol", + "message": "ovs|84568|connmgr|INFO|br-int<->unix#7: 911 flow_mods in the 6 s starting 10 s ago (845 adds, 58 deletes, 8 modifications)" + }, + { + "at": "1789228489581052", + "member": "lab01.glab.lol", + "message": "ovs|84569|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228489581223", + "member": "lab01.glab.lol", + "message": "ovs|84570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228490580965", + "member": "lab01.glab.lol", + "message": "ovs|84571|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228490581071", + "member": "lab01.glab.lol", + "message": "ovs|84572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228491580787", + "member": "lab01.glab.lol", + "message": "ovs|84573|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228491580926", + "member": "lab01.glab.lol", + "message": "ovs|84574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228492580903", + "member": "lab01.glab.lol", + "message": "ovs|84575|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228492581165", + "member": "lab01.glab.lol", + "message": "ovs|84576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228493580892", + "member": "lab01.glab.lol", + "message": "ovs|84577|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228493581040", + "member": "lab01.glab.lol", + "message": "ovs|84578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228494580810", + "member": "lab01.glab.lol", + "message": "ovs|84579|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228494580951", + "member": "lab01.glab.lol", + "message": "ovs|84580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228495316892", + "member": "lab01.glab.lol", + "message": "ovs|84581|poll_loop|INFO|Dropped 12420 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228495317132", + "member": "lab01.glab.lol", + "message": "ovs|84582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228495580847", + "member": "lab01.glab.lol", + "message": "ovs|84583|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228495580949", + "member": "lab01.glab.lol", + "message": "ovs|84584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228496581037", + "member": "lab01.glab.lol", + "message": "ovs|84585|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228496581261", + "member": "lab01.glab.lol", + "message": "ovs|84586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228497580977", + "member": "lab01.glab.lol", + "message": "ovs|84587|dpif|WARN|Dropped 1989 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228497581118", + "member": "lab01.glab.lol", + "message": "ovs|84588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228498581013", + "member": "lab01.glab.lol", + "message": "ovs|84589|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228498581149", + "member": "lab01.glab.lol", + "message": "ovs|84590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228499580774", + "member": "lab01.glab.lol", + "message": "ovs|84591|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228499580921", + "member": "lab01.glab.lol", + "message": "ovs|84592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228500580849", + "member": "lab01.glab.lol", + "message": "ovs|84593|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228500581063", + "member": "lab01.glab.lol", + "message": "ovs|84594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228501316812", + "member": "lab01.glab.lol", + "message": "ovs|84595|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228501316949", + "member": "lab01.glab.lol", + "message": "ovs|84596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228501581171", + "member": "lab01.glab.lol", + "message": "ovs|84597|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228501581346", + "member": "lab01.glab.lol", + "message": "ovs|84598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228502580732", + "member": "lab01.glab.lol", + "message": "ovs|84599|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228502608575", + "member": "lab01.glab.lol", + "message": "ovs|84600|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228503580703", + "member": "lab01.glab.lol", + "message": "ovs|84601|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228503580851", + "member": "lab01.glab.lol", + "message": "ovs|84602|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228504581109", + "member": "lab01.glab.lol", + "message": "ovs|84603|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228504581455", + "member": "lab01.glab.lol", + "message": "ovs|84604|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228505580957", + "member": "lab01.glab.lol", + "message": "ovs|84605|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228505581107", + "member": "lab01.glab.lol", + "message": "ovs|84606|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228506580801", + "member": "lab01.glab.lol", + "message": "ovs|84607|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228506581004", + "member": "lab01.glab.lol", + "message": "ovs|84608|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228507317107", + "member": "lab01.glab.lol", + "message": "ovs|84609|poll_loop|INFO|Dropped 12249 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228507317238", + "member": "lab01.glab.lol", + "message": "ovs|84610|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228507580972", + "member": "lab01.glab.lol", + "message": "ovs|84611|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228507581182", + "member": "lab01.glab.lol", + "message": "ovs|84612|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228508581077", + "member": "lab01.glab.lol", + "message": "ovs|84613|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228508581320", + "member": "lab01.glab.lol", + "message": "ovs|84614|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228509580584", + "member": "lab01.glab.lol", + "message": "ovs|84615|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228509580802", + "member": "lab01.glab.lol", + "message": "ovs|84616|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228510580847", + "member": "lab01.glab.lol", + "message": "ovs|84617|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228510581094", + "member": "lab01.glab.lol", + "message": "ovs|84618|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228511581014", + "member": "lab01.glab.lol", + "message": "ovs|84619|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228511581249", + "member": "lab01.glab.lol", + "message": "ovs|84620|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228512580997", + "member": "lab01.glab.lol", + "message": "ovs|84621|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228512581108", + "member": "lab01.glab.lol", + "message": "ovs|84622|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228513316982", + "member": "lab01.glab.lol", + "message": "ovs|84623|poll_loop|INFO|Dropped 12233 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228513317141", + "member": "lab01.glab.lol", + "message": "ovs|84624|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228513580746", + "member": "lab01.glab.lol", + "message": "ovs|84625|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228513580805", + "member": "lab01.glab.lol", + "message": "ovs|84626|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228514580992", + "member": "lab01.glab.lol", + "message": "ovs|84627|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228514581249", + "member": "lab01.glab.lol", + "message": "ovs|84628|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228515580631", + "member": "lab01.glab.lol", + "message": "ovs|84629|dpif|WARN|Dropped 2104 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228515580773", + "member": "lab01.glab.lol", + "message": "ovs|84630|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228516580917", + "member": "lab01.glab.lol", + "message": "ovs|84631|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228516581123", + "member": "lab01.glab.lol", + "message": "ovs|84632|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228517580978", + "member": "lab01.glab.lol", + "message": "ovs|84633|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228517581216", + "member": "lab01.glab.lol", + "message": "ovs|84634|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228518580786", + "member": "lab01.glab.lol", + "message": "ovs|84635|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228518580904", + "member": "lab01.glab.lol", + "message": "ovs|84636|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228519316796", + "member": "lab01.glab.lol", + "message": "ovs|84637|poll_loop|INFO|Dropped 12367 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228519317027", + "member": "lab01.glab.lol", + "message": "ovs|84638|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228519580709", + "member": "lab01.glab.lol", + "message": "ovs|84639|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228519580779", + "member": "lab01.glab.lol", + "message": "ovs|84640|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228520580597", + "member": "lab01.glab.lol", + "message": "ovs|84641|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228520580836", + "member": "lab01.glab.lol", + "message": "ovs|84642|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228521580730", + "member": "lab01.glab.lol", + "message": "ovs|84643|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228521580973", + "member": "lab01.glab.lol", + "message": "ovs|84644|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228522580887", + "member": "lab01.glab.lol", + "message": "ovs|84645|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228522581093", + "member": "lab01.glab.lol", + "message": "ovs|84646|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228523580573", + "member": "lab01.glab.lol", + "message": "ovs|84647|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228523580669", + "member": "lab01.glab.lol", + "message": "ovs|84648|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228524580898", + "member": "lab01.glab.lol", + "message": "ovs|84649|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228524581131", + "member": "lab01.glab.lol", + "message": "ovs|84650|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228525316757", + "member": "lab01.glab.lol", + "message": "ovs|84651|poll_loop|INFO|Dropped 12482 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228525316919", + "member": "lab01.glab.lol", + "message": "ovs|84652|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228525580739", + "member": "lab01.glab.lol", + "message": "ovs|84653|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228525580821", + "member": "lab01.glab.lol", + "message": "ovs|84654|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228526580988", + "member": "lab01.glab.lol", + "message": "ovs|84655|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228526581243", + "member": "lab01.glab.lol", + "message": "ovs|84656|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228527580971", + "member": "lab01.glab.lol", + "message": "ovs|84657|dpif|WARN|Dropped 2105 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228527581076", + "member": "lab01.glab.lol", + "message": "ovs|84658|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228528581119", + "member": "lab01.glab.lol", + "message": "ovs|84659|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228528581356", + "member": "lab01.glab.lol", + "message": "ovs|84660|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228529580979", + "member": "lab01.glab.lol", + "message": "ovs|84661|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228529581077", + "member": "lab01.glab.lol", + "message": "ovs|84662|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228530581094", + "member": "lab01.glab.lol", + "message": "ovs|84663|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228530581362", + "member": "lab01.glab.lol", + "message": "ovs|84664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228531316980", + "member": "lab01.glab.lol", + "message": "ovs|84665|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228531317093", + "member": "lab01.glab.lol", + "message": "ovs|84666|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228531581110", + "member": "lab01.glab.lol", + "message": "ovs|84667|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228531581280", + "member": "lab01.glab.lol", + "message": "ovs|84668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479472013", + "member": "lab02.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479472164", + "member": "lab02.glab.lol", + "message": "ovs|00247|bridge|INFO|bridge incusovn16: using datapath ID 0000b2f8733c5b4e" + }, + { + "at": "1789228479472179", + "member": "lab02.glab.lol", + "message": "ovs|00248|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479474127", + "member": "lab02.glab.lol", + "message": "ovs|00249|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474189", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474209", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474222", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474231", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474243", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474254", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474271", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474282", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474299", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474312", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474324", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474335", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479474347", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474368", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474380", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474391", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474408", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474420", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474431", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474442", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474453", + "member": "lab02.glab.lol", + "message": "ovs|00250|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474467", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474477", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474486", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474497", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474510", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474519", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474529", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474538", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474548", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474559", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474570", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474579", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479474590", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474602", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474614", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474624", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474635", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474644", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474653", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474663", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474673", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474683", + "member": "lab02.glab.lol", + "message": "ovs|00251|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474709", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474718", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474728", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474744", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474755", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474765", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474776", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474787", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474796", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474811", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474821", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479474833", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474844", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474853", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474868", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474877", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474886", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474897", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474907", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474917", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474926", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479570181", + "member": "lab02.glab.lol", + "message": "ovs|00252|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479570275", + "member": "lab02.glab.lol", + "message": "ovs|00253|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228479570389", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler328)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479570610", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler328)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228479570644", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228479570673", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479570696", + "member": "lab02.glab.lol", + "message": " my_disc:0x24fed059 your_disc:0x8ec6ef2f" + }, + { + "at": "1789228479570720", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479570742", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479570765", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479570786", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479570808", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479571070", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479571124", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479571151", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734570ms" + }, + { + "at": "1789228479571176", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789228479571205", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789228479571228", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479571250", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479571273", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571321", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479571345", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479571366", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571391", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479571420", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228479571449", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571471", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x24fed059" + }, + { + "at": "1789228479571495", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479571524", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571545", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479571566", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler328)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479571595", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479571617", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479571641", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479571662", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479571682", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479571712", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479571737", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789228479571758", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789228479571779", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479571800", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479571821", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571841", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479571862", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479571885", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571907", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479571928", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228479571949", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571969", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x24fed059" + }, + { + "at": "1789228479571988", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479572015", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479572034", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479572480", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler328)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479572510", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler328)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228479572535", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479572562", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479572584", + "member": "lab02.glab.lol", + "message": " my_disc:0xfe8ea320 your_disc:0x0" + }, + { + "at": "1789228479572609", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479572628", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479572649", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479572674", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479572697", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479572717", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479572736", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479572756", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734572ms" + }, + { + "at": "1789228479572777", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +691ms" + }, + { + "at": "1789228479572799", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789228479572824", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479572845", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479572866", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479572887", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479572911", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479572932", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479572953", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479572973", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479572996", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573017", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479573038", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479573058", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573077", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479573095", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479573114", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479573132", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479573153", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479573175", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479573196", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479573216", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479573237", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +691ms" + }, + { + "at": "1789228479573257", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789228479573276", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479573296", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479573317", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573337", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479573360", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479573380", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573405", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479573427", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479573447", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573469", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479573490", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479573510", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573531", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479575013", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler328)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479575076", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler328)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479575104", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479575127", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479575148", + "member": "lab02.glab.lol", + "message": " my_disc:0x8fe124e2 your_disc:0x0" + }, + { + "at": "1789228479575171", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479575192", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479575215", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479575236", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479575261", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479575282", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479575301", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479575319", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734574ms" + }, + { + "at": "1789228479575341", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228479575364", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228479575390", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479575420", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479575441", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575466", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479575487", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479575507", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479575528", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479575546", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479575609", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575632", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479575654", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479575675", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479575695", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479575716", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479575739", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479575758", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479575776", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479575796", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479575823", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479575844", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479575864", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228479575887", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228479575907", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479575928", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479575948", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575969", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479575988", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479576006", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479576027", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479576047", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479576068", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479576091", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479576110", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479576130", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479576156", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479577332", + "member": "lab02.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479577420", + "member": "lab02.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789228480404701", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480404846", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480404878", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480404901", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480404924", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480404949", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480404975", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480405000", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +760ms" + }, + { + "at": "1789228480405035", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -90ms" + }, + { + "at": "1789228480405059", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480405079", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480405106", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480405129", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480405151", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480405174", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480405197", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480405219", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480405246", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480405271", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480405296", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480405315", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480405335", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480442870", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480442960", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480442985", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480443005", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480443030", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480443052", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480443072", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480443093", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +741ms" + }, + { + "at": "1789228480443116", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -179ms" + }, + { + "at": "1789228480443139", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480443161", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480443185", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480443205", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228480443231", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480443251", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480443270", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480443293", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480443315", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480443337", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480443356", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480443377", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480443408", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228489476199", + "member": "lab02.glab.lol", + "message": "ovs|00256|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (812 adds, 56 deletes, 7 modifications)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479468990", + "member": "lab03.glab.lol", + "message": "ovs|00272|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479469117", + "member": "lab03.glab.lol", + "message": "ovs|00273|bridge|INFO|bridge incusovn16: using datapath ID 0000de68b8cf5447" + }, + { + "at": "1789228479469132", + "member": "lab03.glab.lol", + "message": "ovs|00274|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479470916", + "member": "lab03.glab.lol", + "message": "ovs|00275|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479470975", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479470995", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479471010", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479471023", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479471034", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479471053", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634468ms" + }, + { + "at": "1789228479471068", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634468ms" + }, + { + "at": "1789228479471083", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634468ms" + }, + { + "at": "1789228479471096", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479471112", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479471123", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471136", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228479471148", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479471158", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471172", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479471185", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479471198", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471208", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479471223", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479471237", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471248", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479471261", + "member": "lab03.glab.lol", + "message": "ovs|00276|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479471274", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479471288", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479471300", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479471311", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479471320", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479471331", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634468ms" + }, + { + "at": "1789228479471342", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634468ms" + }, + { + "at": "1789228479471354", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634468ms" + }, + { + "at": "1789228479471363", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479471375", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479471388", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471399", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479471414", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479471425", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471436", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479471447", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479471458", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471468", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479471481", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479471492", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471502", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479471513", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479473763", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler324)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479473807", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler324)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479473825", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479473845", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479473860", + "member": "lab03.glab.lol", + "message": " my_disc:0xf1d4b82 your_disc:0x0" + }, + { + "at": "1789228479473875", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479473888", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479473899", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479473911", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479473921", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479473931", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479473943", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479473959", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634471ms" + }, + { + "at": "1789228479473974", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +987ms" + }, + { + "at": "1789228479473986", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479473999", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474009", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479474023", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474034", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479474046", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474055", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474072", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474083", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479474097", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474109", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479474121", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474131", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474143", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479474155", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474170", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474182", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474192", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474207", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474218", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479474228", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479474243", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +987ms" + }, + { + "at": "1789228479474255", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479474265", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474275", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479474287", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474298", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479474309", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474321", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474330", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474342", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479474353", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474364", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479474373", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474391", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474404", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478589", + "member": "lab03.glab.lol", + "message": "ovs|00277|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478631", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478645", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478656", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478667", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478677", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479478690", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634476ms" + }, + { + "at": "1789228479478706", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634476ms" + }, + { + "at": "1789228479478723", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634476ms" + }, + { + "at": "1789228479478733", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478746", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479478757", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478767", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479478778", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478788", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478798", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478807", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479478818", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478829", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479478840", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479478849", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478859", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479567283", + "member": "lab03.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479567423", + "member": "lab03.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228479575196", + "member": "lab03.glab.lol", + "message": "ovs|00280|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479575289", + "member": "lab03.glab.lol", + "message": "ovs|00281|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228480263720", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler324)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480263821", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler324)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228480263855", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480263888", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480263912", + "member": "lab03.glab.lol", + "message": " my_disc:0xc6336142 your_disc:0xfe8ea320" + }, + { + "at": "1789228480263939", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480263964", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480263989", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480264015", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480264039", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480264072", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480264102", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480264134", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50635261ms" + }, + { + "at": "1789228480264160", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228480264186", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -692ms" + }, + { + "at": "1789228480264210", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480264237", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480264261", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264283", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480264308", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480264331", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264354", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480264376", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480264403", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264427", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc6336142" + }, + { + "at": "1789228480264451", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480264472", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264492", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480264515", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler324)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480264540", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480264562", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480264585", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480264663", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480264686", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480264708", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480264736", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228480264758", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -692ms" + }, + { + "at": "1789228480264779", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480264801", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480264824", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264892", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480264914", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480264934", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264958", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480264981", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480265003", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480265026", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc6336142" + }, + { + "at": "1789228480265047", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480265080", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480265101", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480469217", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler324)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480469493", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler324)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228480469532", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480469561", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480469586", + "member": "lab03.glab.lol", + "message": " my_disc:0x126453c1 your_disc:0x894972dc" + }, + { + "at": "1789228480469615", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480469639", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480469663", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480469692", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480469722", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480469747", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480469777", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480469800", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50635467ms" + }, + { + "at": "1789228480469825", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +841ms" + }, + { + "at": "1789228480469851", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -159ms" + }, + { + "at": "1789228480469882", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480469907", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480469931", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480469953", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228480469978", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470003", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470027", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480470052", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480470096", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470317", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x126453c1" + }, + { + "at": "1789228480470347", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480470373", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470395", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480470425", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler324)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480470458", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480470483", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480470510", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480470532", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480470556", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480470582", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480470606", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +841ms" + }, + { + "at": "1789228480470628", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -159ms" + }, + { + "at": "1789228480470655", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480470679", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480470704", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470728", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228480470750", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470776", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470799", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480470820", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480470844", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470869", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x126453c1" + }, + { + "at": "1789228480470893", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470917", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470942", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481173387", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228481173475", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228481173491", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228481173506", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228481173518", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228481173530", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228481173540", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228481173551", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +117ms" + }, + { + "at": "1789228481173563", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -713ms" + }, + { + "at": "1789228481173575", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228481173586", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228481173602", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228481173612", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228481173622", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228481173634", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481173647", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228481173657", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228481173666", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228481173678", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228481173689", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228481173706", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481173718", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481573327", + "member": "lab03.glab.lol", + "message": "ovs|00282|bridge|INFO|bridge br-int: added interface veth0f727b81 on port 36" + }, + { + "at": "1789228489473008", + "member": "lab03.glab.lol", + "message": "ovs|00283|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (844 adds, 76 deletes, 8 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479280841", + "member": "nas01.glab.lol", + "message": "ovs|00250|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479281159", + "member": "nas01.glab.lol", + "message": "ovs|00251|bridge|INFO|bridge incusovn16: using datapath ID 0000120a87fe924e" + }, + { + "at": "1789228479281182", + "member": "nas01.glab.lol", + "message": "ovs|00252|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479378655", + "member": "nas01.glab.lol", + "message": "ovs|00253|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479378758", + "member": "nas01.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228479384238", + "member": "nas01.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479384295", + "member": "nas01.glab.lol", + "message": "ovs|00256|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789228479474399", + "member": "nas01.glab.lol", + "message": "ovs|00257|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474441", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474460", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474479", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474495", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474512", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474532", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861338ms" + }, + { + "at": "1789228479474545", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861338ms" + }, + { + "at": "1789228479474556", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861338ms" + }, + { + "at": "1789228479474566", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474577", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474588", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474603", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479474614", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474631", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474644", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474660", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474675", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474692", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474711", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474726", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474738", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474752", + "member": "nas01.glab.lol", + "message": "ovs|00258|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474773", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474787", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474803", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474815", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474825", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474835", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861338ms" + }, + { + "at": "1789228479474845", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861338ms" + }, + { + "at": "1789228479474856", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861338ms" + }, + { + "at": "1789228479474865", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474875", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474884", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474893", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479474905", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474919", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474929", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474939", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474949", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474958", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474968", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474978", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474989", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474998", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479477553", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler337)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479477697", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler337)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228479477721", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479477749", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479477768", + "member": "nas01.glab.lol", + "message": " my_disc:0x894972dc your_disc:0x0" + }, + { + "at": "1789228479477785", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479477806", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479477822", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479477837", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479477852", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479477866", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479477886", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479477912", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861341ms" + }, + { + "at": "1789228479477934", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +997ms" + }, + { + "at": "1789228479477951", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479477972", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479477985", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479478004", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478019", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479478034", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478049", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478065", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478079", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479478097", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478112", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228479478132", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479478186", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478203", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478222", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478239", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478255", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478270", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478284", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478298", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479478311", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479478333", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +997ms" + }, + { + "at": "1789228479478347", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479478363", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478377", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479478392", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478406", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479478421", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478436", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478451", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478465", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479478480", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478494", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228479478509", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478527", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478542", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478790", + "member": "nas01.glab.lol", + "message": "ovs|00259|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478809", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478819", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478829", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478837", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478848", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479478860", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861342ms" + }, + { + "at": "1789228479478873", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861342ms" + }, + { + "at": "1789228479478884", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861342ms" + }, + { + "at": "1789228479478896", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478907", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479478921", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478933", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479478945", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478962", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478975", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478988", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479478999", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479479010", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479479022", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479479031", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479479040", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479480002", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler337)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479480053", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler337)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228479480068", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479480079", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479480094", + "member": "nas01.glab.lol", + "message": " my_disc:0x8ec6ef2f your_disc:0x0" + }, + { + "at": "1789228479480104", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479480114", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479480124", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479480135", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480144", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480155", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480163", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480178", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861344ms" + }, + { + "at": "1789228479480190", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861344ms" + }, + { + "at": "1789228479480201", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861344ms" + }, + { + "at": "1789228479480211", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480221", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480231", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480242", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479480252", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480261", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480271", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480280", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480290", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480299", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479480310", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479480318", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480329", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480339", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479480355", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479480364", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480374", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480383", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480392", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480401", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479480411", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861344ms" + }, + { + "at": "1789228479480421", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861344ms" + }, + { + "at": "1789228479480431", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480440", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480449", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480458", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479480468", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480479", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480490", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480499", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480509", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480518", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479480527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480547", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480566", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler337)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479480577", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler337)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479480588", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479480598", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479480608", + "member": "nas01.glab.lol", + "message": " my_disc:0x6bc64e34 your_disc:0x0" + }, + { + "at": "1789228479480618", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479480627", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479480637", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479480647", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480656", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480666", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480681", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480690", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861344ms" + }, + { + "at": "1789228479480700", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +915ms" + }, + { + "at": "1789228479480711", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228479480730", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480740", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480749", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480759", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479480768", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480778", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480786", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480796", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480805", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480813", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479480824", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479480833", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480842", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480852", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479480867", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479480876", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480886", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480894", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480905", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480920", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479480934", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +915ms" + }, + { + "at": "1789228479480944", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228479480954", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480963", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480972", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480982", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479480991", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479481001", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479481011", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479481019", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479481029", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479481039", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479481052", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479481061", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479481070", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480291060", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480291346", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480291370", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480291385", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480291394", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480291407", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480291417", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480291428", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +84ms" + }, + { + "at": "1789228480291439", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789228480291453", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480291473", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480291499", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480291510", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228480291523", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480291533", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480291546", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480291557", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480291568", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480291578", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228480291590", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480291601", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480291611", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480410199", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480410414", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480410443", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480410463", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480410479", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480410498", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480410515", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480410533", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +985ms" + }, + { + "at": "1789228480410551", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -15ms" + }, + { + "at": "1789228480410570", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480410588", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480410606", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480410623", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480410641", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480410666", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480410692", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480410714", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480410732", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480410749", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480410767", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480410783", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480410799", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481317295", + "member": "nas01.glab.lol", + "message": "ovs|00012|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228481317728", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228481317780", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228481317824", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228481317859", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228481317904", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228481317980", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228481318038", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +58ms" + }, + { + "at": "1789228481318072", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -842ms" + }, + { + "at": "1789228481318102", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228481318131", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228481318161", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228481318189", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228481318217", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228481318237", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481318257", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228481318276", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228481318296", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228481318314", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228481318332", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228481318351", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481318371", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228489286016", + "member": "nas01.glab.lol", + "message": "ovs|00260|connmgr|INFO|br-int<->unix#7: 969 flow_mods in the 6 s starting 10 s ago (862 adds, 106 deletes, 1 modifications)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-teardown.txt new file mode 100644 index 0000000..4be33f3 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-after-teardown.txt @@ -0,0 +1,6059 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ovn-nbctl list HA_Chassis_Group === +=== ovn-nbctl list HA_Chassis === +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479484425", + "member": "lab01.glab.lol", + "message": "ovs|84516|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479484766", + "member": "lab01.glab.lol", + "message": "ovs|84517|bridge|INFO|bridge incusovn16: using datapath ID 0000fecb28f30f44" + }, + { + "at": "1789228479484807", + "member": "lab01.glab.lol", + "message": "ovs|84518|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479486903", + "member": "lab01.glab.lol", + "message": "ovs|84519|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479486961", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479486992", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479487020", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479487041", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479487068", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479487089", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757487ms" + }, + { + "at": "1789228479487104", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757487ms" + }, + { + "at": "1789228479487126", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757487ms" + }, + { + "at": "1789228479487152", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479487177", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479487195", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487218", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479487239", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479487251", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487275", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479487293", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479487311", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487333", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479487354", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479487372", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487391", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479487413", + "member": "lab01.glab.lol", + "message": "ovs|84520|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479487444", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479487461", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479487488", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479487504", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479487520", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479487545", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757487ms" + }, + { + "at": "1789228479487560", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757487ms" + }, + { + "at": "1789228479487582", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757487ms" + }, + { + "at": "1789228479487605", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479487617", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479487632", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487647", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479487668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479487682", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487698", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479487713", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479487729", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487741", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479487755", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479487770", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487783", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479487796", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479494185", + "member": "lab01.glab.lol", + "message": "ovs|84521|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479494228", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479494250", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479494269", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479494282", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479494299", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479494312", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757494ms" + }, + { + "at": "1789228479494333", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757494ms" + }, + { + "at": "1789228479494349", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757494ms" + }, + { + "at": "1789228479494371", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479494388", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479494400", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479494422", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479494442", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479494470", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479494483", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479494498", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479494521", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479494542", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479494561", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479494573", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479494587", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479581012", + "member": "lab01.glab.lol", + "message": "ovs|84522|dpif|WARN|Dropped 1500 log messages in last 308 seconds (most recently, 308 seconds ago) due to excessive rate" + }, + { + "at": "1789228479581112", + "member": "lab01.glab.lol", + "message": "ovs|84523|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479581149", + "member": "lab01.glab.lol", + "message": "ovs|84524|bridge|WARN|Dropped 56686 log messages in last 335 seconds (most recently, 308 seconds ago) due to excessive rate" + }, + { + "at": "1789228479581190", + "member": "lab01.glab.lol", + "message": "ovs|84525|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479581341", + "member": "lab01.glab.lol", + "message": "ovs|84526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479581371", + "member": "lab01.glab.lol", + "message": "ovs|84527|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479582706", + "member": "lab01.glab.lol", + "message": "ovs|84528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479582786", + "member": "lab01.glab.lol", + "message": "ovs|84529|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479583949", + "member": "lab01.glab.lol", + "message": "ovs|84530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479584037", + "member": "lab01.glab.lol", + "message": "ovs|84531|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479585060", + "member": "lab01.glab.lol", + "message": "ovs|84532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479585181", + "member": "lab01.glab.lol", + "message": "ovs|84533|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479588143", + "member": "lab01.glab.lol", + "message": "ovs|84534|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228479588235", + "member": "lab01.glab.lol", + "message": "ovs|84535|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228480327229", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler327)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480327347", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler327)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228480327378", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480327412", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480327440", + "member": "lab01.glab.lol", + "message": " my_disc:0xe975fdaf your_disc:0x8fe124e2" + }, + { + "at": "1789228480327458", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480327475", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480327497", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480327512", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480327530", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480327547", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480327561", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480327577", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758327ms" + }, + { + "at": "1789228480327599", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +90ms" + }, + { + "at": "1789228480327614", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -740ms" + }, + { + "at": "1789228480327647", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480327659", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480327672", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480327682", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480327700", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480327714", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480327731", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480327741", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480327764", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480327838", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480327857", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480327868", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480327889", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480327899", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler327)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480327916", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480327931", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480327942", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480327952", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480327962", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480327981", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480327996", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +90ms" + }, + { + "at": "1789228480328013", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -740ms" + }, + { + "at": "1789228480328022", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480328038", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480328049", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480328067", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480328079", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480328098", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480328114", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480328123", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480328133", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480328144", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480328158", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480328169", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480328184", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480403421", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler327)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480403541", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler327)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228480403572", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480403585", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480403608", + "member": "lab01.glab.lol", + "message": " my_disc:0x9b9bc62f your_disc:0x6bc64e34" + }, + { + "at": "1789228480403624", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480403636", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480403646", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480403658", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480403674", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480403685", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480403705", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480403725", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758403ms" + }, + { + "at": "1789228480403748", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -136ms" + }, + { + "at": "1789228480403768", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -916ms" + }, + { + "at": "1789228480403788", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480403798", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480403809", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480403826", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480403838", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480403851", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480403861", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480403878", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480403889", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480403904", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480403926", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480403944", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480403959", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480403974", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler327)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480403991", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480404003", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480404021", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480404031", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480404048", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480404065", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480404075", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -136ms" + }, + { + "at": "1789228480404087", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -916ms" + }, + { + "at": "1789228480404096", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480404113", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480404126", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480404140", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480404159", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480404170", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480404180", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480404191", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480404208", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480404217", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480404232", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480404244", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480404261", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480474245", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler327)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480474355", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler327)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228480474376", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480474392", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480474415", + "member": "lab01.glab.lol", + "message": " my_disc:0x45468bf5 your_disc:0xf1d4b82" + }, + { + "at": "1789228480474433", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480474448", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480474457", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480474478", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480474500", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480474512", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480474523", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480474538", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758474ms" + }, + { + "at": "1789228480474560", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +713ms" + }, + { + "at": "1789228480474591", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -147ms" + }, + { + "at": "1789228480474615", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480474636", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480474647", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474659", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228480474676", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480474691", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480474703", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480474717", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480474730", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474743", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x45468bf5" + }, + { + "at": "1789228480474762", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480474773", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480474792", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480474807", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler327)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480474829", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480474843", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480474853", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480474863", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480474872", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480474884", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480474893", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +713ms" + }, + { + "at": "1789228480474911", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -147ms" + }, + { + "at": "1789228480474923", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480474933", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480474952", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474962", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228480474981", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480474991", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480475006", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480475015", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480475024", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480475034", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x45468bf5" + }, + { + "at": "1789228480475050", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480475061", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480475072", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480580957", + "member": "lab01.glab.lol", + "message": "ovs|84536|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228480581107", + "member": "lab01.glab.lol", + "message": "ovs|84537|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228480782390", + "member": "lab01.glab.lol", + "message": "ovs|84538|bridge|INFO|bridge br-int: added interface veth4711b759 on port 38" + }, + { + "at": "1789228481580858", + "member": "lab01.glab.lol", + "message": "ovs|84539|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228481580995", + "member": "lab01.glab.lol", + "message": "ovs|84540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228482580818", + "member": "lab01.glab.lol", + "message": "ovs|84541|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228482580919", + "member": "lab01.glab.lol", + "message": "ovs|84542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228483316767", + "member": "lab01.glab.lol", + "message": "ovs|84543|poll_loop|INFO|Dropped 2526 log messages in last 313 seconds (most recently, 310 seconds ago) due to excessive rate" + }, + { + "at": "1789228483317034", + "member": "lab01.glab.lol", + "message": "ovs|84544|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483317290", + "member": "lab01.glab.lol", + "message": "ovs|84545|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483317798", + "member": "lab01.glab.lol", + "message": "ovs|84546|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483318477", + "member": "lab01.glab.lol", + "message": "ovs|84547|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483318772", + "member": "lab01.glab.lol", + "message": "ovs|84548|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483319274", + "member": "lab01.glab.lol", + "message": "ovs|84549|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483319853", + "member": "lab01.glab.lol", + "message": "ovs|84550|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483320368", + "member": "lab01.glab.lol", + "message": "ovs|84551|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483320882", + "member": "lab01.glab.lol", + "message": "ovs|84552|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483321398", + "member": "lab01.glab.lol", + "message": "ovs|84553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483580552", + "member": "lab01.glab.lol", + "message": "ovs|84554|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228483580617", + "member": "lab01.glab.lol", + "message": "ovs|84555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228484580669", + "member": "lab01.glab.lol", + "message": "ovs|84556|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228484580860", + "member": "lab01.glab.lol", + "message": "ovs|84557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228485580915", + "member": "lab01.glab.lol", + "message": "ovs|84558|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228485581160", + "member": "lab01.glab.lol", + "message": "ovs|84559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228486581159", + "member": "lab01.glab.lol", + "message": "ovs|84560|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228486581417", + "member": "lab01.glab.lol", + "message": "ovs|84561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228487580730", + "member": "lab01.glab.lol", + "message": "ovs|84562|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228487580823", + "member": "lab01.glab.lol", + "message": "ovs|84563|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228488580936", + "member": "lab01.glab.lol", + "message": "ovs|84564|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228488581132", + "member": "lab01.glab.lol", + "message": "ovs|84565|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228489316770", + "member": "lab01.glab.lol", + "message": "ovs|84566|poll_loop|INFO|Dropped 12178 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228489316895", + "member": "lab01.glab.lol", + "message": "ovs|84567|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228489488874", + "member": "lab01.glab.lol", + "message": "ovs|84568|connmgr|INFO|br-int<->unix#7: 911 flow_mods in the 6 s starting 10 s ago (845 adds, 58 deletes, 8 modifications)" + }, + { + "at": "1789228489581052", + "member": "lab01.glab.lol", + "message": "ovs|84569|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228489581223", + "member": "lab01.glab.lol", + "message": "ovs|84570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228490580965", + "member": "lab01.glab.lol", + "message": "ovs|84571|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228490581071", + "member": "lab01.glab.lol", + "message": "ovs|84572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228491580787", + "member": "lab01.glab.lol", + "message": "ovs|84573|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228491580926", + "member": "lab01.glab.lol", + "message": "ovs|84574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228492580903", + "member": "lab01.glab.lol", + "message": "ovs|84575|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228492581165", + "member": "lab01.glab.lol", + "message": "ovs|84576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228493580892", + "member": "lab01.glab.lol", + "message": "ovs|84577|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228493581040", + "member": "lab01.glab.lol", + "message": "ovs|84578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228494580810", + "member": "lab01.glab.lol", + "message": "ovs|84579|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228494580951", + "member": "lab01.glab.lol", + "message": "ovs|84580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228495316892", + "member": "lab01.glab.lol", + "message": "ovs|84581|poll_loop|INFO|Dropped 12420 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228495317132", + "member": "lab01.glab.lol", + "message": "ovs|84582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228495580847", + "member": "lab01.glab.lol", + "message": "ovs|84583|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228495580949", + "member": "lab01.glab.lol", + "message": "ovs|84584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228496581037", + "member": "lab01.glab.lol", + "message": "ovs|84585|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228496581261", + "member": "lab01.glab.lol", + "message": "ovs|84586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228497580977", + "member": "lab01.glab.lol", + "message": "ovs|84587|dpif|WARN|Dropped 1989 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228497581118", + "member": "lab01.glab.lol", + "message": "ovs|84588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228498581013", + "member": "lab01.glab.lol", + "message": "ovs|84589|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228498581149", + "member": "lab01.glab.lol", + "message": "ovs|84590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228499580774", + "member": "lab01.glab.lol", + "message": "ovs|84591|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228499580921", + "member": "lab01.glab.lol", + "message": "ovs|84592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228500580849", + "member": "lab01.glab.lol", + "message": "ovs|84593|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228500581063", + "member": "lab01.glab.lol", + "message": "ovs|84594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228501316812", + "member": "lab01.glab.lol", + "message": "ovs|84595|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228501316949", + "member": "lab01.glab.lol", + "message": "ovs|84596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228501581171", + "member": "lab01.glab.lol", + "message": "ovs|84597|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228501581346", + "member": "lab01.glab.lol", + "message": "ovs|84598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228502580732", + "member": "lab01.glab.lol", + "message": "ovs|84599|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228502608575", + "member": "lab01.glab.lol", + "message": "ovs|84600|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228503580703", + "member": "lab01.glab.lol", + "message": "ovs|84601|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228503580851", + "member": "lab01.glab.lol", + "message": "ovs|84602|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228504581109", + "member": "lab01.glab.lol", + "message": "ovs|84603|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228504581455", + "member": "lab01.glab.lol", + "message": "ovs|84604|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228505580957", + "member": "lab01.glab.lol", + "message": "ovs|84605|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228505581107", + "member": "lab01.glab.lol", + "message": "ovs|84606|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228506580801", + "member": "lab01.glab.lol", + "message": "ovs|84607|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228506581004", + "member": "lab01.glab.lol", + "message": "ovs|84608|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228507317107", + "member": "lab01.glab.lol", + "message": "ovs|84609|poll_loop|INFO|Dropped 12249 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228507317238", + "member": "lab01.glab.lol", + "message": "ovs|84610|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228507580972", + "member": "lab01.glab.lol", + "message": "ovs|84611|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228507581182", + "member": "lab01.glab.lol", + "message": "ovs|84612|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228508581077", + "member": "lab01.glab.lol", + "message": "ovs|84613|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228508581320", + "member": "lab01.glab.lol", + "message": "ovs|84614|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228509580584", + "member": "lab01.glab.lol", + "message": "ovs|84615|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228509580802", + "member": "lab01.glab.lol", + "message": "ovs|84616|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228510580847", + "member": "lab01.glab.lol", + "message": "ovs|84617|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228510581094", + "member": "lab01.glab.lol", + "message": "ovs|84618|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228511581014", + "member": "lab01.glab.lol", + "message": "ovs|84619|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228511581249", + "member": "lab01.glab.lol", + "message": "ovs|84620|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228512580997", + "member": "lab01.glab.lol", + "message": "ovs|84621|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228512581108", + "member": "lab01.glab.lol", + "message": "ovs|84622|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228513316982", + "member": "lab01.glab.lol", + "message": "ovs|84623|poll_loop|INFO|Dropped 12233 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228513317141", + "member": "lab01.glab.lol", + "message": "ovs|84624|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228513580746", + "member": "lab01.glab.lol", + "message": "ovs|84625|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228513580805", + "member": "lab01.glab.lol", + "message": "ovs|84626|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228514580992", + "member": "lab01.glab.lol", + "message": "ovs|84627|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228514581249", + "member": "lab01.glab.lol", + "message": "ovs|84628|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228515580631", + "member": "lab01.glab.lol", + "message": "ovs|84629|dpif|WARN|Dropped 2104 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228515580773", + "member": "lab01.glab.lol", + "message": "ovs|84630|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228516580917", + "member": "lab01.glab.lol", + "message": "ovs|84631|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228516581123", + "member": "lab01.glab.lol", + "message": "ovs|84632|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228517580978", + "member": "lab01.glab.lol", + "message": "ovs|84633|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228517581216", + "member": "lab01.glab.lol", + "message": "ovs|84634|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228518580786", + "member": "lab01.glab.lol", + "message": "ovs|84635|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228518580904", + "member": "lab01.glab.lol", + "message": "ovs|84636|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228519316796", + "member": "lab01.glab.lol", + "message": "ovs|84637|poll_loop|INFO|Dropped 12367 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228519317027", + "member": "lab01.glab.lol", + "message": "ovs|84638|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228519580709", + "member": "lab01.glab.lol", + "message": "ovs|84639|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228519580779", + "member": "lab01.glab.lol", + "message": "ovs|84640|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228520580597", + "member": "lab01.glab.lol", + "message": "ovs|84641|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228520580836", + "member": "lab01.glab.lol", + "message": "ovs|84642|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228521580730", + "member": "lab01.glab.lol", + "message": "ovs|84643|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228521580973", + "member": "lab01.glab.lol", + "message": "ovs|84644|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228522580887", + "member": "lab01.glab.lol", + "message": "ovs|84645|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228522581093", + "member": "lab01.glab.lol", + "message": "ovs|84646|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228523580573", + "member": "lab01.glab.lol", + "message": "ovs|84647|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228523580669", + "member": "lab01.glab.lol", + "message": "ovs|84648|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228524580898", + "member": "lab01.glab.lol", + "message": "ovs|84649|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228524581131", + "member": "lab01.glab.lol", + "message": "ovs|84650|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228525316757", + "member": "lab01.glab.lol", + "message": "ovs|84651|poll_loop|INFO|Dropped 12482 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228525316919", + "member": "lab01.glab.lol", + "message": "ovs|84652|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228525580739", + "member": "lab01.glab.lol", + "message": "ovs|84653|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228525580821", + "member": "lab01.glab.lol", + "message": "ovs|84654|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228526580988", + "member": "lab01.glab.lol", + "message": "ovs|84655|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228526581243", + "member": "lab01.glab.lol", + "message": "ovs|84656|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228527580971", + "member": "lab01.glab.lol", + "message": "ovs|84657|dpif|WARN|Dropped 2105 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228527581076", + "member": "lab01.glab.lol", + "message": "ovs|84658|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228528581119", + "member": "lab01.glab.lol", + "message": "ovs|84659|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228528581356", + "member": "lab01.glab.lol", + "message": "ovs|84660|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228529580979", + "member": "lab01.glab.lol", + "message": "ovs|84661|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228529581077", + "member": "lab01.glab.lol", + "message": "ovs|84662|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228530581094", + "member": "lab01.glab.lol", + "message": "ovs|84663|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228530581362", + "member": "lab01.glab.lol", + "message": "ovs|84664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228531316980", + "member": "lab01.glab.lol", + "message": "ovs|84665|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228531317093", + "member": "lab01.glab.lol", + "message": "ovs|84666|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789228531581110", + "member": "lab01.glab.lol", + "message": "ovs|84667|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228531581280", + "member": "lab01.glab.lol", + "message": "ovs|84668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228532580841", + "member": "lab01.glab.lol", + "message": "ovs|84669|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228532580969", + "member": "lab01.glab.lol", + "message": "ovs|84670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228533085629", + "member": "lab01.glab.lol", + "message": "ovs|84671|bridge|INFO|bridge br-int: deleted interface veth4711b759 on port 38" + }, + { + "at": "1789228533580803", + "member": "lab01.glab.lol", + "message": "ovs|84672|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228533580895", + "member": "lab01.glab.lol", + "message": "ovs|84673|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228534580716", + "member": "lab01.glab.lol", + "message": "ovs|84674|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228534580906", + "member": "lab01.glab.lol", + "message": "ovs|84675|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228535390191", + "member": "lab01.glab.lol", + "message": "ovs|84676|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228535390246", + "member": "lab01.glab.lol", + "message": "ovs|84677|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228535409940", + "member": "lab01.glab.lol", + "message": "ovs|84678|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228535410120", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479472013", + "member": "lab02.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479472164", + "member": "lab02.glab.lol", + "message": "ovs|00247|bridge|INFO|bridge incusovn16: using datapath ID 0000b2f8733c5b4e" + }, + { + "at": "1789228479472179", + "member": "lab02.glab.lol", + "message": "ovs|00248|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479474127", + "member": "lab02.glab.lol", + "message": "ovs|00249|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474189", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474209", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474222", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474231", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474243", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474254", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474271", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474282", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474299", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474312", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474324", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474335", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479474347", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474368", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474380", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474391", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474408", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474420", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474431", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474442", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474453", + "member": "lab02.glab.lol", + "message": "ovs|00250|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474467", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474477", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474486", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474497", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474510", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474519", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474529", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474538", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474548", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474559", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474570", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474579", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479474590", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474602", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474614", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474624", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474635", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474644", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474653", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474663", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474673", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474683", + "member": "lab02.glab.lol", + "message": "ovs|00251|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474709", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474718", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474728", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474744", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474755", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474765", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474776", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474787", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474796", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474811", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474821", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479474833", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474844", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474853", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474868", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474877", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474886", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474897", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474907", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474917", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474926", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479570181", + "member": "lab02.glab.lol", + "message": "ovs|00252|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479570275", + "member": "lab02.glab.lol", + "message": "ovs|00253|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228479570389", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler328)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479570610", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler328)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228479570644", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228479570673", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479570696", + "member": "lab02.glab.lol", + "message": " my_disc:0x24fed059 your_disc:0x8ec6ef2f" + }, + { + "at": "1789228479570720", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479570742", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479570765", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479570786", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479570808", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479571070", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479571124", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479571151", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734570ms" + }, + { + "at": "1789228479571176", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789228479571205", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789228479571228", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479571250", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479571273", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571321", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479571345", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479571366", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571391", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479571420", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228479571449", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571471", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x24fed059" + }, + { + "at": "1789228479571495", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479571524", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571545", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479571566", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler328)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479571595", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479571617", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479571641", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479571662", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479571682", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479571712", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479571737", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789228479571758", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789228479571779", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479571800", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479571821", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571841", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479571862", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479571885", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571907", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479571928", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228479571949", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571969", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x24fed059" + }, + { + "at": "1789228479571988", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479572015", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479572034", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479572480", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler328)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479572510", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler328)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228479572535", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479572562", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479572584", + "member": "lab02.glab.lol", + "message": " my_disc:0xfe8ea320 your_disc:0x0" + }, + { + "at": "1789228479572609", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479572628", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479572649", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479572674", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479572697", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479572717", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479572736", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479572756", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734572ms" + }, + { + "at": "1789228479572777", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +691ms" + }, + { + "at": "1789228479572799", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789228479572824", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479572845", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479572866", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479572887", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479572911", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479572932", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479572953", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479572973", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479572996", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573017", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479573038", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479573058", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573077", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479573095", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479573114", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479573132", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479573153", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479573175", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479573196", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479573216", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479573237", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +691ms" + }, + { + "at": "1789228479573257", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789228479573276", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479573296", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479573317", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573337", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479573360", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479573380", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573405", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479573427", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479573447", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573469", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479573490", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479573510", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573531", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479575013", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler328)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479575076", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler328)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479575104", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479575127", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479575148", + "member": "lab02.glab.lol", + "message": " my_disc:0x8fe124e2 your_disc:0x0" + }, + { + "at": "1789228479575171", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479575192", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479575215", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479575236", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479575261", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479575282", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479575301", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479575319", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734574ms" + }, + { + "at": "1789228479575341", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228479575364", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228479575390", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479575420", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479575441", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575466", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479575487", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479575507", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479575528", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479575546", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479575609", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575632", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479575654", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479575675", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479575695", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479575716", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479575739", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479575758", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479575776", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479575796", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479575823", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479575844", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479575864", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228479575887", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228479575907", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479575928", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479575948", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575969", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479575988", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479576006", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479576027", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479576047", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479576068", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479576091", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479576110", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479576130", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479576156", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479577332", + "member": "lab02.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479577420", + "member": "lab02.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789228480404701", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480404846", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480404878", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480404901", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480404924", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480404949", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480404975", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480405000", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +760ms" + }, + { + "at": "1789228480405035", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -90ms" + }, + { + "at": "1789228480405059", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480405079", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480405106", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480405129", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480405151", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480405174", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480405197", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480405219", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480405246", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480405271", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480405296", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480405315", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480405335", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480442870", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480442960", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480442985", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480443005", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480443030", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480443052", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480443072", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480443093", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +741ms" + }, + { + "at": "1789228480443116", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -179ms" + }, + { + "at": "1789228480443139", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480443161", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480443185", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480443205", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228480443231", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480443251", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480443270", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480443293", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480443315", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480443337", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480443356", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480443377", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480443408", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228489476199", + "member": "lab02.glab.lol", + "message": "ovs|00256|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (812 adds, 56 deletes, 7 modifications)" + }, + { + "at": "1789228535381614", + "member": "lab02.glab.lol", + "message": "ovs|00257|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228535381949", + "member": "lab02.glab.lol", + "message": "ovs|00258|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228535382297", + "member": "lab02.glab.lol", + "message": "ovs|00259|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228535397981", + "member": "lab02.glab.lol", + "message": "ovs|00260|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789228535398032", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479468990", + "member": "lab03.glab.lol", + "message": "ovs|00272|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479469117", + "member": "lab03.glab.lol", + "message": "ovs|00273|bridge|INFO|bridge incusovn16: using datapath ID 0000de68b8cf5447" + }, + { + "at": "1789228479469132", + "member": "lab03.glab.lol", + "message": "ovs|00274|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479470916", + "member": "lab03.glab.lol", + "message": "ovs|00275|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479470975", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479470995", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479471010", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479471023", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479471034", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479471053", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634468ms" + }, + { + "at": "1789228479471068", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634468ms" + }, + { + "at": "1789228479471083", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634468ms" + }, + { + "at": "1789228479471096", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479471112", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479471123", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471136", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228479471148", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479471158", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471172", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479471185", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479471198", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471208", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479471223", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479471237", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471248", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479471261", + "member": "lab03.glab.lol", + "message": "ovs|00276|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479471274", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479471288", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479471300", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479471311", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479471320", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479471331", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634468ms" + }, + { + "at": "1789228479471342", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634468ms" + }, + { + "at": "1789228479471354", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634468ms" + }, + { + "at": "1789228479471363", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479471375", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479471388", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471399", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479471414", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479471425", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471436", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479471447", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479471458", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471468", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479471481", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479471492", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471502", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479471513", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479473763", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler324)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479473807", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler324)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479473825", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479473845", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479473860", + "member": "lab03.glab.lol", + "message": " my_disc:0xf1d4b82 your_disc:0x0" + }, + { + "at": "1789228479473875", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479473888", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479473899", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479473911", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479473921", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479473931", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479473943", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479473959", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634471ms" + }, + { + "at": "1789228479473974", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +987ms" + }, + { + "at": "1789228479473986", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479473999", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474009", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479474023", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474034", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479474046", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474055", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474072", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474083", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479474097", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474109", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479474121", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474131", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474143", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479474155", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474170", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474182", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474192", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474207", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474218", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479474228", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479474243", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +987ms" + }, + { + "at": "1789228479474255", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479474265", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474275", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479474287", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474298", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479474309", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474321", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474330", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474342", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479474353", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474364", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479474373", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474391", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474404", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478589", + "member": "lab03.glab.lol", + "message": "ovs|00277|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478631", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478645", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478656", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478667", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478677", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479478690", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634476ms" + }, + { + "at": "1789228479478706", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634476ms" + }, + { + "at": "1789228479478723", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634476ms" + }, + { + "at": "1789228479478733", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478746", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479478757", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478767", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479478778", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478788", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478798", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478807", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479478818", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478829", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479478840", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479478849", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478859", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479567283", + "member": "lab03.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479567423", + "member": "lab03.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228479575196", + "member": "lab03.glab.lol", + "message": "ovs|00280|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479575289", + "member": "lab03.glab.lol", + "message": "ovs|00281|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228480263720", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler324)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480263821", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler324)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228480263855", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480263888", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480263912", + "member": "lab03.glab.lol", + "message": " my_disc:0xc6336142 your_disc:0xfe8ea320" + }, + { + "at": "1789228480263939", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480263964", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480263989", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480264015", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480264039", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480264072", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480264102", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480264134", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50635261ms" + }, + { + "at": "1789228480264160", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228480264186", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -692ms" + }, + { + "at": "1789228480264210", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480264237", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480264261", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264283", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480264308", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480264331", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264354", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480264376", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480264403", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264427", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc6336142" + }, + { + "at": "1789228480264451", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480264472", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264492", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480264515", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler324)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480264540", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480264562", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480264585", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480264663", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480264686", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480264708", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480264736", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228480264758", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -692ms" + }, + { + "at": "1789228480264779", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480264801", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480264824", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264892", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480264914", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480264934", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264958", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480264981", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480265003", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480265026", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc6336142" + }, + { + "at": "1789228480265047", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480265080", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480265101", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480469217", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler324)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480469493", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler324)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228480469532", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480469561", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480469586", + "member": "lab03.glab.lol", + "message": " my_disc:0x126453c1 your_disc:0x894972dc" + }, + { + "at": "1789228480469615", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480469639", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480469663", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480469692", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480469722", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480469747", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480469777", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480469800", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50635467ms" + }, + { + "at": "1789228480469825", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +841ms" + }, + { + "at": "1789228480469851", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -159ms" + }, + { + "at": "1789228480469882", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480469907", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480469931", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480469953", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228480469978", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470003", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470027", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480470052", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480470096", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470317", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x126453c1" + }, + { + "at": "1789228480470347", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480470373", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470395", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480470425", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler324)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480470458", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480470483", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480470510", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480470532", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480470556", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480470582", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480470606", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +841ms" + }, + { + "at": "1789228480470628", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -159ms" + }, + { + "at": "1789228480470655", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480470679", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480470704", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470728", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228480470750", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470776", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470799", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480470820", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480470844", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470869", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x126453c1" + }, + { + "at": "1789228480470893", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470917", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470942", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481173387", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228481173475", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228481173491", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228481173506", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228481173518", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228481173530", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228481173540", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228481173551", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +117ms" + }, + { + "at": "1789228481173563", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -713ms" + }, + { + "at": "1789228481173575", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228481173586", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228481173602", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228481173612", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228481173622", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228481173634", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481173647", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228481173657", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228481173666", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228481173678", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228481173689", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228481173706", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481173718", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481573327", + "member": "lab03.glab.lol", + "message": "ovs|00282|bridge|INFO|bridge br-int: added interface veth0f727b81 on port 36" + }, + { + "at": "1789228489473008", + "member": "lab03.glab.lol", + "message": "ovs|00283|connmgr|INFO|br-int<->unix#7: 928 flow_mods in the 6 s starting 10 s ago (844 adds, 76 deletes, 8 modifications)" + }, + { + "at": "1789228534060745", + "member": "lab03.glab.lol", + "message": "ovs|00284|bridge|INFO|bridge br-int: deleted interface veth0f727b81 on port 36" + }, + { + "at": "1789228535381056", + "member": "lab03.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228535381368", + "member": "lab03.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228535381596", + "member": "lab03.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228535403359", + "member": "lab03.glab.lol", + "message": "ovs|00288|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228535403582", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479280841", + "member": "nas01.glab.lol", + "message": "ovs|00250|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479281159", + "member": "nas01.glab.lol", + "message": "ovs|00251|bridge|INFO|bridge incusovn16: using datapath ID 0000120a87fe924e" + }, + { + "at": "1789228479281182", + "member": "nas01.glab.lol", + "message": "ovs|00252|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479378655", + "member": "nas01.glab.lol", + "message": "ovs|00253|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479378758", + "member": "nas01.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228479384238", + "member": "nas01.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479384295", + "member": "nas01.glab.lol", + "message": "ovs|00256|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789228479474399", + "member": "nas01.glab.lol", + "message": "ovs|00257|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474441", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474460", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474479", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474495", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474512", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474532", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861338ms" + }, + { + "at": "1789228479474545", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861338ms" + }, + { + "at": "1789228479474556", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861338ms" + }, + { + "at": "1789228479474566", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474577", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474588", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474603", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479474614", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474631", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474644", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474660", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474675", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474692", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474711", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474726", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474738", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474752", + "member": "nas01.glab.lol", + "message": "ovs|00258|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474773", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474787", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474803", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474815", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474825", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474835", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861338ms" + }, + { + "at": "1789228479474845", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861338ms" + }, + { + "at": "1789228479474856", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861338ms" + }, + { + "at": "1789228479474865", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474875", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474884", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474893", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479474905", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474919", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474929", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474939", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474949", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474958", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474968", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474978", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474989", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474998", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479477553", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler337)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479477697", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler337)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228479477721", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479477749", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479477768", + "member": "nas01.glab.lol", + "message": " my_disc:0x894972dc your_disc:0x0" + }, + { + "at": "1789228479477785", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479477806", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479477822", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479477837", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479477852", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479477866", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479477886", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479477912", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861341ms" + }, + { + "at": "1789228479477934", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +997ms" + }, + { + "at": "1789228479477951", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479477972", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479477985", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479478004", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478019", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479478034", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478049", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478065", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478079", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479478097", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478112", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228479478132", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479478186", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478203", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478222", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478239", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478255", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478270", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478284", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478298", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479478311", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479478333", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +997ms" + }, + { + "at": "1789228479478347", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479478363", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478377", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479478392", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478406", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479478421", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478436", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478451", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478465", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479478480", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478494", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228479478509", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478527", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478542", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478790", + "member": "nas01.glab.lol", + "message": "ovs|00259|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478809", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478819", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478829", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478837", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478848", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479478860", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861342ms" + }, + { + "at": "1789228479478873", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861342ms" + }, + { + "at": "1789228479478884", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861342ms" + }, + { + "at": "1789228479478896", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478907", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479478921", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478933", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479478945", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478962", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478975", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478988", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479478999", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479479010", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479479022", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479479031", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479479040", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479480002", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler337)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479480053", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler337)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228479480068", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479480079", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479480094", + "member": "nas01.glab.lol", + "message": " my_disc:0x8ec6ef2f your_disc:0x0" + }, + { + "at": "1789228479480104", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479480114", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479480124", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479480135", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480144", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480155", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480163", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480178", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861344ms" + }, + { + "at": "1789228479480190", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861344ms" + }, + { + "at": "1789228479480201", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861344ms" + }, + { + "at": "1789228479480211", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480221", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480231", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480242", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479480252", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480261", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480271", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480280", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480290", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480299", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479480310", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479480318", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480329", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480339", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479480355", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479480364", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480374", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480383", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480392", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480401", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479480411", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861344ms" + }, + { + "at": "1789228479480421", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861344ms" + }, + { + "at": "1789228479480431", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480440", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480449", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480458", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479480468", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480479", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480490", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480499", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480509", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480518", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479480527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480547", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480566", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler337)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479480577", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler337)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479480588", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479480598", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479480608", + "member": "nas01.glab.lol", + "message": " my_disc:0x6bc64e34 your_disc:0x0" + }, + { + "at": "1789228479480618", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479480627", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479480637", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479480647", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480656", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480666", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480681", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480690", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861344ms" + }, + { + "at": "1789228479480700", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +915ms" + }, + { + "at": "1789228479480711", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228479480730", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480740", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480749", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480759", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479480768", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480778", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480786", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480796", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480805", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480813", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479480824", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479480833", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480842", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480852", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479480867", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479480876", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480886", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480894", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480905", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480920", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479480934", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +915ms" + }, + { + "at": "1789228479480944", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228479480954", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480963", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480972", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480982", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479480991", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479481001", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479481011", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479481019", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479481029", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479481039", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479481052", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479481061", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479481070", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480291060", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480291346", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480291370", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480291385", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480291394", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480291407", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480291417", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480291428", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +84ms" + }, + { + "at": "1789228480291439", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789228480291453", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480291473", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480291499", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480291510", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228480291523", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480291533", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480291546", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480291557", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480291568", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480291578", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228480291590", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480291601", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480291611", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480410199", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480410414", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480410443", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480410463", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480410479", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480410498", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480410515", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480410533", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +985ms" + }, + { + "at": "1789228480410551", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -15ms" + }, + { + "at": "1789228480410570", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480410588", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480410606", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480410623", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480410641", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480410666", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480410692", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480410714", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480410732", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480410749", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480410767", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480410783", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480410799", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481317295", + "member": "nas01.glab.lol", + "message": "ovs|00012|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228481317728", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228481317780", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228481317824", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228481317859", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228481317904", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228481317980", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228481318038", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +58ms" + }, + { + "at": "1789228481318072", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -842ms" + }, + { + "at": "1789228481318102", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228481318131", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228481318161", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228481318189", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228481318217", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228481318237", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481318257", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228481318276", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228481318296", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228481318314", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228481318332", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228481318351", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481318371", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228489286016", + "member": "nas01.glab.lol", + "message": "ovs|00260|connmgr|INFO|br-int<->unix#7: 969 flow_mods in the 6 s starting 10 s ago (862 adds, 106 deletes, 1 modifications)" + }, + { + "at": "1789228535389567", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor353)|INFO|monitor thread terminated" + }, + { + "at": "1789228535390481", + "member": "nas01.glab.lol", + "message": "ovs|00261|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789228535390527", + "member": "nas01.glab.lol", + "message": "ovs|00262|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228535390553", + "member": "nas01.glab.lol", + "message": "ovs|00263|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789228535419894", + "member": "nas01.glab.lol", + "message": "ovs|00264|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-before-probe.txt new file mode 100644 index 0000000..8699f12 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/diagnostics-before-probe.txt @@ -0,0 +1,5513 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:42:ab:f9 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:7e:16:81 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch fd4b631c-81c0-4c8e-9e92-dc7cf9a33c9d (incus-net37-ls-ext) + port incus-net37-ls-ext-lsp-router + type: router + router-port: incus-net37-lr-lrp-ext + port incus-net37-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 684fbd9a-01fc-43aa-a171-d322d63e6887 (incus-net37-ls-int) + port incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0 + addresses: ["10:66:6a:7e:16:81 dynamic"] + port incus-net37-ls-int-lsp-router + type: router + router-port: incus-net37-lr-lrp-int + port incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0 + addresses: ["10:66:6a:42:ab:f9 dynamic"] +router acd84fae-7dea-4d77-b555-dae888322639 (incus-net37-lr) + port incus-net37-lr-lrp-ext + mac: "10:66:6a:b2:7a:65" + ipv6-lla: "fe80::1266:6aff:feb2:7a65" + networks: ["10.10.40.64/24"] + port incus-net37-lr-lrp-int + mac: "10:66:6a:b2:7a:65" + ipv6-lla: "fe80::1266:6aff:feb2:7a65" + networks: ["10.253.73.1/24"] + nat a10b55e2-fd03-497a-b507-27de4d11b529 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net37-instance-1865c9ca-a151-476a-9d41-61a7e0c2e2ba-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net37-lr-lrp-ext + Port_Binding incus-net37-instance-1d65075f-bf3c-44b1-bcd2-e0990753a8f8-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : d629ff1d-a504-49fe-a7c8-f0323ee49c93 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : de608431-0186-4362-86d7-cac077dd05e7 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:b2:7a:65" +name : incus-net37-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : e04baf95-5323-4806-8837-59c9e0fbc892 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:b2:7a:65" +name : incus-net37-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 70a417e5-7e57-4de0-8d05-1cd489841205 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 62a237be-632c-48ed-8a7b-8844743cd71b +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : ce09c18b-41bd-4255-a48e-d5595868baa0 +logical_port : cr-incus-net37-lr-lrp-ext +mac : ["10:66:6a:b2:7a:65 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net37-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : de608431-0186-4362-86d7-cac077dd05e7 +external_ids : {} +ha_chassis : [093d581f-a240-48d1-8523-23f1f4332ef2, 6bae3c80-717c-4b0f-82a0-035c6921b222, aeacbaee-6168-4a6d-ba97-359ec9f0230c, e68ec4f2-be40-49bb-9a54-454bc30f38e8] +name : incus-net37 +=== ovn-nbctl list HA_Chassis === +_uuid : 6bae3c80-717c-4b0f-82a0-035c6921b222 +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 30102 + +_uuid : e68ec4f2-be40-49bb-9a54-454bc30f38e8 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 31425 + +_uuid : aeacbaee-6168-4a6d-ba97-359ec9f0230c +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 5868 + +_uuid : 093d581f-a240-48d1-8523-23f1f4332ef2 +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 6746 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:ef:03:ee STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:ef:03:ee PROBE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479484425", + "member": "lab01.glab.lol", + "message": "ovs|84516|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479484766", + "member": "lab01.glab.lol", + "message": "ovs|84517|bridge|INFO|bridge incusovn16: using datapath ID 0000fecb28f30f44" + }, + { + "at": "1789228479484807", + "member": "lab01.glab.lol", + "message": "ovs|84518|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479486903", + "member": "lab01.glab.lol", + "message": "ovs|84519|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479486961", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479486992", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479487020", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479487041", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479487068", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479487089", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757487ms" + }, + { + "at": "1789228479487104", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757487ms" + }, + { + "at": "1789228479487126", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757487ms" + }, + { + "at": "1789228479487152", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479487177", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479487195", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487218", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479487239", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479487251", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487275", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479487293", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479487311", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487333", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479487354", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479487372", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487391", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479487413", + "member": "lab01.glab.lol", + "message": "ovs|84520|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479487444", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479487461", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479487488", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479487504", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479487520", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479487545", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757487ms" + }, + { + "at": "1789228479487560", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757487ms" + }, + { + "at": "1789228479487582", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757487ms" + }, + { + "at": "1789228479487605", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479487617", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479487632", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487647", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479487668", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479487682", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487698", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479487713", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479487729", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479487741", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479487755", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479487770", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479487783", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479487796", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479494185", + "member": "lab01.glab.lol", + "message": "ovs|84521|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479494228", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479494250", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479494269", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479494282", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479494299", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479494312", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542757494ms" + }, + { + "at": "1789228479494333", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1542757494ms" + }, + { + "at": "1789228479494349", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1542757494ms" + }, + { + "at": "1789228479494371", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479494388", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479494400", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479494422", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479494442", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479494470", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479494483", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479494498", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479494521", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479494542", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479494561", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479494573", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479494587", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479581012", + "member": "lab01.glab.lol", + "message": "ovs|84522|dpif|WARN|Dropped 1500 log messages in last 308 seconds (most recently, 308 seconds ago) due to excessive rate" + }, + { + "at": "1789228479581112", + "member": "lab01.glab.lol", + "message": "ovs|84523|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479581149", + "member": "lab01.glab.lol", + "message": "ovs|84524|bridge|WARN|Dropped 56686 log messages in last 335 seconds (most recently, 308 seconds ago) due to excessive rate" + }, + { + "at": "1789228479581190", + "member": "lab01.glab.lol", + "message": "ovs|84525|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479581341", + "member": "lab01.glab.lol", + "message": "ovs|84526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479581371", + "member": "lab01.glab.lol", + "message": "ovs|84527|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479582706", + "member": "lab01.glab.lol", + "message": "ovs|84528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479582786", + "member": "lab01.glab.lol", + "message": "ovs|84529|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479583949", + "member": "lab01.glab.lol", + "message": "ovs|84530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479584037", + "member": "lab01.glab.lol", + "message": "ovs|84531|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479585060", + "member": "lab01.glab.lol", + "message": "ovs|84532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228479585181", + "member": "lab01.glab.lol", + "message": "ovs|84533|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228479588143", + "member": "lab01.glab.lol", + "message": "ovs|84534|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789228479588235", + "member": "lab01.glab.lol", + "message": "ovs|84535|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 37" + }, + { + "at": "1789228480327229", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler327)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480327347", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler327)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228480327378", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480327412", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480327440", + "member": "lab01.glab.lol", + "message": " my_disc:0xe975fdaf your_disc:0x8fe124e2" + }, + { + "at": "1789228480327458", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480327475", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480327497", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480327512", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480327530", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480327547", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480327561", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480327577", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758327ms" + }, + { + "at": "1789228480327599", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +90ms" + }, + { + "at": "1789228480327614", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -740ms" + }, + { + "at": "1789228480327647", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480327659", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480327672", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480327682", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480327700", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480327714", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480327731", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480327741", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480327764", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480327838", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480327857", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480327868", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480327889", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480327899", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler327)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480327916", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480327931", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480327942", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480327952", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480327962", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480327981", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480327996", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +90ms" + }, + { + "at": "1789228480328013", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -740ms" + }, + { + "at": "1789228480328022", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480328038", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480328049", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480328067", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480328079", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480328098", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480328114", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480328123", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480328133", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480328144", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480328158", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480328169", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480328184", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480403421", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler327)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480403541", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler327)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228480403572", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480403585", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480403608", + "member": "lab01.glab.lol", + "message": " my_disc:0x9b9bc62f your_disc:0x6bc64e34" + }, + { + "at": "1789228480403624", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480403636", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480403646", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480403658", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480403674", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480403685", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480403705", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480403725", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758403ms" + }, + { + "at": "1789228480403748", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -136ms" + }, + { + "at": "1789228480403768", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -916ms" + }, + { + "at": "1789228480403788", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480403798", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480403809", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480403826", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480403838", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480403851", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480403861", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480403878", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480403889", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480403904", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480403926", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480403944", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480403959", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480403974", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler327)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480403991", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480404003", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480404021", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480404031", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480404048", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480404065", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480404075", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -136ms" + }, + { + "at": "1789228480404087", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -916ms" + }, + { + "at": "1789228480404096", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480404113", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480404126", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480404140", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480404159", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480404170", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480404180", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480404191", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480404208", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480404217", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480404232", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480404244", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480404261", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480474245", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler327)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480474355", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler327)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228480474376", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480474392", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480474415", + "member": "lab01.glab.lol", + "message": " my_disc:0x45468bf5 your_disc:0xf1d4b82" + }, + { + "at": "1789228480474433", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480474448", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480474457", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480474478", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480474500", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480474512", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480474523", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480474538", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1542758474ms" + }, + { + "at": "1789228480474560", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +713ms" + }, + { + "at": "1789228480474591", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -147ms" + }, + { + "at": "1789228480474615", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480474636", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480474647", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474659", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228480474676", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480474691", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480474703", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480474717", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480474730", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474743", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x45468bf5" + }, + { + "at": "1789228480474762", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480474773", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480474792", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480474807", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler327)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480474829", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480474843", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480474853", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480474863", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480474872", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480474884", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480474893", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +713ms" + }, + { + "at": "1789228480474911", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -147ms" + }, + { + "at": "1789228480474923", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480474933", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480474952", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480474962", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xf1d4b82" + }, + { + "at": "1789228480474981", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480474991", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480475006", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480475015", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480475024", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480475034", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x45468bf5" + }, + { + "at": "1789228480475050", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480475061", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480475072", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480580957", + "member": "lab01.glab.lol", + "message": "ovs|84536|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228480581107", + "member": "lab01.glab.lol", + "message": "ovs|84537|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228480782390", + "member": "lab01.glab.lol", + "message": "ovs|84538|bridge|INFO|bridge br-int: added interface veth4711b759 on port 38" + }, + { + "at": "1789228481580858", + "member": "lab01.glab.lol", + "message": "ovs|84539|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228481580995", + "member": "lab01.glab.lol", + "message": "ovs|84540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228482580818", + "member": "lab01.glab.lol", + "message": "ovs|84541|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228482580919", + "member": "lab01.glab.lol", + "message": "ovs|84542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228483316767", + "member": "lab01.glab.lol", + "message": "ovs|84543|poll_loop|INFO|Dropped 2526 log messages in last 313 seconds (most recently, 310 seconds ago) due to excessive rate" + }, + { + "at": "1789228483317034", + "member": "lab01.glab.lol", + "message": "ovs|84544|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483317290", + "member": "lab01.glab.lol", + "message": "ovs|84545|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483317798", + "member": "lab01.glab.lol", + "message": "ovs|84546|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483318477", + "member": "lab01.glab.lol", + "message": "ovs|84547|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483318772", + "member": "lab01.glab.lol", + "message": "ovs|84548|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483319274", + "member": "lab01.glab.lol", + "message": "ovs|84549|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483319853", + "member": "lab01.glab.lol", + "message": "ovs|84550|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483320368", + "member": "lab01.glab.lol", + "message": "ovs|84551|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483320882", + "member": "lab01.glab.lol", + "message": "ovs|84552|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483321398", + "member": "lab01.glab.lol", + "message": "ovs|84553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789228483580552", + "member": "lab01.glab.lol", + "message": "ovs|84554|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228483580617", + "member": "lab01.glab.lol", + "message": "ovs|84555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228484580669", + "member": "lab01.glab.lol", + "message": "ovs|84556|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228484580860", + "member": "lab01.glab.lol", + "message": "ovs|84557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228485580915", + "member": "lab01.glab.lol", + "message": "ovs|84558|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228485581160", + "member": "lab01.glab.lol", + "message": "ovs|84559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228486581159", + "member": "lab01.glab.lol", + "message": "ovs|84560|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789228486581417", + "member": "lab01.glab.lol", + "message": "ovs|84561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479472013", + "member": "lab02.glab.lol", + "message": "ovs|00246|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479472164", + "member": "lab02.glab.lol", + "message": "ovs|00247|bridge|INFO|bridge incusovn16: using datapath ID 0000b2f8733c5b4e" + }, + { + "at": "1789228479472179", + "member": "lab02.glab.lol", + "message": "ovs|00248|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479474127", + "member": "lab02.glab.lol", + "message": "ovs|00249|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474189", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474209", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474222", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474231", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474243", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474254", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474271", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474282", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474299", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474312", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474324", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474335", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479474347", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474358", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474368", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474380", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474391", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474408", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474420", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474431", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474442", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474453", + "member": "lab02.glab.lol", + "message": "ovs|00250|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474467", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474477", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474486", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474497", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474510", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474519", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474529", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474538", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474548", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474559", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474570", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474579", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479474590", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474602", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474614", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474624", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474635", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474644", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474653", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474663", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474673", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474683", + "member": "lab02.glab.lol", + "message": "ovs|00251|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474697", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474709", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474718", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474728", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474744", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474755", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734473ms" + }, + { + "at": "1789228479474765", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1591734473ms" + }, + { + "at": "1789228479474776", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1591734473ms" + }, + { + "at": "1789228479474787", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474796", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474811", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474821", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479474833", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474844", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474853", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474868", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474877", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474886", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474897", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474907", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474917", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474926", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479570181", + "member": "lab02.glab.lol", + "message": "ovs|00252|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479570275", + "member": "lab02.glab.lol", + "message": "ovs|00253|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789228479570389", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler328)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479570610", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler328)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228479570644", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228479570673", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479570696", + "member": "lab02.glab.lol", + "message": " my_disc:0x24fed059 your_disc:0x8ec6ef2f" + }, + { + "at": "1789228479570720", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479570742", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479570765", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479570786", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479570808", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479571070", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479571124", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479571151", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734570ms" + }, + { + "at": "1789228479571176", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789228479571205", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789228479571228", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479571250", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479571273", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571321", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479571345", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479571366", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571391", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479571420", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228479571449", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571471", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x24fed059" + }, + { + "at": "1789228479571495", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479571524", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571545", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479571566", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler328)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479571595", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479571617", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479571641", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479571662", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479571682", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479571712", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479571737", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +714ms" + }, + { + "at": "1789228479571758", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -96ms" + }, + { + "at": "1789228479571779", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479571800", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479571821", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571841", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479571862", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479571885", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479571907", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479571928", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228479571949", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479571969", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x24fed059" + }, + { + "at": "1789228479571988", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479572015", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479572034", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479572480", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler328)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479572510", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler328)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228479572535", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479572562", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479572584", + "member": "lab02.glab.lol", + "message": " my_disc:0xfe8ea320 your_disc:0x0" + }, + { + "at": "1789228479572609", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479572628", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479572649", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479572674", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479572697", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479572717", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479572736", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479572756", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734572ms" + }, + { + "at": "1789228479572777", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +691ms" + }, + { + "at": "1789228479572799", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789228479572824", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479572845", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479572866", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479572887", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479572911", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479572932", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479572953", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479572973", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479572996", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573017", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479573038", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479573058", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573077", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479573095", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479573114", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479573132", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479573153", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479573175", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479573196", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479573216", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479573237", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +691ms" + }, + { + "at": "1789228479573257", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789228479573276", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479573296", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479573317", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573337", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228479573360", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479573380", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573405", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479573427", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479573447", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479573469", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479573490", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479573510", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479573531", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479575013", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler328)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479575076", + "member": "lab02.glab.lol", + "message": "ovs|00008|bfd(handler328)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479575104", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479575127", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479575148", + "member": "lab02.glab.lol", + "message": " my_disc:0x8fe124e2 your_disc:0x0" + }, + { + "at": "1789228479575171", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479575192", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479575215", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479575236", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479575261", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479575282", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479575301", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479575319", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1591734574ms" + }, + { + "at": "1789228479575341", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228479575364", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228479575390", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479575420", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479575441", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575466", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479575487", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479575507", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479575528", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479575546", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479575609", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575632", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479575654", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479575675", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479575695", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479575716", + "member": "lab02.glab.lol", + "message": "ovs|00009|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479575739", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479575758", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479575776", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479575796", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479575823", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479575844", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479575864", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +740ms" + }, + { + "at": "1789228479575887", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -100ms" + }, + { + "at": "1789228479575907", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479575928", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479575948", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479575969", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228479575988", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479576006", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479576027", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479576047", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479576068", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479576091", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228479576110", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479576130", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479576156", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479577332", + "member": "lab02.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479577420", + "member": "lab02.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 22" + }, + { + "at": "1789228480404701", + "member": "lab02.glab.lol", + "message": "ovs|00010|bfd(handler328)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480404846", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480404878", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480404901", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480404924", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480404949", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480404975", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480405000", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +760ms" + }, + { + "at": "1789228480405035", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -90ms" + }, + { + "at": "1789228480405059", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480405079", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480405106", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480405129", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xe975fdaf" + }, + { + "at": "1789228480405151", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480405174", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480405197", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480405219", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480405246", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480405271", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x8fe124e2" + }, + { + "at": "1789228480405296", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480405315", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480405335", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480442870", + "member": "lab02.glab.lol", + "message": "ovs|00011|bfd(handler328)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480442960", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480442985", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480443005", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480443030", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480443052", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480443072", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480443093", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +741ms" + }, + { + "at": "1789228480443116", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -179ms" + }, + { + "at": "1789228480443139", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480443161", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480443185", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480443205", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xc6336142" + }, + { + "at": "1789228480443231", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480443251", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480443270", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480443293", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480443315", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480443337", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480443356", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480443377", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480443408", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479468990", + "member": "lab03.glab.lol", + "message": "ovs|00272|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479469117", + "member": "lab03.glab.lol", + "message": "ovs|00273|bridge|INFO|bridge incusovn16: using datapath ID 0000de68b8cf5447" + }, + { + "at": "1789228479469132", + "member": "lab03.glab.lol", + "message": "ovs|00274|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479470916", + "member": "lab03.glab.lol", + "message": "ovs|00275|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479470975", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479470995", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479471010", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479471023", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479471034", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479471053", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634468ms" + }, + { + "at": "1789228479471068", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634468ms" + }, + { + "at": "1789228479471083", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634468ms" + }, + { + "at": "1789228479471096", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479471112", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479471123", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471136", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228479471148", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479471158", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471172", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479471185", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479471198", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471208", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479471223", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479471237", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471248", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479471261", + "member": "lab03.glab.lol", + "message": "ovs|00276|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479471274", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479471288", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479471300", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479471311", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479471320", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479471331", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634468ms" + }, + { + "at": "1789228479471342", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634468ms" + }, + { + "at": "1789228479471354", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634468ms" + }, + { + "at": "1789228479471363", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479471375", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479471388", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471399", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479471414", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479471425", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471436", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479471447", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479471458", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479471468", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479471481", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479471492", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479471502", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479471513", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479473763", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler324)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479473807", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler324)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479473825", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479473845", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479473860", + "member": "lab03.glab.lol", + "message": " my_disc:0xf1d4b82 your_disc:0x0" + }, + { + "at": "1789228479473875", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479473888", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479473899", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479473911", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479473921", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479473931", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479473943", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479473959", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634471ms" + }, + { + "at": "1789228479473974", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +987ms" + }, + { + "at": "1789228479473986", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479473999", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474009", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479474023", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474034", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479474046", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474055", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474072", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474083", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479474097", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474109", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479474121", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474131", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474143", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479474155", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474170", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474182", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474192", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474207", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474218", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479474228", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479474243", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +987ms" + }, + { + "at": "1789228479474255", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479474265", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474275", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479474287", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474298", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228479474309", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474321", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474330", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474342", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479474353", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474364", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228479474373", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474391", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479474404", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478589", + "member": "lab03.glab.lol", + "message": "ovs|00277|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478631", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478645", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478656", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478667", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478677", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479478690", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50634476ms" + }, + { + "at": "1789228479478706", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -50634476ms" + }, + { + "at": "1789228479478723", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -50634476ms" + }, + { + "at": "1789228479478733", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478746", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479478757", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478767", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228479478778", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478788", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478798", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478807", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479478818", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478829", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479478840", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479478849", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478859", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479567283", + "member": "lab03.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479567423", + "member": "lab03.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789228479575196", + "member": "lab03.glab.lol", + "message": "ovs|00280|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479575289", + "member": "lab03.glab.lol", + "message": "ovs|00281|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 35" + }, + { + "at": "1789228480263720", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler324)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480263821", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler324)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228480263855", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480263888", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480263912", + "member": "lab03.glab.lol", + "message": " my_disc:0xc6336142 your_disc:0xfe8ea320" + }, + { + "at": "1789228480263939", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480263964", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480263989", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480264015", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480264039", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480264072", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480264102", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480264134", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50635261ms" + }, + { + "at": "1789228480264160", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228480264186", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -692ms" + }, + { + "at": "1789228480264210", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480264237", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480264261", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264283", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480264308", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480264331", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264354", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480264376", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480264403", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264427", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc6336142" + }, + { + "at": "1789228480264451", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480264472", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264492", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480264515", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler324)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480264540", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480264562", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480264585", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480264663", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480264686", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480264708", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480264736", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +108ms" + }, + { + "at": "1789228480264758", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -692ms" + }, + { + "at": "1789228480264779", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480264801", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480264824", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480264892", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xfe8ea320" + }, + { + "at": "1789228480264914", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480264934", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480264958", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480264981", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480265003", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480265026", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc6336142" + }, + { + "at": "1789228480265047", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480265080", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480265101", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480469217", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler324)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228480469493", + "member": "lab03.glab.lol", + "message": "ovs|00008|bfd(handler324)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789228480469532", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789228480469561", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228480469586", + "member": "lab03.glab.lol", + "message": " my_disc:0x126453c1 your_disc:0x894972dc" + }, + { + "at": "1789228480469615", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228480469639", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228480469663", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228480469692", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480469722", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480469747", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480469777", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480469800", + "member": "lab03.glab.lol", + "message": " Detect Time: now -50635467ms" + }, + { + "at": "1789228480469825", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +841ms" + }, + { + "at": "1789228480469851", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -159ms" + }, + { + "at": "1789228480469882", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480469907", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480469931", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480469953", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228480469978", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470003", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470027", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480470052", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480470096", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470317", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x126453c1" + }, + { + "at": "1789228480470347", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228480470373", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470395", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480470425", + "member": "lab03.glab.lol", + "message": "ovs|00009|bfd(handler324)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480470458", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480470483", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480470510", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480470532", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480470556", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480470582", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480470606", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +841ms" + }, + { + "at": "1789228480470628", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -159ms" + }, + { + "at": "1789228480470655", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480470679", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228480470704", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470728", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x894972dc" + }, + { + "at": "1789228480470750", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470776", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470799", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480470820", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789228480470844", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480470869", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x126453c1" + }, + { + "at": "1789228480470893", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480470917", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480470942", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481173387", + "member": "lab03.glab.lol", + "message": "ovs|00010|bfd(handler324)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228481173475", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228481173491", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228481173506", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228481173518", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228481173530", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228481173540", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228481173551", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +117ms" + }, + { + "at": "1789228481173563", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -713ms" + }, + { + "at": "1789228481173575", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228481173586", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228481173602", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228481173612", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x45468bf5" + }, + { + "at": "1789228481173622", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228481173634", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481173647", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228481173657", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228481173666", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228481173678", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xf1d4b82" + }, + { + "at": "1789228481173689", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228481173706", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481173718", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481573327", + "member": "lab03.glab.lol", + "message": "ovs|00282|bridge|INFO|bridge br-int: added interface veth0f727b81 on port 36" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789228479280841", + "member": "nas01.glab.lol", + "message": "ovs|00250|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789228479281159", + "member": "nas01.glab.lol", + "message": "ovs|00251|bridge|INFO|bridge incusovn16: using datapath ID 0000120a87fe924e" + }, + { + "at": "1789228479281182", + "member": "nas01.glab.lol", + "message": "ovs|00252|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789228479378655", + "member": "nas01.glab.lol", + "message": "ovs|00253|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789228479378758", + "member": "nas01.glab.lol", + "message": "ovs|00254|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789228479384238", + "member": "nas01.glab.lol", + "message": "ovs|00255|bridge|INFO|bridge incusovn16: added interface patch-incus-net37-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789228479384295", + "member": "nas01.glab.lol", + "message": "ovs|00256|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net37-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789228479474399", + "member": "nas01.glab.lol", + "message": "ovs|00257|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474441", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474460", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474479", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474495", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474512", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474532", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861338ms" + }, + { + "at": "1789228479474545", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861338ms" + }, + { + "at": "1789228479474556", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861338ms" + }, + { + "at": "1789228479474566", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474577", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474588", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474603", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479474614", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474631", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474644", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474660", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474675", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474692", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474711", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474726", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474738", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474752", + "member": "nas01.glab.lol", + "message": "ovs|00258|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479474773", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479474787", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479474803", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479474815", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479474825", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479474835", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861338ms" + }, + { + "at": "1789228479474845", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861338ms" + }, + { + "at": "1789228479474856", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861338ms" + }, + { + "at": "1789228479474865", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479474875", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479474884", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474893", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479474905", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479474919", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474929", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479474939", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479474949", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479474958", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479474968", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479474978", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479474989", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479474998", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor353)|INFO|monitor thread created" + }, + { + "at": "1789228479477553", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler337)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479477697", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler337)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789228479477721", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479477749", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479477768", + "member": "nas01.glab.lol", + "message": " my_disc:0x894972dc your_disc:0x0" + }, + { + "at": "1789228479477785", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479477806", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479477822", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479477837", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479477852", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479477866", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479477886", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479477912", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861341ms" + }, + { + "at": "1789228479477934", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +997ms" + }, + { + "at": "1789228479477951", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479477972", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479477985", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479478004", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478019", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479478034", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478049", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478065", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478079", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479478097", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478112", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228479478132", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479478186", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478203", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478222", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478239", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478255", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478270", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478284", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478298", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479478311", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479478333", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +997ms" + }, + { + "at": "1789228479478347", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789228479478363", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478377", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479478392", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478406", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228479478421", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478436", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478451", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478465", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479478480", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478494", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228479478509", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478527", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479478542", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479478790", + "member": "nas01.glab.lol", + "message": "ovs|00259|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479478809", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479478819", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479478829", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479478837", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479478848", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789228479478860", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861342ms" + }, + { + "at": "1789228479478873", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861342ms" + }, + { + "at": "1789228479478884", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861342ms" + }, + { + "at": "1789228479478896", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479478907", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789228479478921", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479478933", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479478945", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479478962", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789228479478975", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479478988", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789228479478999", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479479010", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789228479479022", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479479031", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789228479479040", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789228479480002", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler337)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479480053", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler337)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789228479480068", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479480079", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479480094", + "member": "nas01.glab.lol", + "message": " my_disc:0x8ec6ef2f your_disc:0x0" + }, + { + "at": "1789228479480104", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479480114", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479480124", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479480135", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480144", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480155", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480163", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480178", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861344ms" + }, + { + "at": "1789228479480190", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861344ms" + }, + { + "at": "1789228479480201", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861344ms" + }, + { + "at": "1789228479480211", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480221", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480231", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480242", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479480252", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480261", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480271", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480280", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480290", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480299", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479480310", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479480318", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480329", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480339", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479480355", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479480364", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480374", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480383", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480392", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480401", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479480411", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1591861344ms" + }, + { + "at": "1789228479480421", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1591861344ms" + }, + { + "at": "1789228479480431", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480440", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480449", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480458", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228479480468", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480479", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480490", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480499", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480509", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480518", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228479480527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480547", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480566", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler337)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789228479480577", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler337)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789228479480588", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789228479480598", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789228479480608", + "member": "nas01.glab.lol", + "message": " my_disc:0x6bc64e34 your_disc:0x0" + }, + { + "at": "1789228479480618", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789228479480627", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789228479480637", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789228479480647", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480656", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480666", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480681", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480690", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1591861344ms" + }, + { + "at": "1789228479480700", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +915ms" + }, + { + "at": "1789228479480711", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228479480730", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480740", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480749", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480759", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479480768", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479480778", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480786", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479480796", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479480805", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480813", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479480824", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789228479480833", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479480842", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228479480852", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228479480867", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228479480876", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228479480886", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228479480894", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228479480905", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228479480920", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228479480934", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +915ms" + }, + { + "at": "1789228479480944", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789228479480954", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228479480963", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789228479480972", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228479480982", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228479480991", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479481001", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479481011", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228479481019", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789228479481029", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228479481039", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228479481052", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789228479481061", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228479481070", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480291060", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler337)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480291346", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480291370", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480291385", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480291394", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480291407", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480291417", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480291428", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +84ms" + }, + { + "at": "1789228480291439", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -716ms" + }, + { + "at": "1789228480291453", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480291473", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480291499", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480291510", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x24fed059" + }, + { + "at": "1789228480291523", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480291533", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480291546", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480291557", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480291568", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480291578", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x8ec6ef2f" + }, + { + "at": "1789228480291590", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480291601", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480291611", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228480410199", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler337)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228480410414", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228480410443", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228480410463", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228480410479", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228480410498", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228480410515", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228480410533", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +985ms" + }, + { + "at": "1789228480410551", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -15ms" + }, + { + "at": "1789228480410570", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228480410588", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228480410606", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228480410623", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x9b9bc62f" + }, + { + "at": "1789228480410641", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228480410666", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480410692", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228480410714", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228480410732", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228480410749", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x6bc64e34" + }, + { + "at": "1789228480410767", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228480410783", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228480410799", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789228481317295", + "member": "nas01.glab.lol", + "message": "ovs|00012|bfd(handler337)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789228481317728", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789228481317780", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789228481317824", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789228481317859", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789228481317904", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789228481317980", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789228481318038", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +58ms" + }, + { + "at": "1789228481318072", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -842ms" + }, + { + "at": "1789228481318102", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789228481318131", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789228481318161", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789228481318189", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x126453c1" + }, + { + "at": "1789228481318217", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789228481318237", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481318257", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789228481318276", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789228481318296", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789228481318314", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x894972dc" + }, + { + "at": "1789228481318332", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789228481318351", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789228481318371", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.debug.log new file mode 100644 index 0000000..4499bc2 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:54:37-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.log new file mode 100644 index 0000000..aa438d3 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-create.log @@ -0,0 +1,542 @@ +time="2026-09-12T15:54:37Z" level=debug msg="[nas01] Event listener server handler started" id=2bd9deb3-cb98-412f-b71c-539c1573b065 local="10.10.10.14:8443" remote="100.122.142.76:57186" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57204" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57205" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57206" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57207" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:38Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57208" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57209" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57210" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57211" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57212" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57213" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:b2:7a:65" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.37 +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net37 driver=ovn memberID=1 network=default priority=30102 project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57214" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57215" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57216" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57217" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57219" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:39Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57220" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57221" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57222" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57223" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Event listener server handler started" id=109fd963-4426-40ee-8129-0f866878e03a local="10.10.10.14:8443" remote="100.122.142.76:57223" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57224" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=a9605631-65be-4a8f-9c87-c2e9004c0fde project=image-build +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=a9605631-65be-4a8f-9c87-c2e9004c0fde project=image-build +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Event listener server handler started" id=e1fc4a83-271d-4fc1-a00a-75094748b56a local="10.10.10.14:8443" remote="100.122.142.76:57225" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57225" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57226" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=6c75cc01-edd6-4547-8414-0efbd27b33e6 project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=6c75cc01-edd6-4547-8414-0efbd27b33e6 project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:54:40Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=6c75cc01-edd6-4547-8414-0efbd27b33e6 project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=6c75cc01-edd6-4547-8414-0efbd27b33e6 project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57227" method=GET protocol=tls url="/1.0/operations/6c75cc01-edd6-4547-8414-0efbd27b33e6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=109fd963-4426-40ee-8129-0f866878e03a local="10.10.10.14:8443" remote="100.122.142.76:57223" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e1fc4a83-271d-4fc1-a00a-75094748b56a local="10.10.10.14:8443" remote="100.122.142.76:57225" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57228" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57229" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"a2f0c485-ab35-429d-bee0-073bcfe6170b\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:54:40.279648235Z\",\n\t\t\"updated_at\": \"2026-09-12T15:54:40.279648235Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57230" method=GET protocol=tls url="/1.0/operations/a2f0c485-ab35-429d-bee0-073bcfe6170b/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57231" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57232" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57233" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Event listener server handler started" id=12ed869b-c51d-44fc-8f6f-41ab25c49864 local="10.10.10.14:8443" remote="100.122.142.76:57233" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57234" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 15:54:40.291942629 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57235" method=GET protocol=tls url="/1.0/operations/e4bca6d2-1b64-4d03-bd67-354e9352dc3c?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:40Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 15:54:40.291942629 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:54:40Z" level=debug msg="[nas01] Event listener server handler stopped" listener=12ed869b-c51d-44fc-8f6f-41ab25c49864 local="10.10.10.14:8443" remote="100.122.142.76:57233" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57237" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57238" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"8473a89c-6cbd-4037-91c7-ed76b34deed1\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T15:54:41.035545711Z\",\n\t\t\"updated_at\": \"2026-09-12T15:54:41.035545711Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57239" method=GET protocol=tls url="/1.0/operations/8473a89c-6cbd-4037-91c7-ed76b34deed1/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:54:41Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57240" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57241" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57242" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Event listener server handler started" id=34fb6f9b-090c-476b-bed6-f8c78bb5d73c local="10.10.10.14:8443" remote="100.122.142.76:57242" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57243" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 15:54:41.080263333 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57244" method=GET protocol=tls url="/1.0/operations/7ccc252d-0892-4f92-a8bf-9e2bab9268ac?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T15:54:41Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 15:54:41.080263333 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Event listener server handler stopped" listener=34fb6f9b-090c-476b-bed6-f8c78bb5d73c local="10.10.10.14:8443" remote="100.122.142.76:57242" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57245" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57246" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:41Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57247" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57248" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57250" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57251" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57252" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57253" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57254" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57255" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Event listener server handler started" id=fcf22f7f-a6e0-45d6-b3fc-8e27a584ce51 local="10.10.10.14:8443" remote="100.122.142.76:57255" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57257" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57260" method=GET protocol=tls url="/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=7ae71c4b3b550e167e483629151d1fdaea5e3887ed7caeea407d7860311f927e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57260" +time="2026-09-12T15:54:42Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=7ae71c4b3b550e167e483629151d1fdaea5e3887ed7caeea407d7860311f927e" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57262" method=GET protocol=tls url="/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=190ae460b5b8adf34e5ae065409787ddda092bc25565d0fc40d5c1080edb13c7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=190ae460b5b8adf34e5ae065409787ddda092bc25565d0fc40d5c1080edb13c7" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57262" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57263" method=GET protocol=tls url="/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=45f1ea87052d50846a75b64900f29883ee41d5cd1166a9ba4d8ada9c03c330c5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=45f1ea87052d50846a75b64900f29883ee41d5cd1166a9ba4d8ada9c03c330c5" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57263" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57264" method=GET protocol=tls url="/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=0f47102c4f6299bb3bf6b06abb1e20e1f3832ece9fac8cc2eeaccbd1dc692533" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11/websocket?secret=0f47102c4f6299bb3bf6b06abb1e20e1f3832ece9fac8cc2eeaccbd1dc692533" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57264" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57262" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57265" method=GET protocol=tls url="/1.0/operations/502d0e1f-9bf0-4051-824d-055832e50a11?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57260" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57263" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57264" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=fcf22f7f-a6e0-45d6-b3fc-8e27a584ce51 local="10.10.10.14:8443" remote="100.122.142.76:57255" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57266" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57267" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57268" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57269" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Event listener server handler started" id=9a6dc088-743f-4a57-8474-af7560e54604 local="10.10.10.14:8443" remote="100.122.142.76:57269" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57270" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57271" method=GET protocol=tls url="/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=7b1dc16bddbdb9bd45cfe42c5820433bed44bf7213b0ea13941dac49ba045016" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=7b1dc16bddbdb9bd45cfe42c5820433bed44bf7213b0ea13941dac49ba045016" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57271" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57272" method=GET protocol=tls url="/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=9aab3756395563534e61f29e11383f7e08d05589ec6ad15424e2fb00f050668d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=9aab3756395563534e61f29e11383f7e08d05589ec6ad15424e2fb00f050668d" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57272" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57273" method=GET protocol=tls url="/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=1e43ed1f76490575b1f9066d263b58f5f0510f90853793290ad135432997033b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=1e43ed1f76490575b1f9066d263b58f5f0510f90853793290ad135432997033b" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57273" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57274" method=GET protocol=tls url="/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=ccf13e3d2a319d803d62aae9a4d8ab9bc9afe94297e75c1a14d0774c038d737c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5124e468-01b5-4a62-a28b-930360054219/websocket?secret=ccf13e3d2a319d803d62aae9a4d8ab9bc9afe94297e75c1a14d0774c038d737c" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57274" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57272" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57275" method=GET protocol=tls url="/1.0/operations/5124e468-01b5-4a62-a28b-930360054219?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57271" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57274" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57273" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=9a6dc088-743f-4a57-8474-af7560e54604 local="10.10.10.14:8443" remote="100.122.142.76:57269" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57276" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57277" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Event listener server handler started" id=a98ee09c-4d2e-4697-ad56-9b0daffa1bc1 local="10.10.10.14:8443" remote="100.122.142.76:57277" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57278" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57280" method=GET protocol=tls url="/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=f0bfa835e8d15d888723b66d6c152004a67ef738924b440756c2da7fdf49299c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=f0bfa835e8d15d888723b66d6c152004a67ef738924b440756c2da7fdf49299c" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57280" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57281" method=GET protocol=tls url="/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=f0efa7d1089680ea4f3af7865170a2fd4ae82aeeb0cbbc3d5949534e766b08ba" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=f0efa7d1089680ea4f3af7865170a2fd4ae82aeeb0cbbc3d5949534e766b08ba" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57281" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57282" method=GET protocol=tls url="/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=5b12b2101fc111801ed11b032924705543f5e180ce2b860b1b6dd30d0dd4ddd2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57282" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=5b12b2101fc111801ed11b032924705543f5e180ce2b860b1b6dd30d0dd4ddd2" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57283" method=GET protocol=tls url="/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=4b29daeb8125198d885e608805be2117aa39426ead6422f8bcd216b63cbea6b2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d/websocket?secret=4b29daeb8125198d885e608805be2117aa39426ead6422f8bcd216b63cbea6b2" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57283" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57281" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57284" method=GET protocol=tls url="/1.0/operations/08ceac67-1d10-4ff8-8fca-077698d07a8d?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57280" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57283" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57282" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a98ee09c-4d2e-4697-ad56-9b0daffa1bc1 local="10.10.10.14:8443" remote="100.122.142.76:57277" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57285" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57286" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57288" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57289" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Event listener server handler started" id=caf8be85-21fe-465c-a60a-eae853c5a315 local="10.10.10.14:8443" remote="100.122.142.76:57289" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57290" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57291" method=GET protocol=tls url="/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=bd468391675faea81551162f1772853acd860f47a5b598475dacb2848a54a2d6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57291" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=bd468391675faea81551162f1772853acd860f47a5b598475dacb2848a54a2d6" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57292" method=GET protocol=tls url="/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=fe81f07fff8c9fe23a45aaada1ae510f26922b5a9ad427735c8f820840f0e5af" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=fe81f07fff8c9fe23a45aaada1ae510f26922b5a9ad427735c8f820840f0e5af" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57292" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57293" method=GET protocol=tls url="/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=0961e74caca15b6f8faaf19d449992b95d00e7befe0a1546c415490a630e50ad" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57293" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=0961e74caca15b6f8faaf19d449992b95d00e7befe0a1546c415490a630e50ad" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57294" method=GET protocol=tls url="/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=5f16c4bba785cc19b764341470dd7ff4710119c612d177988067229104e527d2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57294" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba/websocket?secret=5f16c4bba785cc19b764341470dd7ff4710119c612d177988067229104e527d2" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57292" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57295" method=GET protocol=tls url="/1.0/operations/009d6b01-2159-4898-b253-a5715f6bd0ba?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57291" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57293" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57294" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Event listener server handler stopped" listener=caf8be85-21fe-465c-a60a-eae853c5a315 local="10.10.10.14:8443" remote="100.122.142.76:57289" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57296" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Event listener server handler started" id=6e29c1d8-5e9f-408c-8a15-720268b6c103 local="10.10.10.14:8443" remote="100.122.142.76:57297" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57297" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57298" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57299" method=GET protocol=tls url="/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=2b1cf712f936433581e8eb5473a9e9085bb40e92befa1ab8e6538c45611d5bb4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57299" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=2b1cf712f936433581e8eb5473a9e9085bb40e92befa1ab8e6538c45611d5bb4" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57301" method=GET protocol=tls url="/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=22f799c683bfafcf68109a94c4abd2b4e72ac140274812f1f57e1a3e58b4ac1d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=22f799c683bfafcf68109a94c4abd2b4e72ac140274812f1f57e1a3e58b4ac1d" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57301" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57302" method=GET protocol=tls url="/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=fc9f07057c6788fc3b52b26d9eb33c228194727e0fbe8c023121dc2de91ea266" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57302" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=fc9f07057c6788fc3b52b26d9eb33c228194727e0fbe8c023121dc2de91ea266" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57303" method=GET protocol=tls url="/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=e039b9e32bde4e1ec5941eba71c8f9b2c0d1a8fdcedf5c2d77a97159e78ecc82" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef/websocket?secret=e039b9e32bde4e1ec5941eba71c8f9b2c0d1a8fdcedf5c2d77a97159e78ecc82" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57303" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57301" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57304" method=GET protocol=tls url="/1.0/operations/c7ee083d-821d-4edf-b34f-b4f3c31cc5ef?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57299" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57303" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57302" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Event listener server handler stopped" listener=6e29c1d8-5e9f-408c-8a15-720268b6c103 local="10.10.10.14:8443" remote="100.122.142.76:57297" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57305" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57306" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Event listener server handler started" id=a3cee04d-49f5-45e1-be60-3557b9fb90fd local="10.10.10.14:8443" remote="100.122.142.76:57306" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57307" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:44Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57310" method=GET protocol=tls url="/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=b83e0b7d5353ecc809aca719747ba3167d67907cfbc34ce849099105cd1dfa22" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=b83e0b7d5353ecc809aca719747ba3167d67907cfbc34ce849099105cd1dfa22" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57310" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57311" method=GET protocol=tls url="/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=a099eb2c6e73e3eec476bf507e1fa5b970423535789a5ba7125dfbcf52835c4c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57311" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=a099eb2c6e73e3eec476bf507e1fa5b970423535789a5ba7125dfbcf52835c4c" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57312" method=GET protocol=tls url="/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=7c2958f7fd2f67086adcf718e27933654d66e096250789f6d3d0955898691f44" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=7c2958f7fd2f67086adcf718e27933654d66e096250789f6d3d0955898691f44" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57312" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57313" method=GET protocol=tls url="/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=4f051a185dbcb0071a12685e8679f8b7211dac99ed94d37f0887d807ee41dfc9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab/websocket?secret=4f051a185dbcb0071a12685e8679f8b7211dac99ed94d37f0887d807ee41dfc9" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:57313" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57311" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57314" method=GET protocol=tls url="/1.0/operations/fc3f4848-6155-4b6c-b3a4-d5f8163effab?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57310" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57312" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:57313" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a3cee04d-49f5-45e1-be60-3557b9fb90fd local="10.10.10.14:8443" remote="100.122.142.76:57306" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57316" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57317" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Event listener server handler started" id=1ce15335-9964-4fed-af5a-e0bc7989a018 local="10.10.10.14:8443" remote="100.122.142.76:57317" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57318" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Completed heartbeat round" duration=6.929687103s +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57319" method=GET protocol=tls url="/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=672bfd76cf491fe15e51141ee042ff896000bc5eb24a5eca00a499ba89cba281" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=672bfd76cf491fe15e51141ee042ff896000bc5eb24a5eca00a499ba89cba281" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57319" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57320" method=GET protocol=tls url="/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=26a67a68af55df6596a8d46d5d9b600eba941a7acabf4318d27702f495db31b4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=26a67a68af55df6596a8d46d5d9b600eba941a7acabf4318d27702f495db31b4" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57320" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57321" method=GET protocol=tls url="/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=494f24905848de165803170de98c8affb41dc8801f87dd9a1b944e526cf42d79" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57321" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=494f24905848de165803170de98c8affb41dc8801f87dd9a1b944e526cf42d79" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57322" method=GET protocol=tls url="/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=ed3459a97cfbe109b0a159073071c911b89fed97f4fc8ab13dc522090510e295" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39/websocket?secret=ed3459a97cfbe109b0a159073071c911b89fed97f4fc8ab13dc522090510e295" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:57322" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57320" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57323" method=GET protocol=tls url="/1.0/operations/06c70747-8ddf-45d4-9de8-1e1a40105e39?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57322" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57321" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:57319" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Event listener server handler stopped" listener=1ce15335-9964-4fed-af5a-e0bc7989a018 local="10.10.10.14:8443" remote="100.122.142.76:57317" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57325" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57326" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T15:54:46Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.debug.log new file mode 100644 index 0000000..2562318 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T08:55:32-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.log new file mode 100644 index 0000000..2766426 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/monitor-delete.log @@ -0,0 +1,168 @@ +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Event listener server handler started" id=0e4fa43a-ff85-45e0-9114-9aee407eb187 local="10.10.10.14:8443" remote="100.122.142.76:57528" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57529" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57530" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57531" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57532" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:54:40.291942629Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:54:40.866490778Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T15:54:41.080263333Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T15:54:41.65195342Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57533" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57534" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57535" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Event listener server handler started" id=8a5ed8d2-437b-4fdc-8b0b-245e460bdca1 local="10.10.10.14:8443" remote="100.122.142.76:57535" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57536" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:32Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T15:55:33Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 15:54:40.291942629 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:54:40.866490778 +0000 UTC" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57538" method=GET protocol=tls url="/1.0/operations/61d6d042-6626-4c26-a4e4-52d114224913?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57539" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:33Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 15:54:40.291942629 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:54:40.866490778 +0000 UTC" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57540" method=GET protocol=tls url="/1.0/operations/2f15eef7-ef34-46d8-9623-c427885dfe6f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 15:54:40.291942629 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 15:54:40.866490778 +0000 UTC" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8a5ed8d2-437b-4fdc-8b0b-245e460bdca1 local="10.10.10.14:8443" remote="100.122.142.76:57535" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57542" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57543" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Event listener server handler started" id=b2f4fbc4-0846-4668-b85a-270c3c8551e2 local="10.10.10.14:8443" remote="100.122.142.76:57544" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57544" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:33Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57545" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:34Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 15:54:41.080263333 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 15:54:41.65195342 +0000 UTC" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57546" method=GET protocol=tls url="/1.0/operations/86a6986a-7cf2-4ee8-853b-81964e7aca0b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57547" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:34Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 15:54:41.080263333 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:54:41.65195342 +0000 UTC" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57548" method=GET protocol=tls url="/1.0/operations/1e063a2e-74be-4d5d-aa5c-1609dc2921f1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:34Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 15:54:41.080263333 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 15:54:41.65195342 +0000 UTC" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b2f4fbc4-0846-4668-b85a-270c3c8551e2 local="10.10.10.14:8443" remote="100.122.142.76:57544" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:34Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57549" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57550" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57551" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57552" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57553" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57554" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57555" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57556" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Completed heartbeat round" duration=6.758728129s +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57557" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57558" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57559" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57560" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57561" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57562" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57563" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57564" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57565" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Event listener server handler started" id=29ff1aa8-5c7d-42bb-b233-e410f3420f21 local="10.10.10.14:8443" remote="100.122.142.76:57565" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57566" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=01af5ab2-f571-412c-99c1-83e5e5d6c2ea project=ac-ovn-spike +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=01af5ab2-f571-412c-99c1-83e5e5d6c2ea project=ac-ovn-spike +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=01af5ab2-f571-412c-99c1-83e5e5d6c2ea project=ac-ovn-spike +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57567" method=GET protocol=tls url="/1.0/operations/01af5ab2-f571-412c-99c1-83e5e5d6c2ea?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Event listener server handler stopped" listener=29ff1aa8-5c7d-42bb-b233-e410f3420f21 local="10.10.10.14:8443" remote="100.122.142.76:57565" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57568" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:35Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T15:55:36Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:57569" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T15:55:36Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/probe.stderr.txt new file mode 100644 index 0000000..2041e75 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/probe.stderr.txt @@ -0,0 +1,8 @@ +probe: gateway ping one -> 10.10.40.1 failed +probe: gateway ping two -> 10.10.40.1 failed +probe: dns lookup example.com from one via 10.10.40.1 failed +probe: dns lookup example.com from two via 10.10.40.1 failed +probe: internet egress curl from one failed +probe: internet egress curl from two failed +probe: workstation curl of forward-url failed +probe: 7 datapath checks failed diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/probe.stdout.txt new file mode 100644 index 0000000..84118ca --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/probe.stdout.txt @@ -0,0 +1,107 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.113 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.097 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"8a516d02-d9b6-4222-ade6-11cd08d9ef14","volatile.eth0.host_name":"veth4711b759","volatile.eth0.hwaddr":"10:66:6a:42:ab:f9","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"1d65075f-bf3c-44b1-bcd2-e0990753a8f8","volatile.uuid.generation":"1d65075f-bf3c-44b1-bcd2-e0990753a8f8"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:54:40.291942629Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"8a516d02-d9b6-4222-ade6-11cd08d9ef14","volatile.eth0.host_name":"veth4711b759","volatile.eth0.hwaddr":"10:66:6a:42:ab:f9","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"1d65075f-bf3c-44b1-bcd2-e0990753a8f8","volatile.uuid.generation":"1d65075f-bf3c-44b1-bcd2-e0990753a8f8"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:54:40.866490778Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9662464,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe42:abf9","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:42:ab:f9","host_name":"veth4711b759","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4180780,"processes":4,"cpu":{"usage":482073000,"allocated_time":24000000000},"started_at":"2026-09-12T15:54:39.880000114Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"d35024e8-a62e-4076-b972-b0649f082bcc","volatile.eth0.host_name":"veth0f727b81","volatile.eth0.hwaddr":"10:66:6a:7e:16:81","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"1865c9ca-a151-476a-9d41-61a7e0c2e2ba","volatile.uuid.generation":"1865c9ca-a151-476a-9d41-61a7e0c2e2ba"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T15:54:41.080263333Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"d35024e8-a62e-4076-b972-b0649f082bcc","volatile.eth0.host_name":"veth0f727b81","volatile.eth0.hwaddr":"10:66:6a:7e:16:81","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"1865c9ca-a151-476a-9d41-61a7e0c2e2ba","volatile.uuid.generation":"1865c9ca-a151-476a-9d41-61a7e0c2e2ba"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T15:54:41.65195342Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":10747904,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe7e:1681","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:7e:16:81","host_name":"veth0f727b81","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":37065,"processes":4,"cpu":{"usage":488402000,"allocated_time":24000000000},"started_at":"2026-09-12T15:54:41.660000085Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.266 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.201 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.261 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.075 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.707 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.340 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.340/0.707/1.075 ms +elapsed_seconds=2.260 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.025 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.807 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.413 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.413/0.748/1.025 ms +elapsed_seconds=2.242 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.409 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.276 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.256 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.239 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5002 milliseconds +elapsed_seconds=5.253 exit=28 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5001 milliseconds +elapsed_seconds=5.298 exit=28 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +curl: (28) Failed to connect to 10.10.40.79 port 8080 after 5003 ms: Timeout was reached +elapsed_seconds=5.030 exit=28 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.108883 bytes_per_second=918417016 +elapsed_seconds=0.556 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.491 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.142853 bytes_per_second=700020300 +elapsed_seconds=0.393 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.558 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/tcpdump-arp.log new file mode 100644 index 0000000..4431c9a --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/tcpdump-arp.log @@ -0,0 +1,3 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/topology.jsonl new file mode 100644 index 0000000..b6fc887 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/gateway-pre-6/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.127, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.568, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.098, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.27, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.377, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:54:40.279648235Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"a2f0c485-ab35-429d-bee0-073bcfe6170b\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:54:40.279648235Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.385, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.414, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T15:54:41.035545711Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"8473a89c-6cbd-4037-91c7-ed76b34deed1\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T15:54:41.035545711Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.36, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.224, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 136369000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 5689344,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe42:abf9\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth4711b759\",\n\t\t\t\"hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4180780,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:54:39.880000114Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.231, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 130618000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6451200,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe7e:1681\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 860,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"veth0f727b81\",\n\t\t\t\"hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 37065,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T15:54:41.660000085Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t},\n\t\"created_at\": \"2026-09-12T15:54:40.291942629Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:54:40.866490778Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t},\n\t\"created_at\": \"2026-09-12T15:54:41.080263333Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T15:54:41.65195342Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.705, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.593 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.593/1.593/1.593 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.323, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.192, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.305, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.36, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-desq60zv/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.19, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.301, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.785, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.024689 seconds, 3.8GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.49, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.026046 seconds, 3.6GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.161, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 19\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.107, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:54:40.291942629Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"8a516d02-d9b6-4222-ade6-11cd08d9ef14\",\n\t\t\t\"volatile.eth0.host_name\": \"veth4711b759\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:42:ab:f9\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\",\n\t\t\t\"volatile.uuid.generation\": \"1d65075f-bf3c-44b1-bcd2-e0990753a8f8\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:54:40.866490778Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T15:54:41.080263333Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"d35024e8-a62e-4076-b972-b0649f082bcc\",\n\t\t\t\"volatile.eth0.host_name\": \"veth0f727b81\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:7e:16:81\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\",\n\t\t\t\"volatile.uuid.generation\": \"1865c9ca-a151-476a-9d41-61a7e0c2e2ba\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T15:54:41.65195342Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.091, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.083, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.16, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.186, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.104, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T15:54:41.111143968Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T15:54:40.155533024Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.153, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.104, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/h3-arp-capture.json b/spikes/ovn/diagnosis-2026-09-12/h3-arp-capture.json new file mode 100644 index 0000000..d6c479a --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/h3-arp-capture.json @@ -0,0 +1,9 @@ +{ + "text": "tcpdump: verbose output suppressed, use -v[v]... for full protocol decode\nlistening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes\n\n0 packets captured\n0 packets received by filter\n0 packets dropped by kernel\nConnection to sandbox01 closed.\n[ovn-h3-arp: failed; cursor=269]", + "details": { + "op": "logs", + "cursor": 269, + "timedOut": false, + "state": "failed" + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/h3-keeper-arp-capture.json b/spikes/ovn/diagnosis-2026-09-12/h3-keeper-arp-capture.json new file mode 100644 index 0000000..39f019c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/h3-keeper-arp-capture.json @@ -0,0 +1,9 @@ +{ + "text": "tcpdump: verbose output suppressed, use -v[v]... for full protocol decode\nlistening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes\n\n0 packets captured\n0 packets received by filter\n0 packets dropped by kernel\nConnection to sandbox01 closed.\n[ovn-h3-keeper-arp: failed; cursor=269]", + "details": { + "op": "logs", + "cursor": 269, + "timedOut": false, + "state": "failed" + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/keeper-1/commands.jsonl new file mode 100644 index 0000000..2564e33 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.111, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T05:58:52.549317+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.284, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T05:58:52.833516+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.095, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T05:58:52.929379+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 44474, "ready": true, "ready_signal": "time=\"2026-09-11T22:58:53-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:58:53.010398+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/topology.jsonl", "create"], "seconds": 8.194, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.65\",\n \"network_create_seconds\": 0.382,\n \"first_cross_member_ping_seconds\": 3.125,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.204818+00:00"} +{"capture": "monitor-create", "pid": 44474, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.log", "ready_signal": "time=\"2026-09-11T22:58:53-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:59:01.207363+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.094, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.301947+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.088, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d1:59:9b |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:28:a6:a7 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.390156+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.111, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 76d12b84-f05e-41fa-96d2-bda91c185aff (incus-net26-ls-int)\n port incus-net26-ls-int-lsp-router\n type: router\n router-port: incus-net26-lr-lrp-int\n port incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0\n addresses: [\"10:66:6a:d1:59:9b dynamic\"]\n port incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0\n addresses: [\"10:66:6a:28:a6:a7 dynamic\"]\nswitch 621453ed-2996-4acb-965c-5d088e92d1b6 (incus-net26-ls-ext)\n port incus-net26-ls-ext-lsp-router\n type: router\n router-port: incus-net26-lr-lrp-ext\n port incus-net26-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 70bc20a5-05b6-44d0-a9ee-0a12e4e7b386 (incus-net26-lr)\n port incus-net26-lr-lrp-ext\n mac: \"10:66:6a:ed:13:7f\"\n ipv6-lla: \"fe80::1266:6aff:feed:137f\"\n networks: [\"10.10.40.65/24\"]\n port incus-net26-lr-lrp-int\n mac: \"10:66:6a:ed:13:7f\"\n ipv6-lla: \"fe80::1266:6aff:feed:137f\"\n networks: [\"10.253.73.1/24\"]\n nat 85877e0f-2f36-4796-90da-753d6830dd72\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\n Port_Binding cr-incus-net26-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : a6b7de8c-1fab-4849-aa3d-e3850ea5c38a\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ed:13:7f\"\nname : incus-net26-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 675e74e4-1aa2-425a-8850-037cad86d585\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 6ca9a674-65cd-44a3-a96a-09e92defc83b\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ed:13:7f\"\nname : incus-net26-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 34e1c355-91e6-46c4-a769-74289fe0d7a0\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : 85fde4cd-3d5e-4913-9fe9-cd92e27c2ca8\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f49c8969-49c0-48fb-82ba-c247aa389fb0\nlogical_port : cr-incus-net26-lr-lrp-ext\nmac : [\"10:66:6a:ed:13:7f 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net26-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.501798+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.287, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:ed:13:7f REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.789751+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192733200954\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02650|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192733201218\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192734200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02652|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192734200965\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02653|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192734975878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02654|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192734976090\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02655|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192735200979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02656|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192735201098\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192735259110\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02658|poll_loop|INFO|Dropped 12547 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192735259220\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02659|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192736200787\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02660|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192736200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192736292421\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02662|bridge|INFO|bridge br-int: added interface veth2a691f0a on port 18\"\n },\n {\n \"at\": \"1789192737200568\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02663|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192737200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192738201046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02665|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192738201291\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02666|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192739200618\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02667|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192739200736\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192740201123\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02669|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192740201371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192741201094\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02671|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192741201219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02672|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192741258868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02673|poll_loop|INFO|Dropped 12038 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192741258966\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02674|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.898855+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.098, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734968236\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00131|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734968518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00132|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:01.997232+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.094, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734970297\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734970597\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15\"\n },\n {\n \"at\": \"1789192737323110\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00139|bridge|INFO|bridge br-int: added interface vetha6f26a5a on port 16\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:02.091513+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.086, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734960169\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00135|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734960481\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00136|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:02.178126+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-before-probe.txt", "router_mac": "10:66:6a:ed:13:7f", "at": "2026-09-12T05:59:02.178865+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.092, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:58:55.708740699Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:58:56.58163556Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:58:56.813195872Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:58:57.401372044Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:02.271348+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.65"], "capture": "tcpdump-arp", "pid": 44781, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T05:59:02.391564+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.14, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.086 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.092 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"e4d66421-f566-40dc-933b-129bb8f654b2\",\"volatile.eth0.host_name\":\"veth2a691f0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:d1:59:9b\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\",\"volatile.uuid.generation\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T05:58:55.708740699Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"e4d66421-f566-40dc-933b-129bb8f654b2\",\"volatile.eth0.host_name\":\"veth2a691f0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:d1:59:9b\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\",\"volatile.uuid.generation\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T05:58:56.58163556Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9662464,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fed1:599b\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":898,\"bytes_sent\":1410,\"packets_received\":5,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:d1:59:9b\",\"host_name\":\"veth2a691f0a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4071042,\"processes\":4,\"cpu\":{\"usage\":485535000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T05:58:55.599999904Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"cdf9b99f-6558-48d7-9534-c8d1975296be\",\"volatile.eth0.host_name\":\"vetha6f26a5a\",\"volatile.eth0.hwaddr\":\"10:66:6a:28:a6:a7\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c1518eb6-924b-4e4f-a795-f1e260088103\",\"volatile.uuid.generation\":\"c1518eb6-924b-4e4f-a795-f1e260088103\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T05:58:56.813195872Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"cdf9b99f-6558-48d7-9534-c8d1975296be\",\"volatile.eth0.host_name\":\"vetha6f26a5a\",\"volatile.eth0.hwaddr\":\"10:66:6a:28:a6:a7\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c1518eb6-924b-4e4f-a795-f1e260088103\",\"volatile.uuid.generation\":\"c1518eb6-924b-4e4f-a795-f1e260088103\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T05:58:57.401372044Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11218944,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe28:a6a7\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1340,\"packets_received\":6,\"packets_sent\":10,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:28:a6:a7\",\"host_name\":\"vetha6f26a5a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":13098,\"processes\":4,\"cpu\":{\"usage\":503057000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T05:58:57.410000085Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.108 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.254 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.176 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.262 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.610 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.345 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.345/0.739/1.262 ms\nelapsed_seconds=2.246 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.982 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.831 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.435 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.435/0.749/0.982 ms\nelapsed_seconds=2.244 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.666 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.803 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.302 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.302/1.590/1.803 ms\nelapsed_seconds=2.301 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.537 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.187 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.104 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.104/1.276/1.537 ms\nelapsed_seconds=2.587 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.571 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.275 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.304 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.334 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.028 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.141790 bytes_per_second=705268354\nelapsed_seconds=0.378 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.516 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.143080 bytes_per_second=698909700\nelapsed_seconds=0.392 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.491 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:16.532011+00:00"} +{"capture": "tcpdump-arp", "pid": 44781, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T05:59:16.534529+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.089, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:16.624002+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d1:59:9b |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:28:a6:a7 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:16.710693+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.115, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 76d12b84-f05e-41fa-96d2-bda91c185aff (incus-net26-ls-int)\n port incus-net26-ls-int-lsp-router\n type: router\n router-port: incus-net26-lr-lrp-int\n port incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0\n addresses: [\"10:66:6a:d1:59:9b dynamic\"]\n port incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0\n addresses: [\"10:66:6a:28:a6:a7 dynamic\"]\nswitch 621453ed-2996-4acb-965c-5d088e92d1b6 (incus-net26-ls-ext)\n port incus-net26-ls-ext-lsp-router\n type: router\n router-port: incus-net26-lr-lrp-ext\n port incus-net26-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 70bc20a5-05b6-44d0-a9ee-0a12e4e7b386 (incus-net26-lr)\n port incus-net26-lr-lrp-ext\n mac: \"10:66:6a:ed:13:7f\"\n ipv6-lla: \"fe80::1266:6aff:feed:137f\"\n networks: [\"10.10.40.65/24\"]\n port incus-net26-lr-lrp-int\n mac: \"10:66:6a:ed:13:7f\"\n ipv6-lla: \"fe80::1266:6aff:feed:137f\"\n networks: [\"10.253.73.1/24\"]\n nat 85877e0f-2f36-4796-90da-753d6830dd72\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\n Port_Binding cr-incus-net26-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : a6b7de8c-1fab-4849-aa3d-e3850ea5c38a\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ed:13:7f\"\nname : incus-net26-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 675e74e4-1aa2-425a-8850-037cad86d585\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 6ca9a674-65cd-44a3-a96a-09e92defc83b\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ed:13:7f\"\nname : incus-net26-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 34e1c355-91e6-46c4-a769-74289fe0d7a0\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : 85fde4cd-3d5e-4913-9fe9-cd92e27c2ca8\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f49c8969-49c0-48fb-82ba-c247aa389fb0\nlogical_port : cr-incus-net26-lr-lrp-ext\nmac : [\"10:66:6a:ed:13:7f 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net26-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:16.826028+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.291, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:ed:13:7f REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T05:59:17.117586+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.121, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192733200954\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02650|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192733201218\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192734200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02652|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192734200965\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02653|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192734975878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02654|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192734976090\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02655|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192735200979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02656|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192735201098\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192735259110\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02658|poll_loop|INFO|Dropped 12547 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192735259220\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02659|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192736200787\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02660|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192736200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192736292421\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02662|bridge|INFO|bridge br-int: added interface veth2a691f0a on port 18\"\n },\n {\n \"at\": \"1789192737200568\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02663|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192737200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192738201046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02665|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192738201291\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02666|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192739200618\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02667|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192739200736\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192740201123\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02669|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192740201371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192741201094\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02671|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192741201219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02672|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192741258868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02673|poll_loop|INFO|Dropped 12038 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192741258966\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02674|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192742201027\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02675|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192742201163\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02676|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192743201039\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02677|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192743201280\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02678|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192744200763\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02679|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192744200866\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02680|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192744957794\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02681|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789192745201119\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02682|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192745201247\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02683|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192746200789\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02684|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192746201004\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02685|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192747200855\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02686|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192747201103\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02687|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192747258924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02688|poll_loop|INFO|Dropped 12097 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192747259025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02689|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192748200996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02690|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192748201261\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192749200642\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02692|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192749200782\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192750200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02694|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192750201209\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192751201049\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02696|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192751201300\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02697|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192752200731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02698|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192752200843\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192753200655\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02700|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192753200930\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02701|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192753258713\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02702|poll_loop|INFO|Dropped 12363 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192753258832\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02703|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192754200918\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02704|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192754201171\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02705|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192755200969\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02706|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192755201188\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02707|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192756200937\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02708|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192756201044\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02709|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192757200746\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02710|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192757200901\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02711|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:17.239033+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.099, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734968236\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00131|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734968518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00132|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192744953035\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00133|connmgr|INFO|br-int<->unix#7: 962 flow_mods in the 6 s starting 10 s ago (863 adds, 99 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:17.338949+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.093, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734970297\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734970597\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15\"\n },\n {\n \"at\": \"1789192737323110\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00139|bridge|INFO|bridge br-int: added interface vetha6f26a5a on port 16\"\n },\n {\n \"at\": \"1789192744958184\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00140|connmgr|INFO|br-int<->unix#7: 968 flow_mods in the 6 s starting 10 s ago (872 adds, 96 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:17.432997+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.084, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734960169\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00135|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734960481\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00136|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789192744955688\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00137|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (877 adds, 96 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:17.516972+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-probe.txt", "router_mac": "10:66:6a:ed:13:7f", "at": "2026-09-12T05:59:17.517692+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 45577, "ready": true, "ready_signal": "time=\"2026-09-11T22:59:17-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:59:17.597653+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/topology.jsonl", "destroy"], "seconds": 3.537, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:21.134842+00:00"} +{"capture": "monitor-delete", "pid": 45577, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.log", "ready_signal": "time=\"2026-09-11T22:59:17-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T05:59:21.137182+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.08, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T05:59:21.217767+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.105, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T05:59:21.322880+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.122, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:21.445619+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.341, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:ed:13:7f REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T05:59:21.786906+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.113, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192733200954\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02650|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192733201218\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192734200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02652|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192734200965\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02653|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192734975878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02654|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192734976090\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02655|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192735200979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02656|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192735201098\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192735259110\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02658|poll_loop|INFO|Dropped 12547 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192735259220\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02659|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192736200787\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02660|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192736200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192736292421\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02662|bridge|INFO|bridge br-int: added interface veth2a691f0a on port 18\"\n },\n {\n \"at\": \"1789192737200568\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02663|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192737200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192738201046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02665|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192738201291\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02666|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192739200618\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02667|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192739200736\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192740201123\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02669|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192740201371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192741201094\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02671|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192741201219\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02672|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192741258868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02673|poll_loop|INFO|Dropped 12038 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192741258966\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02674|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192742201027\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02675|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192742201163\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02676|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192743201039\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02677|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192743201280\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02678|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192744200763\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02679|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192744200866\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02680|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192744957794\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02681|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789192745201119\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02682|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192745201247\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02683|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192746200789\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02684|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192746201004\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02685|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192747200855\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02686|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192747201103\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02687|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192747258924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02688|poll_loop|INFO|Dropped 12097 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192747259025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02689|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192748200996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02690|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192748201261\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192749200642\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02692|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192749200782\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192750200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02694|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192750201209\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192751201049\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02696|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192751201300\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02697|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192752200731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02698|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192752200843\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192753200655\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02700|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192753200930\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02701|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192753258713\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02702|poll_loop|INFO|Dropped 12363 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192753258832\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02703|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192754200918\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02704|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192754201171\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02705|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192755200969\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02706|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192755201188\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02707|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192756200937\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02708|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192756201044\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02709|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192757200746\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02710|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192757200901\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02711|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192758200523\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02712|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192758200797\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02713|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192758412069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02714|bridge|INFO|bridge br-int: deleted interface veth2a691f0a on port 18\"\n },\n {\n \"at\": \"1789192759200542\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02715|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192759200785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02716|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192759258613\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02717|poll_loop|INFO|Dropped 12164 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192759258662\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02718|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192760200527\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02719|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192760200706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02720|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192760596849\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02721|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789192760596972\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02722|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192761200534\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02723|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192761200634\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02724|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:21.902175+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.097, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734968236\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00131|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734968518\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00132|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12\"\n },\n {\n \"at\": \"1789192744953035\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00133|connmgr|INFO|br-int<->unix#7: 962 flow_mods in the 6 s starting 10 s ago (863 adds, 99 deletes)\"\n },\n {\n \"at\": \"1789192760587233\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00134|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192760587597\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00135|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:22.000684+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.096, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734970297\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734970597\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15\"\n },\n {\n \"at\": \"1789192737323110\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00139|bridge|INFO|bridge br-int: added interface vetha6f26a5a on port 16\"\n },\n {\n \"at\": \"1789192744958184\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00140|connmgr|INFO|br-int<->unix#7: 968 flow_mods in the 6 s starting 10 s ago (872 adds, 96 deletes)\"\n },\n {\n \"at\": \"1789192759355883\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00141|bridge|INFO|bridge br-int: deleted interface vetha6f26a5a on port 16\"\n },\n {\n \"at\": \"1789192760592021\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00142|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192760592255\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00143|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:22.097398+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T05%3A58%3A52.437907%2B00%3A00"], "seconds": 0.095, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192734960169\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00135|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192734960481\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00136|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789192744955688\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00137|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (877 adds, 96 deletes)\"\n },\n {\n \"at\": \"1789192760594793\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00138|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192760595012\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00139|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T05:59:22.192690+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T05:59:22.193693+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/keeper-1/create.stdout.json new file mode 100644 index 0000000..522cd73 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.382, + "first_cross_member_ping_seconds": 3.125, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/cycle.json b/spikes/ovn/diagnosis-2026-09-12/keeper-1/cycle.json new file mode 100644 index 0000000..446c048 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T05:58:52.437907+00:00", + "ended_at": "2026-09-12T05:59:22.193858+00:00", + "seconds": 29.756, + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:ed:13:7f", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.382, + "first_cross_member_ping_seconds": 3.125, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.086 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.092 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"e4d66421-f566-40dc-933b-129bb8f654b2\",\"volatile.eth0.host_name\":\"veth2a691f0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:d1:59:9b\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\",\"volatile.uuid.generation\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T05:58:55.708740699Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"e4d66421-f566-40dc-933b-129bb8f654b2\",\"volatile.eth0.host_name\":\"veth2a691f0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:d1:59:9b\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\",\"volatile.uuid.generation\":\"b325fe46-33b1-464b-a633-5663c93bd9a8\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T05:58:56.58163556Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9662464,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fed1:599b\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":898,\"bytes_sent\":1410,\"packets_received\":5,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:d1:59:9b\",\"host_name\":\"veth2a691f0a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4071042,\"processes\":4,\"cpu\":{\"usage\":485535000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T05:58:55.599999904Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"cdf9b99f-6558-48d7-9534-c8d1975296be\",\"volatile.eth0.host_name\":\"vetha6f26a5a\",\"volatile.eth0.hwaddr\":\"10:66:6a:28:a6:a7\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c1518eb6-924b-4e4f-a795-f1e260088103\",\"volatile.uuid.generation\":\"c1518eb6-924b-4e4f-a795-f1e260088103\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T05:58:56.813195872Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"cdf9b99f-6558-48d7-9534-c8d1975296be\",\"volatile.eth0.host_name\":\"vetha6f26a5a\",\"volatile.eth0.hwaddr\":\"10:66:6a:28:a6:a7\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c1518eb6-924b-4e4f-a795-f1e260088103\",\"volatile.uuid.generation\":\"c1518eb6-924b-4e4f-a795-f1e260088103\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T05:58:57.401372044Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11218944,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe28:a6a7\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1340,\"packets_received\":6,\"packets_sent\":10,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:28:a6:a7\",\"host_name\":\"vetha6f26a5a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":13098,\"processes\":4,\"cpu\":{\"usage\":503057000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T05:58:57.410000085Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.108 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.254 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.176 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.262 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.610 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.345 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.345/0.739/1.262 ms\nelapsed_seconds=2.246 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.982 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.831 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.435 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.435/0.749/0.982 ms\nelapsed_seconds=2.244 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.666 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.803 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.302 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.302/1.590/1.803 ms\nelapsed_seconds=2.301 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.537 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.187 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.104 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.104/1.276/1.537 ms\nelapsed_seconds=2.587 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.571 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.275 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.304 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.334 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.028 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.141790 bytes_per_second=705268354\nelapsed_seconds=0.378 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.516 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.143080 bytes_per_second=698909700\nelapsed_seconds=0.392 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.491 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 44474, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.log", + "bytes": 175247, + "ready_signal": "time=\"2026-09-11T22:58:53-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T05:58:52.930029+00:00", + "stopped_at": "2026-09-12T05:59:01.206914+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 44781, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T05:59:02.271795+00:00", + "stopped_at": "2026-09-12T05:59:16.534361+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 45577, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.log", + "bytes": 40304, + "ready_signal": "time=\"2026-09-11T22:59:17-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T05:59:17.518052+00:00", + "stopped_at": "2026-09-12T05:59:21.136900+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-1" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/keeper-1/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-probe.txt new file mode 100644 index 0000000..0b6f7b0 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-probe.txt @@ -0,0 +1,676 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d1:59:9b | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:28:a6:a7 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 76d12b84-f05e-41fa-96d2-bda91c185aff (incus-net26-ls-int) + port incus-net26-ls-int-lsp-router + type: router + router-port: incus-net26-lr-lrp-int + port incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0 + addresses: ["10:66:6a:d1:59:9b dynamic"] + port incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0 + addresses: ["10:66:6a:28:a6:a7 dynamic"] +switch 621453ed-2996-4acb-965c-5d088e92d1b6 (incus-net26-ls-ext) + port incus-net26-ls-ext-lsp-router + type: router + router-port: incus-net26-lr-lrp-ext + port incus-net26-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 70bc20a5-05b6-44d0-a9ee-0a12e4e7b386 (incus-net26-lr) + port incus-net26-lr-lrp-ext + mac: "10:66:6a:ed:13:7f" + ipv6-lla: "fe80::1266:6aff:feed:137f" + networks: ["10.10.40.65/24"] + port incus-net26-lr-lrp-int + mac: "10:66:6a:ed:13:7f" + ipv6-lla: "fe80::1266:6aff:feed:137f" + networks: ["10.253.73.1/24"] + nat 85877e0f-2f36-4796-90da-753d6830dd72 + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext + Port_Binding cr-incus-net26-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : a6b7de8c-1fab-4849-aa3d-e3850ea5c38a +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ed:13:7f" +name : incus-net26-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 675e74e4-1aa2-425a-8850-037cad86d585 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 6ca9a674-65cd-44a3-a96a-09e92defc83b +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ed:13:7f" +name : incus-net26-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 34e1c355-91e6-46c4-a769-74289fe0d7a0 +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : 85fde4cd-3d5e-4913-9fe9-cd92e27c2ca8 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f49c8969-49c0-48fb-82ba-c247aa389fb0 +logical_port : cr-incus-net26-lr-lrp-ext +mac : ["10:66:6a:ed:13:7f 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net26-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:ed:13:7f REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192733200954", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02650|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192733201218", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192734200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02652|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192734200965", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02653|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192734975878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02654|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192734976090", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02655|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192735200979", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02656|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192735201098", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192735259110", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02658|poll_loop|INFO|Dropped 12547 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192735259220", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02659|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192736200787", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02660|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192736200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192736292421", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02662|bridge|INFO|bridge br-int: added interface veth2a691f0a on port 18" + }, + { + "at": "1789192737200568", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02663|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192737200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192738201046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02665|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192738201291", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02666|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192739200618", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02667|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192739200736", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192740201123", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02669|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192740201371", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192741201094", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02671|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192741201219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02672|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192741258868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02673|poll_loop|INFO|Dropped 12038 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192741258966", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02674|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192742201027", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02675|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192742201163", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02676|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192743201039", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02677|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192743201280", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02678|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192744200763", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02679|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192744200866", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02680|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192744957794", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02681|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)" + }, + { + "at": "1789192745201119", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02682|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192745201247", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02683|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192746200789", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02684|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192746201004", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02685|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192747200855", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02686|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192747201103", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02687|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192747258924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02688|poll_loop|INFO|Dropped 12097 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192747259025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02689|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192748200996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02690|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192748201261", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192749200642", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02692|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192749200782", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192750200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02694|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192750201209", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192751201049", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02696|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192751201300", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02697|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192752200731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02698|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192752200843", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192753200655", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02700|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192753200930", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02701|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192753258713", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02702|poll_loop|INFO|Dropped 12363 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192753258832", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02703|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192754200918", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02704|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192754201171", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02705|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192755200969", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02706|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192755201188", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02707|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192756200937", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02708|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192756201044", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02709|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192757200746", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02710|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192757200901", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02711|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734968236", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00131|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734968518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00132|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192744953035", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00133|connmgr|INFO|br-int<->unix#7: 962 flow_mods in the 6 s starting 10 s ago (863 adds, 99 deletes)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734970297", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734970597", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15" + }, + { + "at": "1789192737323110", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00139|bridge|INFO|bridge br-int: added interface vetha6f26a5a on port 16" + }, + { + "at": "1789192744958184", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00140|connmgr|INFO|br-int<->unix#7: 968 flow_mods in the 6 s starting 10 s ago (872 adds, 96 deletes)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734960169", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00135|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734960481", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00136|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789192744955688", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00137|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (877 adds, 96 deletes)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-teardown.txt new file mode 100644 index 0000000..872f7b0 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-after-teardown.txt @@ -0,0 +1,678 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:ed:13:7f REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192733200954", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02650|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192733201218", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192734200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02652|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192734200965", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02653|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192734975878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02654|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192734976090", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02655|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192735200979", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02656|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192735201098", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192735259110", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02658|poll_loop|INFO|Dropped 12547 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192735259220", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02659|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192736200787", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02660|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192736200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192736292421", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02662|bridge|INFO|bridge br-int: added interface veth2a691f0a on port 18" + }, + { + "at": "1789192737200568", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02663|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192737200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192738201046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02665|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192738201291", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02666|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192739200618", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02667|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192739200736", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192740201123", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02669|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192740201371", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192741201094", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02671|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192741201219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02672|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192741258868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02673|poll_loop|INFO|Dropped 12038 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192741258966", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02674|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192742201027", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02675|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192742201163", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02676|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192743201039", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02677|dpif|WARN|Dropped 1971 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192743201280", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02678|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192744200763", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02679|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192744200866", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02680|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192744957794", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02681|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)" + }, + { + "at": "1789192745201119", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02682|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192745201247", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02683|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192746200789", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02684|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192746201004", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02685|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192747200855", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02686|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192747201103", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02687|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192747258924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02688|poll_loop|INFO|Dropped 12097 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192747259025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02689|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192748200996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02690|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192748201261", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192749200642", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02692|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192749200782", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192750200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02694|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192750201209", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192751201049", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02696|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192751201300", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02697|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192752200731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02698|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192752200843", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192753200655", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02700|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192753200930", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02701|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192753258713", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02702|poll_loop|INFO|Dropped 12363 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192753258832", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02703|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192754200918", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02704|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192754201171", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02705|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192755200969", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02706|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192755201188", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02707|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192756200937", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02708|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192756201044", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02709|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192757200746", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02710|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192757200901", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02711|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192758200523", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02712|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192758200797", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02713|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192758412069", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02714|bridge|INFO|bridge br-int: deleted interface veth2a691f0a on port 18" + }, + { + "at": "1789192759200542", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02715|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192759200785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02716|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192759258613", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02717|poll_loop|INFO|Dropped 12164 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192759258662", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02718|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192760200527", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02719|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192760200706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02720|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192760596849", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02721|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192760596972", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02722|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192761200534", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02723|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192761200634", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02724|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734968236", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00131|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734968518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00132|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12" + }, + { + "at": "1789192744953035", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00133|connmgr|INFO|br-int<->unix#7: 962 flow_mods in the 6 s starting 10 s ago (863 adds, 99 deletes)" + }, + { + "at": "1789192760587233", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00134|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192760587597", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00135|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734970297", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734970597", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15" + }, + { + "at": "1789192737323110", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00139|bridge|INFO|bridge br-int: added interface vetha6f26a5a on port 16" + }, + { + "at": "1789192744958184", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00140|connmgr|INFO|br-int<->unix#7: 968 flow_mods in the 6 s starting 10 s ago (872 adds, 96 deletes)" + }, + { + "at": "1789192759355883", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00141|bridge|INFO|bridge br-int: deleted interface vetha6f26a5a on port 16" + }, + { + "at": "1789192760592021", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00142|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192760592255", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00143|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734960169", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00135|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734960481", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00136|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789192744955688", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00137|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (877 adds, 96 deletes)" + }, + { + "at": "1789192760594793", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00138|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192760595012", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00139|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-before-probe.txt new file mode 100644 index 0000000..72e9966 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/diagnostics-before-probe.txt @@ -0,0 +1,436 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:d1:59:9b | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:28:a6:a7 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 76d12b84-f05e-41fa-96d2-bda91c185aff (incus-net26-ls-int) + port incus-net26-ls-int-lsp-router + type: router + router-port: incus-net26-lr-lrp-int + port incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0 + addresses: ["10:66:6a:d1:59:9b dynamic"] + port incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0 + addresses: ["10:66:6a:28:a6:a7 dynamic"] +switch 621453ed-2996-4acb-965c-5d088e92d1b6 (incus-net26-ls-ext) + port incus-net26-ls-ext-lsp-router + type: router + router-port: incus-net26-lr-lrp-ext + port incus-net26-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 70bc20a5-05b6-44d0-a9ee-0a12e4e7b386 (incus-net26-lr) + port incus-net26-lr-lrp-ext + mac: "10:66:6a:ed:13:7f" + ipv6-lla: "fe80::1266:6aff:feed:137f" + networks: ["10.10.40.65/24"] + port incus-net26-lr-lrp-int + mac: "10:66:6a:ed:13:7f" + ipv6-lla: "fe80::1266:6aff:feed:137f" + networks: ["10.253.73.1/24"] + nat 85877e0f-2f36-4796-90da-753d6830dd72 + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net26-instance-c1518eb6-924b-4e4f-a795-f1e260088103-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext + Port_Binding cr-incus-net26-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net26-instance-b325fe46-33b1-464b-a633-5663c93bd9a8-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : a6b7de8c-1fab-4849-aa3d-e3850ea5c38a +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ed:13:7f" +name : incus-net26-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 675e74e4-1aa2-425a-8850-037cad86d585 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 6ca9a674-65cd-44a3-a96a-09e92defc83b +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ed:13:7f" +name : incus-net26-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 34e1c355-91e6-46c4-a769-74289fe0d7a0 +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : 85fde4cd-3d5e-4913-9fe9-cd92e27c2ca8 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f49c8969-49c0-48fb-82ba-c247aa389fb0 +logical_port : cr-incus-net26-lr-lrp-ext +mac : ["10:66:6a:ed:13:7f 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net26-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:ed:13:7f REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192733200954", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02650|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192733201218", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192734200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02652|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192734200965", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02653|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192734975878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02654|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789192734976090", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02655|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192735200979", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02656|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192735201098", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192735259110", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02658|poll_loop|INFO|Dropped 12547 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192735259220", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02659|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192736200787", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02660|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192736200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192736292421", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02662|bridge|INFO|bridge br-int: added interface veth2a691f0a on port 18" + }, + { + "at": "1789192737200568", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02663|dpif|WARN|Dropped 1944 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192737200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02664|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192738201046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02665|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192738201291", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02666|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192739200618", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02667|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192739200736", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02668|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192740201123", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02669|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192740201371", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02670|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192741201094", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02671|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192741201219", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02672|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192741258868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02673|poll_loop|INFO|Dropped 12038 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192741258966", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02674|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734968236", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00131|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734968518", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00132|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 12" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734970297", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734970597", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 15" + }, + { + "at": "1789192737323110", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00139|bridge|INFO|bridge br-int: added interface vetha6f26a5a on port 16" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192734960169", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00135|bridge|INFO|bridge incusovn16: added interface patch-incus-net26-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192734960481", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00136|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net26-ls-ext-lsp-provider on port 14" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.debug.log new file mode 100644 index 0000000..4e211f7 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-11T22:58:53-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.log new file mode 100644 index 0000000..36c68a3 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-create.log @@ -0,0 +1,539 @@ +time="2026-09-12T05:58:53Z" level=debug msg="[nas01] Event listener server handler started" id=bc93fb1a-5afc-454d-8ebf-d5661d511481 local="10.10.10.14:8443" remote="100.122.142.76:61647" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61665" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61666" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61667" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61668" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61669" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61670" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61671" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61672" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61673" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61674" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:ed:13:7f" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.26 +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net26 driver=ovn memberID=1 network=default priority=31628 project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" network=default project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T05:58:54Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61675" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61676" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61677" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61678" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61679" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61680" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61681" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61682" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61683" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Event listener server handler started" id=d9b24420-f227-43a1-a699-9f86737367f4 local="10.10.10.14:8443" remote="100.122.142.76:61683" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61684" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=74da49a5-1f6c-4414-b800-95bd5ea72eec project=image-build +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=74da49a5-1f6c-4414-b800-95bd5ea72eec project=image-build +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61685" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Event listener server handler started" id=a9f0a485-7d94-4aef-a10e-7272331a158e local="10.10.10.14:8443" remote="100.122.142.76:61685" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61686" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=3236daa0-79ae-4b79-944c-5fbcd8d1094f project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=3236daa0-79ae-4b79-944c-5fbcd8d1094f project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61687" method=GET protocol=tls url="/1.0/operations/3236daa0-79ae-4b79-944c-5fbcd8d1094f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=3236daa0-79ae-4b79-944c-5fbcd8d1094f project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=3236daa0-79ae-4b79-944c-5fbcd8d1094f project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d9b24420-f227-43a1-a699-9f86737367f4 local="10.10.10.14:8443" remote="100.122.142.76:61683" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a9f0a485-7d94-4aef-a10e-7272331a158e local="10.10.10.14:8443" remote="100.122.142.76:61685" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61688" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61689" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"fad06a5b-908b-4032-aa44-9c3efae286bd\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T05:58:55.696905664Z\",\n\t\t\"updated_at\": \"2026-09-12T05:58:55.696905664Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61690" method=GET protocol=tls url="/1.0/operations/fad06a5b-908b-4032-aa44-9c3efae286bd/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:55Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T05:58:55Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61692" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61693" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61694" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Event listener server handler started" id=343f4c07-b3f3-4e21-8bf4-5dbcc57692bf local="10.10.10.14:8443" remote="100.122.142.76:61694" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61695" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:56Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 05:58:55.708740699 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61696" method=GET protocol=tls url="/1.0/operations/78c557ad-f13f-49f4-8842-7d24186fc1ae?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T05:58:56Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 05:58:55.708740699 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Event listener server handler stopped" listener=343f4c07-b3f3-4e21-8bf4-5dbcc57692bf local="10.10.10.14:8443" remote="100.122.142.76:61694" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61697" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61698" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"ec0d1eff-8954-45fa-b0be-6277b2b43b5b\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T05:58:56.766877596Z\",\n\t\t\"updated_at\": \"2026-09-12T05:58:56.766877596Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61699" method=GET protocol=tls url="/1.0/operations/ec0d1eff-8954-45fa-b0be-6277b2b43b5b/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:56Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T05:58:56Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T05:58:56Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.65 network=default project=ac-ovn-spike +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61700" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61701" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61702" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Event listener server handler started" id=a8ee766d-6fd5-41de-b25a-ce6b27ceefd2 local="10.10.10.14:8443" remote="100.122.142.76:61702" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61703" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:57Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 05:58:56.813195872 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61704" method=GET protocol=tls url="/1.0/operations/57db21b8-bbfc-4198-a417-1f5ca4e2fdbb?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:57Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 05:58:56.813195872 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a8ee766d-6fd5-41de-b25a-ce6b27ceefd2 local="10.10.10.14:8443" remote="100.122.142.76:61702" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61705" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61706" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61707" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61708" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61709" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61710" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61711" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61712" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61713" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61714" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Event listener server handler started" id=10279fd4-ced7-429d-9805-32b6d9ea5f03 local="10.10.10.14:8443" remote="100.122.142.76:61714" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61715" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61716" method=GET protocol=tls url="/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=559385a04f8809c9570bc61ef4122cf78d64798c5113700bfcaadc9ec556f924" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=559385a04f8809c9570bc61ef4122cf78d64798c5113700bfcaadc9ec556f924" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61716" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61717" method=GET protocol=tls url="/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=67d6fed258ac739a27b5c01ffedb9e33d0bdf688f088dd31f5eff08bd9f54ce4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=67d6fed258ac739a27b5c01ffedb9e33d0bdf688f088dd31f5eff08bd9f54ce4" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61717" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61718" method=GET protocol=tls url="/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=6d07e00a2e428ced2a1d59eaa874d7eac9bdc981372fe3a45c8524191d257c22" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61718" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=6d07e00a2e428ced2a1d59eaa874d7eac9bdc981372fe3a45c8524191d257c22" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61719" method=GET protocol=tls url="/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=6cda1f6cf246dd0663a9e2bb779c3a335a4cfc2d8350b9abd7e066eb71167706" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61719" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520/websocket?secret=6cda1f6cf246dd0663a9e2bb779c3a335a4cfc2d8350b9abd7e066eb71167706" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61717" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61720" method=GET protocol=tls url="/1.0/operations/712f7257-8b95-4a2d-a1b0-81bec2ea5520?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61719" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61716" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61718" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Event listener server handler stopped" listener=10279fd4-ced7-429d-9805-32b6d9ea5f03 local="10.10.10.14:8443" remote="100.122.142.76:61714" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61721" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61722" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61723" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61724" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Event listener server handler started" id=4934c51c-d5d7-4463-a7b8-af7fee9428c7 local="10.10.10.14:8443" remote="100.122.142.76:61724" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61725" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61727" method=GET protocol=tls url="/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=e542dffb032a7723889b77cf7742b8d545bf45f33a45f92dd10b033ce785563c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=e542dffb032a7723889b77cf7742b8d545bf45f33a45f92dd10b033ce785563c" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61727" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61728" method=GET protocol=tls url="/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=b13382d7ac89023b02f9d61ea9cc35a189208769354e72174e041559c91edabf" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=b13382d7ac89023b02f9d61ea9cc35a189208769354e72174e041559c91edabf" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61728" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61729" method=GET protocol=tls url="/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=1eaed0a89b5f761e937c004a53267078a2b2153075357046776dd94864fdceb6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=1eaed0a89b5f761e937c004a53267078a2b2153075357046776dd94864fdceb6" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61729" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61730" method=GET protocol=tls url="/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=fe4ef8f02c16ec03729ad36e0a0c4b8100b8e9797bc3e3ab3e901eb9169add8e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61730" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea/websocket?secret=fe4ef8f02c16ec03729ad36e0a0c4b8100b8e9797bc3e3ab3e901eb9169add8e" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61728" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61731" method=GET protocol=tls url="/1.0/operations/2c52b34b-3743-45b3-8753-f3a4e2dbc8ea?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61730" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61727" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61729" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Event listener server handler stopped" listener=4934c51c-d5d7-4463-a7b8-af7fee9428c7 local="10.10.10.14:8443" remote="100.122.142.76:61724" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61732" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61733" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Event listener server handler started" id=fc8a05d9-46ff-4fd3-829c-b77467d9e69f local="10.10.10.14:8443" remote="100.122.142.76:61733" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61734" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:58:58Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61735" method=GET protocol=tls url="/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=e5be06c9ed930e4349e8129b83089279bc50db553ad1db8fba95d754dc5d259a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61735" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=e5be06c9ed930e4349e8129b83089279bc50db553ad1db8fba95d754dc5d259a" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61736" method=GET protocol=tls url="/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=a5f711f21a0cb71fdb897ec34fc22c95985598e447ba78193935149fa52ebc64" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=a5f711f21a0cb71fdb897ec34fc22c95985598e447ba78193935149fa52ebc64" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61736" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61737" method=GET protocol=tls url="/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=23e71d20194b1fd0fd9d1f87e2579641e148ad3ffcdd21a9dea8c3009ed9fd05" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=23e71d20194b1fd0fd9d1f87e2579641e148ad3ffcdd21a9dea8c3009ed9fd05" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61737" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61738" method=GET protocol=tls url="/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=32723ca85633f644652c8a5d895a01a601ed18d9ba96c8bcbc23693934305185" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61738" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff/websocket?secret=32723ca85633f644652c8a5d895a01a601ed18d9ba96c8bcbc23693934305185" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61736" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61739" method=GET protocol=tls url="/1.0/operations/19febbc7-3c35-4552-8652-b1af23bbc1ff?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61735" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61737" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61738" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Event listener server handler stopped" listener=fc8a05d9-46ff-4fd3-829c-b77467d9e69f local="10.10.10.14:8443" remote="100.122.142.76:61733" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61740" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61741" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61742" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61743" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Event listener server handler started" id=5dbbb708-dfe3-43a4-9acb-cfc6eccdfafd local="10.10.10.14:8443" remote="100.122.142.76:61743" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61744" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61745" method=GET protocol=tls url="/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=68b84cba3b08f5c49ce49bc3b9354639dd9fad7f820b45fc7105a71191772921" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61745" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=68b84cba3b08f5c49ce49bc3b9354639dd9fad7f820b45fc7105a71191772921" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61746" method=GET protocol=tls url="/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=a565978b999cd9463e555ccd95c7c0404510f51204126276b99d269bfc2527d4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=a565978b999cd9463e555ccd95c7c0404510f51204126276b99d269bfc2527d4" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61746" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61747" method=GET protocol=tls url="/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=f32f66e8a6d308ce9daad9382570c444cfdb370a950c3f5f2af19d42ea74f3b9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=f32f66e8a6d308ce9daad9382570c444cfdb370a950c3f5f2af19d42ea74f3b9" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61747" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61748" method=GET protocol=tls url="/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=000d9076da582cd25e9ba85e750ffd7b85b9754c1579dc0a3c6f300945834a3d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61748" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1/websocket?secret=000d9076da582cd25e9ba85e750ffd7b85b9754c1579dc0a3c6f300945834a3d" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61746" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61749" method=GET protocol=tls url="/1.0/operations/c2452193-0871-4b06-9ef5-70c13bfef1a1?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61748" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61747" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61745" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Event listener server handler stopped" listener=5dbbb708-dfe3-43a4-9acb-cfc6eccdfafd local="10.10.10.14:8443" remote="100.122.142.76:61743" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61750" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61751" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Event listener server handler started" id=c1d80f90-f25f-4cbf-8e15-a8b7df0ce7f5 local="10.10.10.14:8443" remote="100.122.142.76:61751" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61752" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61753" method=GET protocol=tls url="/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=c66c20a24a7edda1e0aea7d0e9da8e76feba56393d687cbad579102c0fc861a5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=c66c20a24a7edda1e0aea7d0e9da8e76feba56393d687cbad579102c0fc861a5" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61753" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61754" method=GET protocol=tls url="/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=e87774b3f2c97676a5633a014ae4637b3c1ac15e5a2b8ca5845922a88d17b489" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=e87774b3f2c97676a5633a014ae4637b3c1ac15e5a2b8ca5845922a88d17b489" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61754" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61755" method=GET protocol=tls url="/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=ca50c9eee520cb2a3c96364fc78901a8db0a085eff55c211521f7b165fc14280" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61755" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=ca50c9eee520cb2a3c96364fc78901a8db0a085eff55c211521f7b165fc14280" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61756" method=GET protocol=tls url="/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=7a416b846c82f05968438c64d70f277ebd14f1866a8ad1588a9d1b46e438f086" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61756" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37/websocket?secret=7a416b846c82f05968438c64d70f277ebd14f1866a8ad1588a9d1b46e438f086" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61754" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61757" method=GET protocol=tls url="/1.0/operations/d82e71b1-8498-4c3e-9e92-ab046b0b6a37?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61753" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61756" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61755" +time="2026-09-12T05:58:59Z" level=debug msg="[nas01] Event listener server handler stopped" listener=c1d80f90-f25f-4cbf-8e15-a8b7df0ce7f5 local="10.10.10.14:8443" remote="100.122.142.76:61751" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61758" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61759" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Event listener server handler started" id=fc6b7e34-ecba-4596-903e-5cbd426c133c local="10.10.10.14:8443" remote="100.122.142.76:61759" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61760" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61761" method=GET protocol=tls url="/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=e6bfdb925e928064f9797f61dfb87a0487d69e91c64083ca60f6b827e7d4a4b1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61761" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=e6bfdb925e928064f9797f61dfb87a0487d69e91c64083ca60f6b827e7d4a4b1" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61762" method=GET protocol=tls url="/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=b2f76e71092ecff7c3f257eeeb8ab05de8bd66ba85317cea3bd4655a96f3c377" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61762" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=b2f76e71092ecff7c3f257eeeb8ab05de8bd66ba85317cea3bd4655a96f3c377" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61763" method=GET protocol=tls url="/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=96a88e339b905b629b72257b8d3f28d89162338cab4c90f7dde6751fcf52412d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61763" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=96a88e339b905b629b72257b8d3f28d89162338cab4c90f7dde6751fcf52412d" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61764" method=GET protocol=tls url="/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=fa1a231ea66874a5c518a6692c79d65fc9a98d9c535f37450d6ba1b5ba33aa5f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:61764" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c/websocket?secret=fa1a231ea66874a5c518a6692c79d65fc9a98d9c535f37450d6ba1b5ba33aa5f" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61762" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61765" method=GET protocol=tls url="/1.0/operations/cc63093a-f4a9-431c-9887-8e237749610c?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61763" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61764" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:61761" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Event listener server handler stopped" listener=fc6b7e34-ecba-4596-903e-5cbd426c133c local="10.10.10.14:8443" remote="100.122.142.76:61759" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61766" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61767" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Event listener server handler started" id=487083ec-0c3b-4a92-9b7e-7a8d45d56060 local="10.10.10.14:8443" remote="100.122.142.76:61767" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61768" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61769" method=GET protocol=tls url="/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=15f302fb73bfec727bb71f02fb96ba84d6cc15da0f476f99dac7fd94683bb346" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=15f302fb73bfec727bb71f02fb96ba84d6cc15da0f476f99dac7fd94683bb346" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61769" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61770" method=GET protocol=tls url="/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=78dba206bb135a575123ef1a4a80c7b9c3a8ca5eca8d444626d81a2322c9bfbc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61770" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=78dba206bb135a575123ef1a4a80c7b9c3a8ca5eca8d444626d81a2322c9bfbc" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61771" method=GET protocol=tls url="/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=86dcca001906d7bdabfa0eaf484d895620046225db7495246967db160bf6f43f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=86dcca001906d7bdabfa0eaf484d895620046225db7495246967db160bf6f43f" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61771" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61772" method=GET protocol=tls url="/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=e49ad5a0817a3edac265b96c322f833545d079b9330aae2a2c04b5c38a0a0840" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:61772" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91/websocket?secret=e49ad5a0817a3edac265b96c322f833545d079b9330aae2a2c04b5c38a0a0840" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61770" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61773" method=GET protocol=tls url="/1.0/operations/8777a584-649e-44e4-a418-458bc5e3df91?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61771" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61769" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:61772" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=487083ec-0c3b-4a92-9b7e-7a8d45d56060 local="10.10.10.14:8443" remote="100.122.142.76:61767" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61774" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61775" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T05:59:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.debug.log new file mode 100644 index 0000000..3bd65d5 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-11T22:59:17-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.log new file mode 100644 index 0000000..022dd6e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/monitor-delete.log @@ -0,0 +1,166 @@ +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Event listener server handler started" id=f8a39aee-600d-49ee-b751-9562737e66f1 local="10.10.10.14:8443" remote="100.122.142.76:61945" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61946" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61947" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61948" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61949" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T05:58:56.813195872Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T05:58:57.401372044Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T05:58:55.708740699Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T05:58:56.58163556Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61950" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61951" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:17Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Event listener server handler started" id=f583f3a7-ba9a-4c58-bd2c-7bcbdb453f98 local="10.10.10.14:8443" remote="100.122.142.76:61952" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61952" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61953" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:18Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 05:58:55.708740699 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 05:58:56.58163556 +0000 UTC" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61954" method=GET protocol=tls url="/1.0/operations/679fa374-54bd-4d15-aae6-fe2544a4a185?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61955" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:19Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 05:58:55.708740699 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 05:58:56.58163556 +0000 UTC" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61956" method=GET protocol=tls url="/1.0/operations/9a517917-63b3-435c-9213-3b523e2d24a0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 05:58:55.708740699 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 05:58:56.58163556 +0000 UTC" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Event listener server handler stopped" listener=f583f3a7-ba9a-4c58-bd2c-7bcbdb453f98 local="10.10.10.14:8443" remote="100.122.142.76:61952" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61957" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61958" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61959" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Event listener server handler started" id=157e26b7-b16c-43e7-9511-09660f494a39 local="10.10.10.14:8443" remote="100.122.142.76:61959" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61960" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:19Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 05:58:56.813195872 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 05:58:57.401372044 +0000 UTC" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61961" method=GET protocol=tls url="/1.0/operations/63ed4019-dd1d-4969-a38c-bd29001d255c?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61962" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:20Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 05:58:56.813195872 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 05:58:57.401372044 +0000 UTC" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61963" method=GET protocol=tls url="/1.0/operations/b5c81a24-ca5a-4efb-9196-65e486e3156b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T05:59:20Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 05:58:56.813195872 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 05:58:57.401372044 +0000 UTC" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Event listener server handler stopped" listener=157e26b7-b16c-43e7-9511-09660f494a39 local="10.10.10.14:8443" remote="100.122.142.76:61959" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61964" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61965" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61966" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61967" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61968" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61969" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61970" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61971" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61972" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61973" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61974" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61975" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61976" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61977" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61978" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61979" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61980" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Event listener server handler started" id=542719e0-e667-4d8e-a220-24755d469b1e local="10.10.10.14:8443" remote="100.122.142.76:61980" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61981" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=86fa70ff-ddf2-4e6e-b142-e079eb3ffed9 project=ac-ovn-spike +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=86fa70ff-ddf2-4e6e-b142-e079eb3ffed9 project=ac-ovn-spike +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=86fa70ff-ddf2-4e6e-b142-e079eb3ffed9 project=ac-ovn-spike +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61982" method=GET protocol=tls url="/1.0/operations/86fa70ff-ddf2-4e6e-b142-e079eb3ffed9?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Event listener server handler stopped" listener=542719e0-e667-4d8e-a220-24755d469b1e local="10.10.10.14:8443" remote="100.122.142.76:61980" +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61983" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:61984" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T05:59:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-1/probe.stdout.txt new file mode 100644 index 0000000..be31bae --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/probe.stdout.txt @@ -0,0 +1,137 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.086 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.092 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"e4d66421-f566-40dc-933b-129bb8f654b2","volatile.eth0.host_name":"veth2a691f0a","volatile.eth0.hwaddr":"10:66:6a:d1:59:9b","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"b325fe46-33b1-464b-a633-5663c93bd9a8","volatile.uuid.generation":"b325fe46-33b1-464b-a633-5663c93bd9a8"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T05:58:55.708740699Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"e4d66421-f566-40dc-933b-129bb8f654b2","volatile.eth0.host_name":"veth2a691f0a","volatile.eth0.hwaddr":"10:66:6a:d1:59:9b","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"b325fe46-33b1-464b-a633-5663c93bd9a8","volatile.uuid.generation":"b325fe46-33b1-464b-a633-5663c93bd9a8"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T05:58:56.58163556Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9662464,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fed1:599b","netmask":"64","scope":"link"}],"counters":{"bytes_received":898,"bytes_sent":1410,"packets_received":5,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:d1:59:9b","host_name":"veth2a691f0a","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4071042,"processes":4,"cpu":{"usage":485535000,"allocated_time":24000000000},"started_at":"2026-09-12T05:58:55.599999904Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"cdf9b99f-6558-48d7-9534-c8d1975296be","volatile.eth0.host_name":"vetha6f26a5a","volatile.eth0.hwaddr":"10:66:6a:28:a6:a7","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"c1518eb6-924b-4e4f-a795-f1e260088103","volatile.uuid.generation":"c1518eb6-924b-4e4f-a795-f1e260088103"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T05:58:56.813195872Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"cdf9b99f-6558-48d7-9534-c8d1975296be","volatile.eth0.host_name":"vetha6f26a5a","volatile.eth0.hwaddr":"10:66:6a:28:a6:a7","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"c1518eb6-924b-4e4f-a795-f1e260088103","volatile.uuid.generation":"c1518eb6-924b-4e4f-a795-f1e260088103"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T05:58:57.401372044Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11218944,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe28:a6a7","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1340,"packets_received":6,"packets_sent":10,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:28:a6:a7","host_name":"vetha6f26a5a","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":13098,"processes":4,"cpu":{"usage":503057000,"allocated_time":24000000000},"started_at":"2026-09-12T05:58:57.410000085Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.108 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.254 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.176 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.262 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.610 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.345 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.345/0.739/1.262 ms +elapsed_seconds=2.246 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.982 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.831 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.435 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.435/0.749/0.982 ms +elapsed_seconds=2.244 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.666 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.803 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.302 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 1.302/1.590/1.803 ms +elapsed_seconds=2.301 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.537 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.187 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.104 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 1.104/1.276/1.537 ms +elapsed_seconds=2.587 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Non-authoritative answer: +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +Non-authoritative answer: +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +elapsed_seconds=0.571 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.275 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.304 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.334 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.028 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.141790 bytes_per_second=705268354 +elapsed_seconds=0.378 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.516 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.143080 bytes_per_second=698909700 +elapsed_seconds=0.392 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.491 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/keeper-1/tcpdump-arp.log new file mode 100644 index 0000000..b06ec3f --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +05:59:02.958087 10:66:6a:ed:13:7f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.65 tell 10.10.40.65, length 46 +05:59:10.958162 10:66:6a:ed:13:7f > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.65 tell 10.10.40.65, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-1/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/keeper-1/topology.jsonl new file mode 100644 index 0000000..954f1f2 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-1/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/keeper\"\n\t]\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.305, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.382, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.083, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.235, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.475, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T05:58:55.696905664Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"fad06a5b-908b-4032-aa44-9c3efae286bd\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T05:58:55.696905664Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.593, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.431, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T05:58:56.766877596Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"ec0d1eff-8954-45fa-b0be-6277b2b43b5b\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T05:58:56.766877596Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.371, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.206, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 139132000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 5820416,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fed1:599b\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth2a691f0a\",\n\t\t\t\"hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4071042,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T05:58:55.599999904Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.204, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 129968000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6606848,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe28:a6a7\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 864,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"vetha6f26a5a\",\n\t\t\t\"hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 13098,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T05:58:57.410000085Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t},\n\t\"created_at\": \"2026-09-12T05:58:55.708740699Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T05:58:56.58163556Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t},\n\t\"created_at\": \"2026-09-12T05:58:56.813195872Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T05:58:57.401372044Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.235, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.860 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.860/1.860/1.860 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.345, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.202, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.263, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.353, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-n96nvkaj/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.211, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.297, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.531, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.027262 seconds, 3.4GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.575, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.030479 seconds, 3.1GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.132, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:58:55.708740699Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"e4d66421-f566-40dc-933b-129bb8f654b2\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a691f0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:d1:59:9b\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\",\n\t\t\t\"volatile.uuid.generation\": \"b325fe46-33b1-464b-a633-5663c93bd9a8\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:58:56.58163556Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T05:58:56.813195872Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"cdf9b99f-6558-48d7-9534-c8d1975296be\",\n\t\t\t\"volatile.eth0.host_name\": \"vetha6f26a5a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:28:a6:a7\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c1518eb6-924b-4e4f-a795-f1e260088103\",\n\t\t\t\"volatile.uuid.generation\": \"c1518eb6-924b-4e4f-a795-f1e260088103\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T05:58:57.401372044Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.282, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.964, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.082, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.139, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.179, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.081, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.085, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T05:58:56.850500752Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T05:58:55.588406109Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.169, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.106, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/keeper-2/commands.jsonl new file mode 100644 index 0000000..d35d253 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.118, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:01:14.634286+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.299, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:01:14.933684+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.109, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T06:01:15.043082+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 51200, "ready": true, "ready_signal": "time=\"2026-09-11T23:01:15-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:01:15.141609+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/topology.jsonl", "create"], "seconds": 9.079, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.65\",\n \"network_create_seconds\": 0.374,\n \"first_cross_member_ping_seconds\": 3.757,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:24.221509+00:00"} +{"capture": "monitor-create", "pid": 51200, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.log", "ready_signal": "time=\"2026-09-11T23:01:15-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:01:24.225990+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.098, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:24.324991+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.101, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b7:f2:39 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:6f:4a:91 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:24.426470+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.124, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 6430010c-10da-4ccb-bf7c-21d047adad24 (incus-net27-ls-int)\n port incus-net27-ls-int-lsp-router\n type: router\n router-port: incus-net27-lr-lrp-int\n port incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0\n addresses: [\"10:66:6a:6f:4a:91 dynamic\"]\n port incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0\n addresses: [\"10:66:6a:b7:f2:39 dynamic\"]\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch f63c7c52-7dfa-48df-9ac4-d4a0b682408f (incus-net27-ls-ext)\n port incus-net27-ls-ext-lsp-router\n type: router\n router-port: incus-net27-lr-lrp-ext\n port incus-net27-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\nrouter 1205bbee-2400-4483-b1eb-ae248961a3d2 (incus-net27-lr)\n port incus-net27-lr-lrp-int\n mac: \"10:66:6a:6c:ad:18\"\n ipv6-lla: \"fe80::1266:6aff:fe6c:ad18\"\n networks: [\"10.253.73.1/24\"]\n port incus-net27-lr-lrp-ext\n mac: \"10:66:6a:6c:ad:18\"\n ipv6-lla: \"fe80::1266:6aff:fe6c:ad18\"\n networks: [\"10.10.40.65/24\"]\n nat 873e144a-9aa1-4c68-9aea-fbfbc2a892b1\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net27-lr-lrp-ext\n Port_Binding incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 3560a748-fd5b-44b5-ad95-485444a35d8c\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : fca3c7b3-d9cf-44a8-9d37-9968cafee7a1\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:6c:ad:18\"\nname : incus-net27-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"}\n\n_uuid : 0acff935-6775-4d8a-ac11-902fa4246526\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:6c:ad:18\"\nname : incus-net27-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : d740ae00-07c8-4056-b1b3-1f19ca56e9b8\nadditional_chassis : []\nadditional_encap : []\nchassis : 6d5bda8d-4911-4009-98ed-81ad0f344956\ndatapath : 936eae27-2fc0-476c-b34a-a6e190436038\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 0a7d4358-5ce2-4052-a851-49d42e6b7b45\nlogical_port : cr-incus-net27-lr-lrp-ext\nmac : [\"10:66:6a:6c:ad:18 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net27-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:24.551229+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.303, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T06:01:24.855024+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.117, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192875200784\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02994|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192875200897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02995|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192876200951\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02996|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192876201151\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02997|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192877200621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02998|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192877200791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02999|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192877299410\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03000|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192877299621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03001|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192878200785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03002|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192878200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03003|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192878796143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03004|bridge|INFO|bridge br-int: added interface veth010203a2 on port 20\"\n },\n {\n \"at\": \"1789192879200767\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03005|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192879200877\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192879258591\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03007|poll_loop|INFO|Dropped 12483 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192879258656\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03008|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192880201059\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03009|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192880201380\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03010|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192881200639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03011|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192881200760\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192882200654\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03013|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192882200878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192883200693\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03015|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192883201126\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192884200728\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03017|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192884200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:24.972860+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.113, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877292307\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877292673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:25.086423+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.117, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877296494\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00145|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877296674\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192879799198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00147|bridge|INFO|bridge br-int: added interface veth31450499 on port 18\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:25.203654+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877284005\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00141|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877284330\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00142|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:25.311603+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-before-probe.txt", "router_mac": "10:66:6a:6c:ad:18", "at": "2026-09-12T06:01:25.312101+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.111, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:01:18.201764318Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:01:18.941957555Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:01:19.257703529Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:01:19.879984211Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:25.423243+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.65"], "capture": "tcpdump-arp", "pid": 51732, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T06:01:25.537335+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.996, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.101 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.091 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\"volatile.eth0.host_name\":\"veth010203a2\",\"volatile.eth0.hwaddr\":\"10:66:6a:b7:f2:39\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"23118153-0b00-400d-badb-e44ba120d12f\",\"volatile.uuid.generation\":\"23118153-0b00-400d-badb-e44ba120d12f\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:01:18.201764318Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\"volatile.eth0.host_name\":\"veth010203a2\",\"volatile.eth0.hwaddr\":\"10:66:6a:b7:f2:39\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"23118153-0b00-400d-badb-e44ba120d12f\",\"volatile.uuid.generation\":\"23118153-0b00-400d-badb-e44ba120d12f\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:01:18.941957555Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":10010624,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:feb7:f239\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":898,\"bytes_sent\":1410,\"packets_received\":5,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:b7:f2:39\",\"host_name\":\"veth010203a2\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4072162,\"processes\":4,\"cpu\":{\"usage\":504800000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:01:17.960000038Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"fdf20d0e-edee-459d-8e1d-371803c51632\",\"volatile.eth0.host_name\":\"veth31450499\",\"volatile.eth0.hwaddr\":\"10:66:6a:6f:4a:91\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\"volatile.uuid.generation\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:01:19.257703529Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"fdf20d0e-edee-459d-8e1d-371803c51632\",\"volatile.eth0.host_name\":\"veth31450499\",\"volatile.eth0.hwaddr\":\"10:66:6a:6f:4a:91\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\"volatile.uuid.generation\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:01:19.879984211Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11890688,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe6f:4a91\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1340,\"packets_received\":6,\"packets_sent\":10,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:6f:4a:91\",\"host_name\":\"veth31450499\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":13802,\"processes\":4,\"cpu\":{\"usage\":511866000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:01:19.890000104Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.120 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.617 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.224 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.112 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.767 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.447 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.447/0.775/1.112 ms\nelapsed_seconds=2.267 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.413 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.678 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.332 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.332/0.807/1.413 ms\nelapsed_seconds=2.279 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.511 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.478 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.816 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.816/1.601/2.511 ms\nelapsed_seconds=2.792 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.465 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.049 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.687 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.687/1.067/1.465 ms\nelapsed_seconds=2.329 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.492 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.296 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.368 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.376 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.034 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.109130 bytes_per_second=916338312\nelapsed_seconds=0.376 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.528 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.115897 bytes_per_second=862835103\nelapsed_seconds=0.402 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.524 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:40.533896+00:00"} +{"capture": "tcpdump-arp", "pid": 51732, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T06:01:40.536015+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.1, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:40.635713+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.092, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b7:f2:39 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:6f:4a:91 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:40.728423+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.125, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 6430010c-10da-4ccb-bf7c-21d047adad24 (incus-net27-ls-int)\n port incus-net27-ls-int-lsp-router\n type: router\n router-port: incus-net27-lr-lrp-int\n port incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0\n addresses: [\"10:66:6a:6f:4a:91 dynamic\"]\n port incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0\n addresses: [\"10:66:6a:b7:f2:39 dynamic\"]\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch f63c7c52-7dfa-48df-9ac4-d4a0b682408f (incus-net27-ls-ext)\n port incus-net27-ls-ext-lsp-router\n type: router\n router-port: incus-net27-lr-lrp-ext\n port incus-net27-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\nrouter 1205bbee-2400-4483-b1eb-ae248961a3d2 (incus-net27-lr)\n port incus-net27-lr-lrp-int\n mac: \"10:66:6a:6c:ad:18\"\n ipv6-lla: \"fe80::1266:6aff:fe6c:ad18\"\n networks: [\"10.253.73.1/24\"]\n port incus-net27-lr-lrp-ext\n mac: \"10:66:6a:6c:ad:18\"\n ipv6-lla: \"fe80::1266:6aff:fe6c:ad18\"\n networks: [\"10.10.40.65/24\"]\n nat 873e144a-9aa1-4c68-9aea-fbfbc2a892b1\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net27-lr-lrp-ext\n Port_Binding incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 3560a748-fd5b-44b5-ad95-485444a35d8c\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : fca3c7b3-d9cf-44a8-9d37-9968cafee7a1\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:6c:ad:18\"\nname : incus-net27-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"}\n\n_uuid : 0acff935-6775-4d8a-ac11-902fa4246526\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:6c:ad:18\"\nname : incus-net27-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : d740ae00-07c8-4056-b1b3-1f19ca56e9b8\nadditional_chassis : []\nadditional_encap : []\nchassis : 6d5bda8d-4911-4009-98ed-81ad0f344956\ndatapath : 936eae27-2fc0-476c-b34a-a6e190436038\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 0a7d4358-5ce2-4052-a851-49d42e6b7b45\nlogical_port : cr-incus-net27-lr-lrp-ext\nmac : [\"10:66:6a:6c:ad:18 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net27-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:40.853632+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.257, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T06:01:41.111753+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.517, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192875200784\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02994|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192875200897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02995|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192876200951\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02996|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192876201151\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02997|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192877200621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02998|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192877200791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02999|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192877299410\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03000|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192877299621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03001|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192878200785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03002|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192878200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03003|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192878796143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03004|bridge|INFO|bridge br-int: added interface veth010203a2 on port 20\"\n },\n {\n \"at\": \"1789192879200767\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03005|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192879200877\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192879258591\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03007|poll_loop|INFO|Dropped 12483 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192879258656\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03008|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192880201059\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03009|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192880201380\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03010|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192881200639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03011|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192881200760\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192882200654\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03013|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192882200878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192883200693\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03015|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192883201126\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192884200728\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03017|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192884200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192885200900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03019|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192885201208\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03020|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192885258988\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03021|poll_loop|INFO|Dropped 12048 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192885259095\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03022|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192886200952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03023|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192886201274\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03024|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192887200511\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03025|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192887200636\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03026|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192887283867\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03027|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789192888200994\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03028|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192888201120\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03029|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192889200743\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03030|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192889200986\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03031|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192890200648\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03032|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192890200802\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03033|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192891200880\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03034|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192891201167\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03035|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192891258969\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03036|poll_loop|INFO|Dropped 12152 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192891259047\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03037|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192892201075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03038|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192892201286\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03039|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192893201046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03040|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192893201201\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192894140076\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03042|bridge|WARN|Dropped 125243 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192894140223\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03043|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192894200983\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03044|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192894201078\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192895200718\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03046|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192895200971\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192896200675\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03048|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192896200814\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192897200674\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03050|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192897200822\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192897258743\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03052|poll_loop|INFO|Dropped 12324 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192897258871\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03053|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192898201084\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03054|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192898201327\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192899201156\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03056|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192899201411\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192900200871\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03058|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192900201005\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03059|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192901200851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03060|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192901201112\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03061|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:41.653453+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.105, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877292307\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877292673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13\"\n },\n {\n \"at\": \"1789192887276895\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00139|connmgr|INFO|br-int<->unix#7: 960 flow_mods in the 6 s starting 10 s ago (862 adds, 98 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:41.758963+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.103, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877296494\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00145|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877296674\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192879799198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00147|bridge|INFO|bridge br-int: added interface veth31450499 on port 18\"\n },\n {\n \"at\": \"1789192887282457\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00148|connmgr|INFO|br-int<->unix#7: 983 flow_mods in the 6 s starting 10 s ago (888 adds, 95 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:41.862463+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.099, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877284005\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00141|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877284330\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00142|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15\"\n },\n {\n \"at\": \"1789192887277321\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00143|connmgr|INFO|br-int<->unix#7: 1000 flow_mods in the 6 s starting 10 s ago (882 adds, 118 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:41.962606+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-probe.txt", "router_mac": "10:66:6a:6c:ad:18", "at": "2026-09-12T06:01:41.963190+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 52493, "ready": true, "ready_signal": "time=\"2026-09-11T23:01:42-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:01:42.051897+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/topology.jsonl", "destroy"], "seconds": 3.515, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:45.567163+00:00"} +{"capture": "monitor-delete", "pid": 52493, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.log", "ready_signal": "time=\"2026-09-11T23:01:42-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:01:45.571712+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.088, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:01:45.660150+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.109, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:01:45.770118+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.123, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:45.893333+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.34, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T06:01:46.233955+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.143, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192875200784\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02994|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192875200897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02995|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192876200951\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02996|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192876201151\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02997|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192877200621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02998|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192877200791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|02999|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192877299410\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03000|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192877299621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03001|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192878200785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03002|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192878200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03003|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192878796143\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03004|bridge|INFO|bridge br-int: added interface veth010203a2 on port 20\"\n },\n {\n \"at\": \"1789192879200767\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03005|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192879200877\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192879258591\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03007|poll_loop|INFO|Dropped 12483 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192879258656\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03008|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192880201059\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03009|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192880201380\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03010|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192881200639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03011|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192881200760\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192882200654\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03013|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192882200878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192883200693\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03015|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192883201126\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192884200728\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03017|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192884200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192885200900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03019|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192885201208\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03020|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192885258988\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03021|poll_loop|INFO|Dropped 12048 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192885259095\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03022|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192886200952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03023|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192886201274\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03024|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192887200511\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03025|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192887200636\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03026|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192887283867\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03027|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789192888200994\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03028|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192888201120\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03029|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192889200743\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03030|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192889200986\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03031|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192890200648\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03032|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192890200802\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03033|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192891200880\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03034|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192891201167\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03035|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192891258969\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03036|poll_loop|INFO|Dropped 12152 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192891259047\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03037|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192892201075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03038|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192892201286\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03039|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192893201046\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03040|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192893201201\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192894140076\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03042|bridge|WARN|Dropped 125243 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192894140223\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03043|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789192894200983\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03044|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192894201078\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192895200718\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03046|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192895200971\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192896200675\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03048|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192896200814\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192897200674\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03050|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192897200822\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192897258743\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03052|poll_loop|INFO|Dropped 12324 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192897258871\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03053|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192898201084\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03054|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192898201327\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192899201156\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03056|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192899201411\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192900200871\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03058|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192900201005\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03059|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192901200851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03060|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192901201112\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03061|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192902200684\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03062|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192902200794\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192902619348\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03064|bridge|INFO|bridge br-int: deleted interface veth010203a2 on port 20\"\n },\n {\n \"at\": \"1789192903200870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03065|dpif|WARN|Dropped 1975 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192903200958\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192903258736\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03067|poll_loop|INFO|Dropped 12154 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192903258807\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03068|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789192904200708\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03069|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192904201050\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03070|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192904930156\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03071|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3\"\n },\n {\n \"at\": \"1789192904930269\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03072|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192905201083\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03073|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192905201274\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03074|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192906200900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03075|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192906201053\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03076|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:46.378825+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877292307\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877292673\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13\"\n },\n {\n \"at\": \"1789192887276895\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00139|connmgr|INFO|br-int<->unix#7: 960 flow_mods in the 6 s starting 10 s ago (862 adds, 98 deletes)\"\n },\n {\n \"at\": \"1789192904924907\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00140|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192904925173\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00141|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:46.487007+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.106, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877296494\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00145|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877296674\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789192879799198\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00147|bridge|INFO|bridge br-int: added interface veth31450499 on port 18\"\n },\n {\n \"at\": \"1789192887282457\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00148|connmgr|INFO|br-int<->unix#7: 983 flow_mods in the 6 s starting 10 s ago (888 adds, 95 deletes)\"\n },\n {\n \"at\": \"1789192903580413\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00149|bridge|INFO|bridge br-int: deleted interface veth31450499 on port 18\"\n },\n {\n \"at\": \"1789192904928941\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00150|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192904929075\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00151|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:46.592988+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A01%3A14.515389%2B00%3A00"], "seconds": 0.11, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192877284005\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00141|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192877284330\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00142|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15\"\n },\n {\n \"at\": \"1789192887277321\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00143|connmgr|INFO|br-int<->unix#7: 1000 flow_mods in the 6 s starting 10 s ago (882 adds, 118 deletes)\"\n },\n {\n \"at\": \"1789192904933360\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00144|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192904933592\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00145|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:01:46.703858+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T06:01:46.705367+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/keeper-2/create.stdout.json new file mode 100644 index 0000000..52f9542 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.374, + "first_cross_member_ping_seconds": 3.757, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/cycle.json b/spikes/ovn/diagnosis-2026-09-12/keeper-2/cycle.json new file mode 100644 index 0000000..dcc08e8 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T06:01:14.515389+00:00", + "ended_at": "2026-09-12T06:01:46.705522+00:00", + "seconds": 32.19, + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:6c:ad:18", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.374, + "first_cross_member_ping_seconds": 3.757, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.101 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.091 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\"volatile.eth0.host_name\":\"veth010203a2\",\"volatile.eth0.hwaddr\":\"10:66:6a:b7:f2:39\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"23118153-0b00-400d-badb-e44ba120d12f\",\"volatile.uuid.generation\":\"23118153-0b00-400d-badb-e44ba120d12f\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:01:18.201764318Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\"volatile.eth0.host_name\":\"veth010203a2\",\"volatile.eth0.hwaddr\":\"10:66:6a:b7:f2:39\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"23118153-0b00-400d-badb-e44ba120d12f\",\"volatile.uuid.generation\":\"23118153-0b00-400d-badb-e44ba120d12f\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:01:18.941957555Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":10010624,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:feb7:f239\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":898,\"bytes_sent\":1410,\"packets_received\":5,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:b7:f2:39\",\"host_name\":\"veth010203a2\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4072162,\"processes\":4,\"cpu\":{\"usage\":504800000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:01:17.960000038Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"fdf20d0e-edee-459d-8e1d-371803c51632\",\"volatile.eth0.host_name\":\"veth31450499\",\"volatile.eth0.hwaddr\":\"10:66:6a:6f:4a:91\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\"volatile.uuid.generation\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:01:19.257703529Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"fdf20d0e-edee-459d-8e1d-371803c51632\",\"volatile.eth0.host_name\":\"veth31450499\",\"volatile.eth0.hwaddr\":\"10:66:6a:6f:4a:91\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\"volatile.uuid.generation\":\"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:01:19.879984211Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11890688,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe6f:4a91\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1340,\"packets_received\":6,\"packets_sent\":10,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:6f:4a:91\",\"host_name\":\"veth31450499\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":13802,\"processes\":4,\"cpu\":{\"usage\":511866000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:01:19.890000104Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.120 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.617 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.224 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.112 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.767 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.447 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.447/0.775/1.112 ms\nelapsed_seconds=2.267 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.413 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.678 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.332 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.332/0.807/1.413 ms\nelapsed_seconds=2.279 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.511 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.478 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.816 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.816/1.601/2.511 ms\nelapsed_seconds=2.792 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.465 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.049 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.687 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.687/1.067/1.465 ms\nelapsed_seconds=2.329 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.492 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.296 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.368 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.376 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.034 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.109130 bytes_per_second=916338312\nelapsed_seconds=0.376 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.528 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.115897 bytes_per_second=862835103\nelapsed_seconds=0.402 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.524 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 51200, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.log", + "bytes": 175673, + "ready_signal": "time=\"2026-09-11T23:01:15-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:01:15.043820+00:00", + "stopped_at": "2026-09-12T06:01:24.225597+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 51732, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/tcpdump-arp.log", + "bytes": 335, + "ready_signal": "listening on", + "started_at": "2026-09-12T06:01:25.423748+00:00", + "stopped_at": "2026-09-12T06:01:40.535968+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 52493, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.log", + "bytes": 39892, + "ready_signal": "time=\"2026-09-11T23:01:42-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:01:41.963694+00:00", + "stopped_at": "2026-09-12T06:01:45.571253+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-2" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/keeper-2/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-probe.txt new file mode 100644 index 0000000..523af4b --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-probe.txt @@ -0,0 +1,712 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab02 + - lab03 + - nas01 + - lab01 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b7:f2:39 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:6f:4a:91 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 6430010c-10da-4ccb-bf7c-21d047adad24 (incus-net27-ls-int) + port incus-net27-ls-int-lsp-router + type: router + router-port: incus-net27-lr-lrp-int + port incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0 + addresses: ["10:66:6a:6f:4a:91 dynamic"] + port incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0 + addresses: ["10:66:6a:b7:f2:39 dynamic"] +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch f63c7c52-7dfa-48df-9ac4-d4a0b682408f (incus-net27-ls-ext) + port incus-net27-ls-ext-lsp-router + type: router + router-port: incus-net27-lr-lrp-ext + port incus-net27-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +router 1205bbee-2400-4483-b1eb-ae248961a3d2 (incus-net27-lr) + port incus-net27-lr-lrp-int + mac: "10:66:6a:6c:ad:18" + ipv6-lla: "fe80::1266:6aff:fe6c:ad18" + networks: ["10.253.73.1/24"] + port incus-net27-lr-lrp-ext + mac: "10:66:6a:6c:ad:18" + ipv6-lla: "fe80::1266:6aff:fe6c:ad18" + networks: ["10.10.40.65/24"] + nat 873e144a-9aa1-4c68-9aea-fbfbc2a892b1 + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding cr-incus-net27-lr-lrp-ext + Port_Binding incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 3560a748-fd5b-44b5-ad95-485444a35d8c +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : fca3c7b3-d9cf-44a8-9d37-9968cafee7a1 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:6c:ad:18" +name : incus-net27-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="5ec8d171-fbe4-49cf-9923-9d21f9c5d29b"} + +_uuid : 0acff935-6775-4d8a-ac11-902fa4246526 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:6c:ad:18" +name : incus-net27-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : d740ae00-07c8-4056-b1b3-1f19ca56e9b8 +additional_chassis : [] +additional_encap : [] +chassis : 6d5bda8d-4911-4009-98ed-81ad0f344956 +datapath : 936eae27-2fc0-476c-b34a-a6e190436038 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 0a7d4358-5ce2-4052-a851-49d42e6b7b45 +logical_port : cr-incus-net27-lr-lrp-ext +mac : ["10:66:6a:6c:ad:18 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net27-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192875200784", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02994|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192875200897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02995|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192876200951", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02996|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192876201151", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02997|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192877200621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02998|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192877200791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02999|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192877299410", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03000|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192877299621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03001|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192878200785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03002|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192878200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03003|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192878796143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03004|bridge|INFO|bridge br-int: added interface veth010203a2 on port 20" + }, + { + "at": "1789192879200767", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03005|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192879200877", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192879258591", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03007|poll_loop|INFO|Dropped 12483 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192879258656", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03008|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192880201059", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03009|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192880201380", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03010|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192881200639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03011|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192881200760", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192882200654", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03013|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192882200878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192883200693", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03015|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192883201126", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192884200728", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03017|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192884200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192885200900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03019|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192885201208", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03020|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192885258988", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03021|poll_loop|INFO|Dropped 12048 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192885259095", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03022|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192886200952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03023|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192886201274", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03024|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192887200511", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03025|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192887200636", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03026|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192887283867", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03027|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)" + }, + { + "at": "1789192888200994", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03028|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192888201120", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03029|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192889200743", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03030|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192889200986", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03031|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192890200648", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03032|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192890200802", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03033|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192891200880", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03034|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192891201167", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03035|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192891258969", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03036|poll_loop|INFO|Dropped 12152 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192891259047", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03037|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192892201075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03038|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192892201286", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03039|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192893201046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03040|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192893201201", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192894140076", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03042|bridge|WARN|Dropped 125243 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192894140223", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03043|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192894200983", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03044|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192894201078", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192895200718", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03046|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192895200971", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192896200675", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03048|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192896200814", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192897200674", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03050|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192897200822", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192897258743", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03052|poll_loop|INFO|Dropped 12324 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192897258871", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03053|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192898201084", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03054|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192898201327", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192899201156", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03056|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192899201411", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192900200871", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03058|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192900201005", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03059|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192901200851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03060|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192901201112", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03061|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877292307", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877292673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13" + }, + { + "at": "1789192887276895", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00139|connmgr|INFO|br-int<->unix#7: 960 flow_mods in the 6 s starting 10 s ago (862 adds, 98 deletes)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877296494", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00145|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877296674", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192879799198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00147|bridge|INFO|bridge br-int: added interface veth31450499 on port 18" + }, + { + "at": "1789192887282457", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00148|connmgr|INFO|br-int<->unix#7: 983 flow_mods in the 6 s starting 10 s ago (888 adds, 95 deletes)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877284005", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00141|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877284330", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00142|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15" + }, + { + "at": "1789192887277321", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00143|connmgr|INFO|br-int<->unix#7: 1000 flow_mods in the 6 s starting 10 s ago (882 adds, 118 deletes)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-teardown.txt new file mode 100644 index 0000000..430eee9 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-after-teardown.txt @@ -0,0 +1,726 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192875200784", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02994|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192875200897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02995|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192876200951", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02996|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192876201151", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02997|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192877200621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02998|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192877200791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02999|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192877299410", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03000|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192877299621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03001|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192878200785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03002|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192878200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03003|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192878796143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03004|bridge|INFO|bridge br-int: added interface veth010203a2 on port 20" + }, + { + "at": "1789192879200767", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03005|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192879200877", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192879258591", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03007|poll_loop|INFO|Dropped 12483 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192879258656", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03008|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192880201059", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03009|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192880201380", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03010|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192881200639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03011|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192881200760", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192882200654", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03013|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192882200878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192883200693", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03015|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192883201126", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192884200728", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03017|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192884200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192885200900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03019|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192885201208", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03020|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192885258988", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03021|poll_loop|INFO|Dropped 12048 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192885259095", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03022|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192886200952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03023|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192886201274", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03024|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192887200511", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03025|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192887200636", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03026|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192887283867", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03027|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (845 adds, 65 deletes, 30 modifications)" + }, + { + "at": "1789192888200994", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03028|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192888201120", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03029|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192889200743", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03030|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192889200986", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03031|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192890200648", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03032|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192890200802", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03033|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192891200880", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03034|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192891201167", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03035|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192891258969", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03036|poll_loop|INFO|Dropped 12152 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192891259047", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03037|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192892201075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03038|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192892201286", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03039|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192893201046", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03040|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192893201201", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03041|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192894140076", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03042|bridge|WARN|Dropped 125243 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192894140223", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03043|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192894200983", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03044|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192894201078", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03045|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192895200718", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03046|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192895200971", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03047|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192896200675", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03048|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192896200814", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192897200674", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03050|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192897200822", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192897258743", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03052|poll_loop|INFO|Dropped 12324 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192897258871", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03053|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192898201084", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03054|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192898201327", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192899201156", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03056|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192899201411", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192900200871", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03058|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192900201005", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03059|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192901200851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03060|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192901201112", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03061|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192902200684", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03062|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192902200794", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192902619348", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03064|bridge|INFO|bridge br-int: deleted interface veth010203a2 on port 20" + }, + { + "at": "1789192903200870", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03065|dpif|WARN|Dropped 1975 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192903200958", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192903258736", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03067|poll_loop|INFO|Dropped 12154 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192903258807", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03068|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192904200708", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03069|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192904201050", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03070|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192904930156", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03071|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192904930269", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03072|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192905201083", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03073|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192905201274", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03074|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192906200900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03075|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192906201053", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03076|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877292307", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877292673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13" + }, + { + "at": "1789192887276895", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00139|connmgr|INFO|br-int<->unix#7: 960 flow_mods in the 6 s starting 10 s ago (862 adds, 98 deletes)" + }, + { + "at": "1789192904924907", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00140|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192904925173", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00141|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877296494", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00145|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877296674", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192879799198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00147|bridge|INFO|bridge br-int: added interface veth31450499 on port 18" + }, + { + "at": "1789192887282457", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00148|connmgr|INFO|br-int<->unix#7: 983 flow_mods in the 6 s starting 10 s ago (888 adds, 95 deletes)" + }, + { + "at": "1789192903580413", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00149|bridge|INFO|bridge br-int: deleted interface veth31450499 on port 18" + }, + { + "at": "1789192904928941", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00150|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192904929075", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00151|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877284005", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00141|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877284330", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00142|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15" + }, + { + "at": "1789192887277321", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00143|connmgr|INFO|br-int<->unix#7: 1000 flow_mods in the 6 s starting 10 s ago (882 adds, 118 deletes)" + }, + { + "at": "1789192904933360", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00144|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192904933592", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00145|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-before-probe.txt new file mode 100644 index 0000000..f108246 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/diagnostics-before-probe.txt @@ -0,0 +1,436 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:b7:f2:39 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:6f:4a:91 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 6430010c-10da-4ccb-bf7c-21d047adad24 (incus-net27-ls-int) + port incus-net27-ls-int-lsp-router + type: router + router-port: incus-net27-lr-lrp-int + port incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0 + addresses: ["10:66:6a:6f:4a:91 dynamic"] + port incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0 + addresses: ["10:66:6a:b7:f2:39 dynamic"] +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch f63c7c52-7dfa-48df-9ac4-d4a0b682408f (incus-net27-ls-ext) + port incus-net27-ls-ext-lsp-router + type: router + router-port: incus-net27-lr-lrp-ext + port incus-net27-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +router 1205bbee-2400-4483-b1eb-ae248961a3d2 (incus-net27-lr) + port incus-net27-lr-lrp-int + mac: "10:66:6a:6c:ad:18" + ipv6-lla: "fe80::1266:6aff:fe6c:ad18" + networks: ["10.253.73.1/24"] + port incus-net27-lr-lrp-ext + mac: "10:66:6a:6c:ad:18" + ipv6-lla: "fe80::1266:6aff:fe6c:ad18" + networks: ["10.10.40.65/24"] + nat 873e144a-9aa1-4c68-9aea-fbfbc2a892b1 + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding cr-incus-net27-lr-lrp-ext + Port_Binding incus-net27-instance-60f44a7e-701e-4fb8-a297-15c7494f0fbf-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net27-instance-23118153-0b00-400d-badb-e44ba120d12f-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 3560a748-fd5b-44b5-ad95-485444a35d8c +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : fca3c7b3-d9cf-44a8-9d37-9968cafee7a1 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:6c:ad:18" +name : incus-net27-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="5ec8d171-fbe4-49cf-9923-9d21f9c5d29b"} + +_uuid : 0acff935-6775-4d8a-ac11-902fa4246526 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:6c:ad:18" +name : incus-net27-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : d740ae00-07c8-4056-b1b3-1f19ca56e9b8 +additional_chassis : [] +additional_encap : [] +chassis : 6d5bda8d-4911-4009-98ed-81ad0f344956 +datapath : 936eae27-2fc0-476c-b34a-a6e190436038 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 0a7d4358-5ce2-4052-a851-49d42e6b7b45 +logical_port : cr-incus-net27-lr-lrp-ext +mac : ["10:66:6a:6c:ad:18 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net27-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192875200784", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02994|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192875200897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02995|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192876200951", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02996|dpif|WARN|Dropped 2111 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192876201151", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02997|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192877200621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02998|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192877200791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|02999|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192877299410", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03000|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 3" + }, + { + "at": "1789192877299621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03001|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192878200785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03002|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192878200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03003|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192878796143", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03004|bridge|INFO|bridge br-int: added interface veth010203a2 on port 20" + }, + { + "at": "1789192879200767", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03005|dpif|WARN|Dropped 1983 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192879200877", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192879258591", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03007|poll_loop|INFO|Dropped 12483 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192879258656", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03008|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789192880201059", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03009|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192880201380", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03010|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192881200639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03011|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192881200760", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192882200654", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03013|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192882200878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192883200693", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03015|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192883201126", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192884200728", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03017|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192884200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877292307", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00137|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877292673", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00138|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 13" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877296494", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00145|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877296674", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00146|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789192879799198", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00147|bridge|INFO|bridge br-int: added interface veth31450499 on port 18" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192877284005", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00141|bridge|INFO|bridge incusovn16: added interface patch-incus-net27-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192877284330", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00142|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net27-ls-ext-lsp-provider on port 15" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.debug.log new file mode 100644 index 0000000..b7e18fa --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:01:15-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.log new file mode 100644 index 0000000..8693f85 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-create.log @@ -0,0 +1,543 @@ +time="2026-09-12T06:01:15Z" level=debug msg="[nas01] Event listener server handler started" id=2b170eaf-90c5-453c-9581-12326bd7b8f6 local="10.10.10.14:8443" remote="100.122.142.76:62117" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62135" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62136" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62138" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62139" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62140" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62141" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62142" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62143" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62145" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62146" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:6c:ad:18" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.27 +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net27 driver=ovn memberID=1 network=default priority=9433 project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62152" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62153" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62154" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62155" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62156" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62157" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62158" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62159" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Event listener server handler started" id=bb51a426-5232-4c12-9806-765772d21742 local="10.10.10.14:8443" remote="100.122.142.76:62160" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62160" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62161" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=09b88cf7-a776-455f-ab68-06a758946b24 project=image-build +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=09b88cf7-a776-455f-ab68-06a758946b24 project=image-build +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62162" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Event listener server handler started" id=2748c482-a42b-4d4a-a6d5-6f4f65b2afdc local="10.10.10.14:8443" remote="100.122.142.76:62162" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62163" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=0ac3a4d6-ee06-48fd-bf76-e5d4bc691b0e project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=0ac3a4d6-ee06-48fd-bf76-e5d4bc691b0e project=ac-ovn-spike +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62164" method=GET protocol=tls url="/1.0/operations/0ac3a4d6-ee06-48fd-bf76-e5d4bc691b0e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:17Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=0ac3a4d6-ee06-48fd-bf76-e5d4bc691b0e project=ac-ovn-spike +time="2026-09-12T06:01:18Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:01:18Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T06:01:18Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=0ac3a4d6-ee06-48fd-bf76-e5d4bc691b0e project=ac-ovn-spike +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2748c482-a42b-4d4a-a6d5-6f4f65b2afdc local="10.10.10.14:8443" remote="100.122.142.76:62162" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Event listener server handler stopped" listener=bb51a426-5232-4c12-9806-765772d21742 local="10.10.10.14:8443" remote="100.122.142.76:62160" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62165" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62166" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"e5a93e9a-4098-4c7b-8e9e-0f168b36bbde\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:01:18.120352555Z\",\n\t\t\"updated_at\": \"2026-09-12T06:01:18.120352555Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T06:01:18Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62167" method=GET protocol=tls url="/1.0/operations/e5a93e9a-4098-4c7b-8e9e-0f168b36bbde/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:18Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62168" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62169" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62170" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Event listener server handler started" id=3668665b-6ffd-4476-b42f-547db22fefa2 local="10.10.10.14:8443" remote="100.122.142.76:62170" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62171" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:18Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 06:01:18.201764318 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62172" method=GET protocol=tls url="/1.0/operations/c2c789a6-5a92-4f7b-badc-05e2a86dd357?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:01:18Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 06:01:18.201764318 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Event listener server handler stopped" listener=3668665b-6ffd-4476-b42f-547db22fefa2 local="10.10.10.14:8443" remote="100.122.142.76:62170" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62173" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62174" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"c5eba76d-312a-4d3e-9aa0-80f42f480653\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:01:19.210453703Z\",\n\t\t\"updated_at\": \"2026-09-12T06:01:19.210453703Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T06:01:19Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62175" method=GET protocol=tls url="/1.0/operations/c5eba76d-312a-4d3e-9aa0-80f42f480653/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.65 network=default project=ac-ovn-spike +time="2026-09-12T06:01:19Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62176" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62177" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62178" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Event listener server handler started" id=540a7f5f-eaaa-4443-a157-7b563873fa62 local="10.10.10.14:8443" remote="100.122.142.76:62178" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62179" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 06:01:19.257703529 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62180" method=GET protocol=tls url="/1.0/operations/93c4eadd-284d-47b3-9c49-3ed99eddad39?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:19Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 06:01:19.257703529 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:01:19Z" level=debug msg="[nas01] Event listener server handler stopped" listener=540a7f5f-eaaa-4443-a157-7b563873fa62 local="10.10.10.14:8443" remote="100.122.142.76:62178" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62181" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62182" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62183" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62184" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62185" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62186" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62187" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62188" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62189" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Event listener server handler started" id=ea12da33-b7a2-461a-8c42-1078870981e9 local="10.10.10.14:8443" remote="100.122.142.76:62190" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62190" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62191" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:20Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62192" method=GET protocol=tls url="/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=918762e85b1cf507e1cce457348abf6e1bdb7bd374839d1434621ede09e4eb75" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62192" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=918762e85b1cf507e1cce457348abf6e1bdb7bd374839d1434621ede09e4eb75" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62193" method=GET protocol=tls url="/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=136e71da81545fb5463c9fb1b9e9ba6d2f7eb99f0ea8d192bf600276594a8c31" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62193" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=136e71da81545fb5463c9fb1b9e9ba6d2f7eb99f0ea8d192bf600276594a8c31" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62194" method=GET protocol=tls url="/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=823d3ea1ad09d09663f7cf90e4102e4c208eee67fa1de60d651ec44f290e919f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62194" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=823d3ea1ad09d09663f7cf90e4102e4c208eee67fa1de60d651ec44f290e919f" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62195" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62195" method=GET protocol=tls url="/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=74526118ca1d220f4d050544a052bd8a63be54a796c33124edc8b479504bf778" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62/websocket?secret=74526118ca1d220f4d050544a052bd8a63be54a796c33124edc8b479504bf778" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62193" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62196" method=GET protocol=tls url="/1.0/operations/9ad82301-7205-4427-9419-45d8b91d5b62?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62192" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62194" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62195" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ea12da33-b7a2-461a-8c42-1078870981e9 local="10.10.10.14:8443" remote="100.122.142.76:62190" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62197" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62198" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62199" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62200" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Event listener server handler started" id=46e093a5-b931-4df2-b970-7320376f9390 local="10.10.10.14:8443" remote="100.122.142.76:62200" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62201" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62202" method=GET protocol=tls url="/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=673df3475ebf5566982cc947c7633f86bb9939c96175f456f1e82c1078958af1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=673df3475ebf5566982cc947c7633f86bb9939c96175f456f1e82c1078958af1" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62202" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62203" method=GET protocol=tls url="/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=518281ab9e78e4da09aa15b4331ce52651a286588439adfcb76f3f4697d595b7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=518281ab9e78e4da09aa15b4331ce52651a286588439adfcb76f3f4697d595b7" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62203" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62204" method=GET protocol=tls url="/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=985cc13d2ef4f99dcdb4b2deb4049a76225902a84cbbc067c29da55e9dc9a993" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62204" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=985cc13d2ef4f99dcdb4b2deb4049a76225902a84cbbc067c29da55e9dc9a993" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62205" method=GET protocol=tls url="/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=c8566b19a547f8ffeb2f9c8e05d23bc9d3b671a630d715ed4ecda4d8e99c7872" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701/websocket?secret=c8566b19a547f8ffeb2f9c8e05d23bc9d3b671a630d715ed4ecda4d8e99c7872" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62205" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62203" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62206" method=GET protocol=tls url="/1.0/operations/319aa7a6-bced-412d-ad56-6045dfdd8701?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62204" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62202" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62205" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Event listener server handler stopped" listener=46e093a5-b931-4df2-b970-7320376f9390 local="10.10.10.14:8443" remote="100.122.142.76:62200" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62207" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62208" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Event listener server handler started" id=cff4e4f2-e3e8-4e4b-8a4f-e37d9e7eb2ce local="10.10.10.14:8443" remote="100.122.142.76:62208" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62209" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62210" method=GET protocol=tls url="/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=15c1efd1689850ee5c2a97f5c5fc6a60b31f8f6618542204cc34d8272f597aed" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=15c1efd1689850ee5c2a97f5c5fc6a60b31f8f6618542204cc34d8272f597aed" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62210" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62211" method=GET protocol=tls url="/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=2ad189fed3bbd09d868f375484ca60e6b49d2ba64bc1dbe240b72711e3221f01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=2ad189fed3bbd09d868f375484ca60e6b49d2ba64bc1dbe240b72711e3221f01" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62211" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62212" method=GET protocol=tls url="/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=fce7c18e0384505094be2942269beb2ad8d690c2ca9dca170d908874ee15bc01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62212" +time="2026-09-12T06:01:21Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=fce7c18e0384505094be2942269beb2ad8d690c2ca9dca170d908874ee15bc01" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62213" method=GET protocol=tls url="/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=5781228c73f8e1589338d83de7de8d9944ab4cf34ad72c415a859e81e6f7c622" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62213" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32811691-826f-47f9-856e-27d14055af73/websocket?secret=5781228c73f8e1589338d83de7de8d9944ab4cf34ad72c415a859e81e6f7c622" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62211" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62214" method=GET protocol=tls url="/1.0/operations/32811691-826f-47f9-856e-27d14055af73?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62210" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62212" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62213" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Event listener server handler stopped" listener=cff4e4f2-e3e8-4e4b-8a4f-e37d9e7eb2ce local="10.10.10.14:8443" remote="100.122.142.76:62208" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62215" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62216" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.633551973s +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62217" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62218" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Event listener server handler started" id=d2e0b5de-e5ac-4e7a-9af1-a279e050fc79 local="10.10.10.14:8443" remote="100.122.142.76:62218" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62219" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62220" method=GET protocol=tls url="/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=0cb581432dd55a1cafb258c0c78839302e702e91fab5527c4e039189061d01db" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=0cb581432dd55a1cafb258c0c78839302e702e91fab5527c4e039189061d01db" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62220" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62221" method=GET protocol=tls url="/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=a6a60719851f31330c64bcd3efa2c8e15ae56ba3a6f052f4b4512db653ff41a2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=a6a60719851f31330c64bcd3efa2c8e15ae56ba3a6f052f4b4512db653ff41a2" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62221" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62222" method=GET protocol=tls url="/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=b88222eab38506c25f79875f095523f9a5b5c6716da0abbb4b80fe9596e1d809" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=b88222eab38506c25f79875f095523f9a5b5c6716da0abbb4b80fe9596e1d809" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62222" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62223" method=GET protocol=tls url="/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=8dd26f85febe02dcb9cfda41b792c317f79bdcd7cb7e701e66cd8c99e974da68" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b/websocket?secret=8dd26f85febe02dcb9cfda41b792c317f79bdcd7cb7e701e66cd8c99e974da68" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62223" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62221" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62224" method=GET protocol=tls url="/1.0/operations/3bc2bb21-a70b-416d-8c8e-a0ab58a6026b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62220" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62222" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62223" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d2e0b5de-e5ac-4e7a-9af1-a279e050fc79 local="10.10.10.14:8443" remote="100.122.142.76:62218" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62225" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62226" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Event listener server handler started" id=19bdb392-f3c8-48fb-9b6a-8bcddd8f6034 local="10.10.10.14:8443" remote="100.122.142.76:62226" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62227" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62228" method=GET protocol=tls url="/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=2e5462c2d27c4feb9498a1e4c42c72e014975cd108a02df3dabd36292c01a09f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=2e5462c2d27c4feb9498a1e4c42c72e014975cd108a02df3dabd36292c01a09f" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62228" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62229" method=GET protocol=tls url="/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=d32722ebeb7985f5d1724d5f1cfa68d06f5701610a2fe2a348e175fa1fe481e5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62229" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=d32722ebeb7985f5d1724d5f1cfa68d06f5701610a2fe2a348e175fa1fe481e5" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62230" method=GET protocol=tls url="/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=7be33905fb01e071a309d87ae2c8bc9b06eaac16c1b4baad14469302659e1350" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=7be33905fb01e071a309d87ae2c8bc9b06eaac16c1b4baad14469302659e1350" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62230" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62231" method=GET protocol=tls url="/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=7dd45f8e8792f635241c9c3bb9454b73025d8ecc076f7ebbdc924af55513a644" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b/websocket?secret=7dd45f8e8792f635241c9c3bb9454b73025d8ecc076f7ebbdc924af55513a644" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62231" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62229" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62232" method=GET protocol=tls url="/1.0/operations/ce4c47d3-aae7-4ccf-8dec-20060fea768b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62228" +time="2026-09-12T06:01:22Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62231" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62230" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Event listener server handler stopped" listener=19bdb392-f3c8-48fb-9b6a-8bcddd8f6034 local="10.10.10.14:8443" remote="100.122.142.76:62226" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62233" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62234" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Event listener server handler started" id=931b289f-99ed-4625-a24e-24aef1ca0e04 local="10.10.10.14:8443" remote="100.122.142.76:62234" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62235" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62236" method=GET protocol=tls url="/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=a92ab8ace92fd9ba4ed6fe5945ecf945eecbbf80da4842d171453b947df0d658" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=a92ab8ace92fd9ba4ed6fe5945ecf945eecbbf80da4842d171453b947df0d658" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62236" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62237" method=GET protocol=tls url="/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=12933e3a00901a8b5cd51b4bcb2692dcf3811216b3a129bac262a2e9b5c1167b" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62237" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=12933e3a00901a8b5cd51b4bcb2692dcf3811216b3a129bac262a2e9b5c1167b" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62238" method=GET protocol=tls url="/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=c30216f433be8c675c1ceee78447a71a44a115a05beaaff59cfd4043c3c89705" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=c30216f433be8c675c1ceee78447a71a44a115a05beaaff59cfd4043c3c89705" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62238" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62239" method=GET protocol=tls url="/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=c507b7ca9ac86c22335a12b0d5247994152efbdb3067022b2dd438afa8d9c274" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62239" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150/websocket?secret=c507b7ca9ac86c22335a12b0d5247994152efbdb3067022b2dd438afa8d9c274" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62237" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62240" method=GET protocol=tls url="/1.0/operations/92da66d3-357c-4368-97f9-5f6bd198f150?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62238" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62236" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62239" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Event listener server handler stopped" listener=931b289f-99ed-4625-a24e-24aef1ca0e04 local="10.10.10.14:8443" remote="100.122.142.76:62234" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62241" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62242" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Event listener server handler started" id=938303c3-22a9-4dfa-ada0-39171691b2a2 local="10.10.10.14:8443" remote="100.122.142.76:62242" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62243" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62244" method=GET protocol=tls url="/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=a17bc639ff1f5917bc91bfa5523f7fd067537a4e5264d9243eba51ec1fe77193" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62244" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=a17bc639ff1f5917bc91bfa5523f7fd067537a4e5264d9243eba51ec1fe77193" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62245" method=GET protocol=tls url="/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=ca98ca739cba2c118479c0c68392dbdb21887e1f36e5642edf359ace63a00266" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=ca98ca739cba2c118479c0c68392dbdb21887e1f36e5642edf359ace63a00266" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62245" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62246" method=GET protocol=tls url="/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=e8c5680915d85f288b06ad95171f673e14a3b772774beb8428682cfef36e5cde" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=e8c5680915d85f288b06ad95171f673e14a3b772774beb8428682cfef36e5cde" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62246" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62247" method=GET protocol=tls url="/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=76775bf846f8253178e0166981429615ced5be6f87fb2a808c5b4343322334f7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62247" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad/websocket?secret=76775bf846f8253178e0166981429615ced5be6f87fb2a808c5b4343322334f7" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62245" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62248" method=GET protocol=tls url="/1.0/operations/ad49b8b0-3a08-44ee-8fdb-76fad5a617ad?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:23Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62246" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62244" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62247" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Event listener server handler stopped" listener=938303c3-22a9-4dfa-ada0-39171691b2a2 local="10.10.10.14:8443" remote="100.122.142.76:62242" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62249" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62250" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:01:24Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.debug.log new file mode 100644 index 0000000..fdf26e7 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:01:42-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.log new file mode 100644 index 0000000..77bd616 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/monitor-delete.log @@ -0,0 +1,162 @@ +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Event listener server handler started" id=99f55376-14b9-4ae2-9cd1-48d7d2f7e3c2 local="10.10.10.14:8443" remote="100.122.142.76:62403" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62404" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62405" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62406" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62407" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:01:19.257703529Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:01:19.879984211Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:01:18.201764318Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:01:18.941957555Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62408" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62409" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62410" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Event listener server handler started" id=d8628be0-0ef2-4011-a47f-02fa06ee9220 local="10.10.10.14:8443" remote="100.122.142.76:62410" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62411" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 06:01:18.201764318 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:01:18.941957555 +0000 UTC" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62412" method=GET protocol=tls url="/1.0/operations/7cf26fc5-0ee5-405e-bb72-b1b2cd502601?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:42Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62413" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:43Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 06:01:18.201764318 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:01:18.941957555 +0000 UTC" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62414" method=GET protocol=tls url="/1.0/operations/60879e37-1d66-4b6e-bac0-9aeedd5cc32a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:43Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 06:01:18.201764318 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:01:18.941957555 +0000 UTC" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d8628be0-0ef2-4011-a47f-02fa06ee9220 local="10.10.10.14:8443" remote="100.122.142.76:62410" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62415" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62416" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62417" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Event listener server handler started" id=cce5717f-73c5-475a-9569-ad3e740aee9c local="10.10.10.14:8443" remote="100.122.142.76:62417" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62418" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:43Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 06:01:19.257703529 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:01:19.879984211 +0000 UTC" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62419" method=GET protocol=tls url="/1.0/operations/55972f43-94d2-4411-aa36-96ca4c34dc1f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:43Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62420" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 06:01:19.257703529 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:01:19.879984211 +0000 UTC" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62421" method=GET protocol=tls url="/1.0/operations/a55b605b-d516-4fac-a52e-b3bf7cc6808e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:44Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 06:01:19.257703529 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:01:19.879984211 +0000 UTC" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Event listener server handler stopped" listener=cce5717f-73c5-475a-9569-ad3e740aee9c local="10.10.10.14:8443" remote="100.122.142.76:62417" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62422" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62423" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62424" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62425" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62426" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62427" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62428" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62429" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:01:44Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62430" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62431" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62432" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62433" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62434" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62435" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62436" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62437" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Event listener server handler started" id=47ad3615-2cc3-4a96-aaa8-b2832fce272d local="10.10.10.14:8443" remote="100.122.142.76:62438" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62438" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62439" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=766153a8-27a6-490d-a747-48570f04d4e7 project=ac-ovn-spike +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=766153a8-27a6-490d-a747-48570f04d4e7 project=ac-ovn-spike +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=766153a8-27a6-490d-a747-48570f04d4e7 project=ac-ovn-spike +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62440" method=GET protocol=tls url="/1.0/operations/766153a8-27a6-490d-a747-48570f04d4e7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Event listener server handler stopped" listener=47ad3615-2cc3-4a96-aaa8-b2832fce272d local="10.10.10.14:8443" remote="100.122.142.76:62438" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62441" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:01:45Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62442" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-2/probe.stdout.txt new file mode 100644 index 0000000..08e0acd --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/probe.stdout.txt @@ -0,0 +1,135 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.101 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.091 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"39ec6cc1-b768-41e7-af61-880f0ed20c8c","volatile.eth0.host_name":"veth010203a2","volatile.eth0.hwaddr":"10:66:6a:b7:f2:39","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"23118153-0b00-400d-badb-e44ba120d12f","volatile.uuid.generation":"23118153-0b00-400d-badb-e44ba120d12f"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:01:18.201764318Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"39ec6cc1-b768-41e7-af61-880f0ed20c8c","volatile.eth0.host_name":"veth010203a2","volatile.eth0.hwaddr":"10:66:6a:b7:f2:39","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"23118153-0b00-400d-badb-e44ba120d12f","volatile.uuid.generation":"23118153-0b00-400d-badb-e44ba120d12f"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:01:18.941957555Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":10010624,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:feb7:f239","netmask":"64","scope":"link"}],"counters":{"bytes_received":898,"bytes_sent":1410,"packets_received":5,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:b7:f2:39","host_name":"veth010203a2","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4072162,"processes":4,"cpu":{"usage":504800000,"allocated_time":24000000000},"started_at":"2026-09-12T06:01:17.960000038Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"fdf20d0e-edee-459d-8e1d-371803c51632","volatile.eth0.host_name":"veth31450499","volatile.eth0.hwaddr":"10:66:6a:6f:4a:91","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"60f44a7e-701e-4fb8-a297-15c7494f0fbf","volatile.uuid.generation":"60f44a7e-701e-4fb8-a297-15c7494f0fbf"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:01:19.257703529Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"fdf20d0e-edee-459d-8e1d-371803c51632","volatile.eth0.host_name":"veth31450499","volatile.eth0.hwaddr":"10:66:6a:6f:4a:91","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"60f44a7e-701e-4fb8-a297-15c7494f0fbf","volatile.uuid.generation":"60f44a7e-701e-4fb8-a297-15c7494f0fbf"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:01:19.879984211Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11890688,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe6f:4a91","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1340,"packets_received":6,"packets_sent":10,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:6f:4a:91","host_name":"veth31450499","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":13802,"processes":4,"cpu":{"usage":511866000,"allocated_time":24000000000},"started_at":"2026-09-12T06:01:19.890000104Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.120 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.617 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.224 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.112 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.767 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.447 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.447/0.775/1.112 ms +elapsed_seconds=2.267 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.413 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.678 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.332 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.332/0.807/1.413 ms +elapsed_seconds=2.279 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.511 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.478 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.816 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.816/1.601/2.511 ms +elapsed_seconds=2.792 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.465 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.049 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.687 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.687/1.067/1.465 ms +elapsed_seconds=2.329 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.492 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.296 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.368 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.376 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.034 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.109130 bytes_per_second=916338312 +elapsed_seconds=0.376 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.528 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.115897 bytes_per_second=862835103 +elapsed_seconds=0.402 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.524 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/keeper-2/tcpdump-arp.log new file mode 100644 index 0000000..c00e114 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/tcpdump-arp.log @@ -0,0 +1,4 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +06:01:33.294949 10:66:6a:6c:ad:18 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.65 tell 10.10.40.65, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-2/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/keeper-2/topology.jsonl new file mode 100644 index 0000000..9a3b947 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-2/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.108, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.103, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/keeper\"\n\t]\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.114, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.539, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.374, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.106, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.124, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.291, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.483, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:01:18.120352555Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"e5a93e9a-4098-4c7b-8e9e-0f168b36bbde\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:01:18.120352555Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.593, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.472, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:01:19.210453703Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"c5eba76d-312a-4d3e-9aa0-80f42f480653\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:01:19.210453703Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.399, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.214, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 158652000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 6692864,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:feb7:f239\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth010203a2\",\n\t\t\t\"hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4072162,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:01:17.960000038Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.225, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 143727000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6037504,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe6f:4a91\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 864,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"veth31450499\",\n\t\t\t\"hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 13802,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:01:19.890000104Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.106, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t},\n\t\"created_at\": \"2026-09-12T06:01:18.201764318Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:01:18.941957555Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.101, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t},\n\t\"created_at\": \"2026-09-12T06:01:19.257703529Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:01:19.879984211Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.639, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.168 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.168/1.168/1.168 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.331, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.205, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.279, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.35, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-73rio0l2/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.235, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.365, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.546, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.029204 seconds, 3.2GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.558, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.024959 seconds, 3.7GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.127, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.127, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:01:18.201764318Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"39ec6cc1-b768-41e7-af61-880f0ed20c8c\",\n\t\t\t\"volatile.eth0.host_name\": \"veth010203a2\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:b7:f2:39\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"23118153-0b00-400d-badb-e44ba120d12f\",\n\t\t\t\"volatile.uuid.generation\": \"23118153-0b00-400d-badb-e44ba120d12f\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:01:18.941957555Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:01:19.257703529Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"fdf20d0e-edee-459d-8e1d-371803c51632\",\n\t\t\t\"volatile.eth0.host_name\": \"veth31450499\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:6f:4a:91\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\",\n\t\t\t\"volatile.uuid.generation\": \"60f44a7e-701e-4fb8-a297-15c7494f0fbf\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:01:19.879984211Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.999, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.083, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.098, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"lab03\",\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.087, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.149, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.18, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.116, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T06:01:19.299446846Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T06:01:17.992211425Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.184, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.102, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/keeper-3/commands.jsonl new file mode 100644 index 0000000..a8c1919 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.12, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:03:00.785269+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.285, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:03:01.070563+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.114, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T06:03:01.185542+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 59028, "ready": true, "ready_signal": "time=\"2026-09-11T23:03:01-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:03:01.285167+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/topology.jsonl", "create"], "seconds": 9.416, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.65\",\n \"network_create_seconds\": 0.257,\n \"first_cross_member_ping_seconds\": 3.616,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:10.701657+00:00"} +{"capture": "monitor-create", "pid": 59028, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.log", "ready_signal": "time=\"2026-09-11T23:03:01-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:03:10.706175+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.107, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab03\n - nas01\n - lab01\n - lab02\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:10.814050+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.102, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:17:26:43 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:c0:e0:7c |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:10.915862+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.137, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch a7826682-25b6-433c-a551-e24d71fdc0aa (incus-net28-ls-int)\n port incus-net28-ls-int-lsp-router\n type: router\n router-port: incus-net28-lr-lrp-int\n port incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0\n addresses: [\"10:66:6a:c0:e0:7c dynamic\"]\n port incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0\n addresses: [\"10:66:6a:17:26:43 dynamic\"]\nswitch 14954deb-8379-447e-b124-b298724c2e18 (incus-net28-ls-ext)\n port incus-net28-ls-ext-lsp-router\n type: router\n router-port: incus-net28-lr-lrp-ext\n port incus-net28-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 3f25ce24-878f-44ba-816c-f3879a9246d9 (incus-net28-lr)\n port incus-net28-lr-lrp-ext\n mac: \"10:66:6a:14:21:7e\"\n ipv6-lla: \"fe80::1266:6aff:fe14:217e\"\n networks: [\"10.10.40.65/24\"]\n port incus-net28-lr-lrp-int\n mac: \"10:66:6a:14:21:7e\"\n ipv6-lla: \"fe80::1266:6aff:fe14:217e\"\n networks: [\"10.253.73.1/24\"]\n nat b7be98b3-6219-4570-b703-10742584342d\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net28-lr-lrp-ext\n Port_Binding incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 129d3583-97f3-4472-97d6-175385631e23\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 9d73b755-94be-4b3f-b088-f5d310cca707\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:14:21:7e\"\nname : incus-net28-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : ecd52c27-ef90-4b46-8e3c-3f3436f561f5\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:14:21:7e\"\nname : incus-net28-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 909852c0-afa5-460a-bebb-828ee9a761a3\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 58cdf306-a3c4-40f7-bad0-0c40c8570600\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 688ab81f-fff2-4182-875d-41568113f0a5\nlogical_port : cr-incus-net28-lr-lrp-ext\nmac : [\"10:66:6a:14:21:7e 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net28-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:11.054096+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.323, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 PROBE \n", "stderr": "", "error": null, "at": "2026-09-12T06:03:11.377522+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.136, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192981200926\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03252|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192981201051\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03253|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192981258870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03254|poll_loop|INFO|Dropped 12476 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192981259079\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03255|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192982200967\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03256|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192982201129\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192983201042\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03258|dpif|WARN|Dropped 2144 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192983201301\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192983224547\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03260|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192983224608\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03261|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789192984200968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03262|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192984201077\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192984580285\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03264|bridge|INFO|bridge br-int: added interface veth9470b3e9 on port 22\"\n },\n {\n \"at\": \"1789192985200827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03265|dpif|WARN|Dropped 1956 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192985200973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192986200741\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03267|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192986200996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192987200775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03269|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192987200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192987258777\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03271|poll_loop|INFO|Dropped 12221 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192987258896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03272|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192988200598\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03273|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192988200708\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192989200894\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03275|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192989201118\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192990201014\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03277|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192990201308\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192991200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03279|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192991201082\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:11.520713+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.115, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983217463\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00143|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983218383\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00144|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:11.636280+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.106, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983223973\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983224172\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192985536173\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00155|bridge|INFO|bridge br-int: added interface vethc3c8caab on port 20\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:11.743530+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.11, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983207988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00147|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983208267\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00148|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:11.855055+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-before-probe.txt", "router_mac": "10:66:6a:14:21:7e", "at": "2026-09-12T06:03:11.855763+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.452, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:03:04.028158519Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:03:04.70671227Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:03:04.977165511Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:03:05.618869203Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:12.307629+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.65"], "capture": "tcpdump-arp", "pid": 59649, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T06:03:12.437336+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 43.801, "exit_code": 1, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.096 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.106 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f0ee7ab-55de-448b-a76c-e79b17649762\",\"volatile.eth0.host_name\":\"veth9470b3e9\",\"volatile.eth0.hwaddr\":\"10:66:6a:17:26:43\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\"volatile.uuid.generation\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:03:04.028158519Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f0ee7ab-55de-448b-a76c-e79b17649762\",\"volatile.eth0.host_name\":\"veth9470b3e9\",\"volatile.eth0.hwaddr\":\"10:66:6a:17:26:43\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\"volatile.uuid.generation\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:03:04.70671227Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9957376,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe17:2643\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:17:26:43\",\"host_name\":\"veth9470b3e9\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4073065,\"processes\":4,\"cpu\":{\"usage\":478372000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:03:03.730000019Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\"volatile.eth0.host_name\":\"vethc3c8caab\",\"volatile.eth0.hwaddr\":\"10:66:6a:c0:e0:7c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\"volatile.uuid.generation\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:03:04.977165511Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\"volatile.eth0.host_name\":\"vethc3c8caab\",\"volatile.eth0.hwaddr\":\"10:66:6a:c0:e0:7c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\"volatile.uuid.generation\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:03:05.618869203Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11526144,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fec0:e07c\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:c0:e0:7c\",\"host_name\":\"vethc3c8caab\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":14492,\"processes\":4,\"cpu\":{\"usage\":490199000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:03:05.630000114Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.117 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.325 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.301 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.278 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.797 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.352 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.352/0.809/1.278 ms\nelapsed_seconds=2.275 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.905 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.796 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.351 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.351/0.684/0.905 ms\nelapsed_seconds=2.265 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.299 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.775 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.308 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.235 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.254 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5001 milliseconds\nelapsed_seconds=5.289 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5006 ms: Timeout was reached\nelapsed_seconds=5.035 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.116984 bytes_per_second=854817752\nelapsed_seconds=0.363 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.533 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.136481 bytes_per_second=732702720\nelapsed_seconds=0.909 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.537 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n", "error": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed", "at": "2026-09-12T06:03:56.240596+00:00"} +{"capture": "tcpdump-arp", "pid": 59649, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T06:03:56.242917+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.095, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:56.337789+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.097, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:17:26:43 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:c0:e0:7c |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:56.435226+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.12, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch a7826682-25b6-433c-a551-e24d71fdc0aa (incus-net28-ls-int)\n port incus-net28-ls-int-lsp-router\n type: router\n router-port: incus-net28-lr-lrp-int\n port incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0\n addresses: [\"10:66:6a:c0:e0:7c dynamic\"]\n port incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0\n addresses: [\"10:66:6a:17:26:43 dynamic\"]\nswitch 14954deb-8379-447e-b124-b298724c2e18 (incus-net28-ls-ext)\n port incus-net28-ls-ext-lsp-router\n type: router\n router-port: incus-net28-lr-lrp-ext\n port incus-net28-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 3f25ce24-878f-44ba-816c-f3879a9246d9 (incus-net28-lr)\n port incus-net28-lr-lrp-ext\n mac: \"10:66:6a:14:21:7e\"\n ipv6-lla: \"fe80::1266:6aff:fe14:217e\"\n networks: [\"10.10.40.65/24\"]\n port incus-net28-lr-lrp-int\n mac: \"10:66:6a:14:21:7e\"\n ipv6-lla: \"fe80::1266:6aff:fe14:217e\"\n networks: [\"10.253.73.1/24\"]\n nat b7be98b3-6219-4570-b703-10742584342d\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net28-lr-lrp-ext\n Port_Binding incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 129d3583-97f3-4472-97d6-175385631e23\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 9d73b755-94be-4b3f-b088-f5d310cca707\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:14:21:7e\"\nname : incus-net28-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : ecd52c27-ef90-4b46-8e3c-3f3436f561f5\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:14:21:7e\"\nname : incus-net28-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 909852c0-afa5-460a-bebb-828ee9a761a3\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : 58cdf306-a3c4-40f7-bad0-0c40c8570600\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 688ab81f-fff2-4182-875d-41568113f0a5\nlogical_port : cr-incus-net28-lr-lrp-ext\nmac : [\"10:66:6a:14:21:7e 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net28-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:56.555750+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.302, "exit_code": 0, "stdout": "10.10.40.65 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T06:03:56.858391+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.14, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192981200926\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03252|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192981201051\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03253|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192981258870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03254|poll_loop|INFO|Dropped 12476 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192981259079\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03255|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192982200967\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03256|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192982201129\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192983201042\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03258|dpif|WARN|Dropped 2144 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192983201301\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192983224547\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03260|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192983224608\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03261|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789192984200968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03262|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192984201077\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192984580285\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03264|bridge|INFO|bridge br-int: added interface veth9470b3e9 on port 22\"\n },\n {\n \"at\": \"1789192985200827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03265|dpif|WARN|Dropped 1956 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192985200973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192986200741\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03267|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192986200996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192987200775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03269|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192987200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192987258777\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03271|poll_loop|INFO|Dropped 12221 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192987258896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03272|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192988200598\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03273|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192988200708\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192989200894\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03275|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192989201118\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192990201014\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03277|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192990201308\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192991200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03279|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192991201082\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192992200937\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03281|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192992201069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192993200564\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03283|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192993200784\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192993258668\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03285|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192993258795\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03286|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192994200903\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03287|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192994201132\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192995200903\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03289|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192995201170\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192996200630\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03291|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192996200772\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192997200880\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03293|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192997201141\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03294|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192998200916\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03295|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192998201156\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192999200682\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03297|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192999200797\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192999258844\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03299|poll_loop|INFO|Dropped 12062 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192999259061\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193000201155\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03301|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193000201290\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193001200811\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03303|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193001201065\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03304|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193002200845\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03305|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193002201077\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03306|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193003200861\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03307|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193003201073\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03308|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193004200808\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03309|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193004200921\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03310|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193005200998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03311|dpif|WARN|Dropped 1978 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193005201233\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03312|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193005258779\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03313|poll_loop|INFO|Dropped 11922 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193005258866\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03314|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193006200847\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03315|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193006201005\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03316|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193007200675\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03317|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193007201008\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03318|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193007283643\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03319|connmgr|INFO|br-int<->unix#7: 949 flow_mods in the 7 s starting 24 s ago (854 adds, 65 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789193008200750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03320|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193008200953\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03321|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193009200726\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03322|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193009200830\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193010200762\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03324|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193010200876\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03325|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193011200669\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03326|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193011200778\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03327|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193011258735\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03328|poll_loop|INFO|Dropped 12075 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193011258939\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03329|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193012200783\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03330|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193012200898\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03331|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193013200738\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03332|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193013200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03333|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193014139536\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03334|bridge|WARN|Dropped 123487 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193014139662\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03335|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789193014200924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03336|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193014201093\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03337|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193015201055\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03338|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193015201281\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03339|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193016200730\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03340|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193016200873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193017201029\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03342|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193017201353\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03343|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193017258909\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03344|poll_loop|INFO|Dropped 12011 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193017258991\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193018200938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03346|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193018201052\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03347|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193019200573\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03348|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193019200706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03349|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193020200659\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03350|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193020200868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03351|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193021200731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03352|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193021200933\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03353|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193022200673\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03354|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193022200791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03355|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193023200570\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03356|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193023200680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03357|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193023258905\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03358|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193023259061\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03359|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193024200878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03360|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193024200991\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03361|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193025200562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03362|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193025200815\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03363|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193026200827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03364|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193026201025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03365|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193027200565\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03366|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193027200680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03367|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193028200820\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03368|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193028201063\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03369|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193029200895\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03370|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193029201097\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193029258663\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03372|poll_loop|INFO|Dropped 12183 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193029258719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03373|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193030200770\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03374|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193030200896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193031201073\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03376|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193031201277\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193032200680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03378|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193032200780\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193033200976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03380|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193033201216\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03381|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193034200851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03382|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193034200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193035200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03384|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193035200915\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193035258700\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03386|poll_loop|INFO|Dropped 12168 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193035258751\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03387|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193036200608\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03388|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193036200719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:56.998562+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983217463\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00143|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983218383\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00144|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789193007277481\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00145|connmgr|INFO|br-int<->unix#7: 942 flow_mods in the 7 s starting 24 s ago (851 adds, 91 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:57.106816+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.102, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983223973\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983224172\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192985536173\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00155|bridge|INFO|bridge br-int: added interface vethc3c8caab on port 20\"\n },\n {\n \"at\": \"1789193007283241\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00156|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 24 s ago (868 adds, 96 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:57.208924+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.093, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983207988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00147|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983208267\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00148|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16\"\n },\n {\n \"at\": \"1789193007278102\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00149|connmgr|INFO|br-int<->unix#7: 998 flow_mods in the 7 s starting 24 s ago (879 adds, 119 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:03:57.302943+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-probe.txt", "router_mac": "10:66:6a:14:21:7e", "at": "2026-09-12T06:03:57.304721+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 61472, "ready": true, "ready_signal": "time=\"2026-09-11T23:03:57-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:03:57.400374+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/topology.jsonl", "destroy"], "seconds": 3.499, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:04:00.899664+00:00"} +{"capture": "monitor-delete", "pid": 61472, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.log", "ready_signal": "time=\"2026-09-11T23:03:57-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:04:00.904169+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.09, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:04:00.994469+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.104, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:04:01.098730+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.131, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:04:01.229711+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.265, "exit_code": 0, "stdout": "10.10.40.65 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T06:04:01.495324+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.143, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192981200926\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03252|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192981201051\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03253|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192981258870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03254|poll_loop|INFO|Dropped 12476 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192981259079\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03255|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192982200967\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03256|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192982201129\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192983201042\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03258|dpif|WARN|Dropped 2144 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192983201301\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192983224547\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03260|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789192983224608\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03261|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789192984200968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03262|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192984201077\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192984580285\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03264|bridge|INFO|bridge br-int: added interface veth9470b3e9 on port 22\"\n },\n {\n \"at\": \"1789192985200827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03265|dpif|WARN|Dropped 1956 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192985200973\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192986200741\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03267|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192986200996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192987200775\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03269|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192987200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192987258777\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03271|poll_loop|INFO|Dropped 12221 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192987258896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03272|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192988200598\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03273|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192988200708\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192989200894\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03275|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192989201118\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192990201014\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03277|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192990201308\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192991200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03279|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192991201082\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192992200937\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03281|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192992201069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192993200564\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03283|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192993200784\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192993258668\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03285|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192993258795\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03286|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789192994200903\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03287|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192994201132\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192995200903\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03289|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192995201170\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192996200630\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03291|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192996200772\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192997200880\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03293|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192997201141\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03294|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192998200916\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03295|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192998201156\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192999200682\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03297|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192999200797\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789192999258844\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03299|poll_loop|INFO|Dropped 12062 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789192999259061\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193000201155\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03301|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193000201290\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193001200811\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03303|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193001201065\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03304|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193002200845\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03305|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193002201077\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03306|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193003200861\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03307|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193003201073\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03308|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193004200808\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03309|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193004200921\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03310|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193005200998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03311|dpif|WARN|Dropped 1978 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193005201233\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03312|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193005258779\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03313|poll_loop|INFO|Dropped 11922 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193005258866\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03314|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193006200847\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03315|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193006201005\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03316|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193007200675\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03317|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193007201008\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03318|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193007283643\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03319|connmgr|INFO|br-int<->unix#7: 949 flow_mods in the 7 s starting 24 s ago (854 adds, 65 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789193008200750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03320|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193008200953\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03321|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193009200726\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03322|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193009200830\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193010200762\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03324|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193010200876\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03325|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193011200669\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03326|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193011200778\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03327|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193011258735\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03328|poll_loop|INFO|Dropped 12075 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193011258939\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03329|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193012200783\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03330|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193012200898\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03331|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193013200738\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03332|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193013200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03333|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193014139536\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03334|bridge|WARN|Dropped 123487 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193014139662\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03335|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789193014200924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03336|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193014201093\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03337|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193015201055\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03338|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193015201281\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03339|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193016200730\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03340|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193016200873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193017201029\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03342|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193017201353\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03343|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193017258909\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03344|poll_loop|INFO|Dropped 12011 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193017258991\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193018200938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03346|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193018201052\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03347|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193019200573\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03348|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193019200706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03349|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193020200659\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03350|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193020200868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03351|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193021200731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03352|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193021200933\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03353|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193022200673\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03354|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193022200791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03355|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193023200570\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03356|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193023200680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03357|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193023258905\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03358|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193023259061\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03359|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193024200878\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03360|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193024200991\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03361|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193025200562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03362|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193025200815\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03363|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193026200827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03364|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193026201025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03365|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193027200565\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03366|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193027200680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03367|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193028200820\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03368|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193028201063\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03369|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193029200895\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03370|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193029201097\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193029258663\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03372|poll_loop|INFO|Dropped 12183 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193029258719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03373|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193030200770\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03374|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193030200896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193031201073\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03376|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193031201277\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193032200680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03378|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193032200780\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193033200976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03380|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193033201216\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03381|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193034200851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03382|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193034200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193035200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03384|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193035200915\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193035258700\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03386|poll_loop|INFO|Dropped 12168 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193035258751\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03387|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193036200608\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03388|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193036200719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193037201027\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03390|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193037201247\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193037937201\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03392|bridge|INFO|bridge br-int: deleted interface veth9470b3e9 on port 22\"\n },\n {\n \"at\": \"1789193038200976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03393|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193038201069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03394|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193039200656\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03395|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193039200761\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03396|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193040200712\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03397|dpif|WARN|Dropped 2083 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193040200919\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03398|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193040244856\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03399|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4\"\n },\n {\n \"at\": \"1789193040244918\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03400|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789193041200950\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03401|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193041201149\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03402|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193041258571\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03403|poll_loop|INFO|Dropped 12358 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193041258630\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03404|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:04:01.646085+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.108, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983217463\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00143|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983218383\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00144|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14\"\n },\n {\n \"at\": \"1789193007277481\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00145|connmgr|INFO|br-int<->unix#7: 942 flow_mods in the 7 s starting 24 s ago (851 adds, 91 deletes)\"\n },\n {\n \"at\": \"1789193040238365\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00146|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789193040238653\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00147|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:04:01.755011+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.114, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983223973\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983224172\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19\"\n },\n {\n \"at\": \"1789192985536173\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00155|bridge|INFO|bridge br-int: added interface vethc3c8caab on port 20\"\n },\n {\n \"at\": \"1789193007283241\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00156|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 24 s ago (868 adds, 96 deletes)\"\n },\n {\n \"at\": \"1789193038919275\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00157|bridge|INFO|bridge br-int: deleted interface vethc3c8caab on port 20\"\n },\n {\n \"at\": \"1789193040235660\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00158|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789193040235774\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00159|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:04:01.869930+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A03%3A00.664582%2B00%3A00"], "seconds": 0.1, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789192983207988\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00147|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789192983208267\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00148|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16\"\n },\n {\n \"at\": \"1789193007278102\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00149|connmgr|INFO|br-int<->unix#7: 998 flow_mods in the 7 s starting 24 s ago (879 adds, 119 deletes)\"\n },\n {\n \"at\": \"1789193040248550\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00150|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789193040248768\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00151|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:04:01.970882+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T06:04:01.971434+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/keeper-3/create.stdout.json new file mode 100644 index 0000000..42bec37 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.257, + "first_cross_member_ping_seconds": 3.616, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/cycle.json b/spikes/ovn/diagnosis-2026-09-12/keeper-3/cycle.json new file mode 100644 index 0000000..209d469 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/cycle.json @@ -0,0 +1,121 @@ +{ + "ok": false, + "datapath_ok": false, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 1, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T06:03:00.664582+00:00", + "ended_at": "2026-09-12T06:04:01.971653+00:00", + "seconds": 61.306, + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:14:21:7e", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.257, + "first_cross_member_ping_seconds": 3.616, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": false, + "exit_code": 1, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.096 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.106 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f0ee7ab-55de-448b-a76c-e79b17649762\",\"volatile.eth0.host_name\":\"veth9470b3e9\",\"volatile.eth0.hwaddr\":\"10:66:6a:17:26:43\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\"volatile.uuid.generation\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:03:04.028158519Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f0ee7ab-55de-448b-a76c-e79b17649762\",\"volatile.eth0.host_name\":\"veth9470b3e9\",\"volatile.eth0.hwaddr\":\"10:66:6a:17:26:43\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\"volatile.uuid.generation\":\"87f23f8a-492f-4897-a8a2-f9ea297830ae\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:03:04.70671227Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9957376,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe17:2643\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:17:26:43\",\"host_name\":\"veth9470b3e9\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4073065,\"processes\":4,\"cpu\":{\"usage\":478372000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:03:03.730000019Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\"volatile.eth0.host_name\":\"vethc3c8caab\",\"volatile.eth0.hwaddr\":\"10:66:6a:c0:e0:7c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\"volatile.uuid.generation\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:03:04.977165511Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\"volatile.eth0.host_name\":\"vethc3c8caab\",\"volatile.eth0.hwaddr\":\"10:66:6a:c0:e0:7c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\"volatile.uuid.generation\":\"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:03:05.618869203Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11526144,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fec0:e07c\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:c0:e0:7c\",\"host_name\":\"vethc3c8caab\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":14492,\"processes\":4,\"cpu\":{\"usage\":490199000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:03:05.630000114Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.117 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.325 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.301 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.278 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.797 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.352 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.352/0.809/1.278 ms\nelapsed_seconds=2.275 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.905 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.796 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.351 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.351/0.684/0.905 ms\nelapsed_seconds=2.265 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.299 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.775 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.308 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.235 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.254 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5001 milliseconds\nelapsed_seconds=5.289 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5006 ms: Timeout was reached\nelapsed_seconds=5.035 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.116984 bytes_per_second=854817752\nelapsed_seconds=0.363 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.533 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.136481 bytes_per_second=732702720\nelapsed_seconds=0.909 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.537 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", + "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 59028, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.log", + "bytes": 175513, + "ready_signal": "time=\"2026-09-11T23:03:01-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:03:01.186234+00:00", + "stopped_at": "2026-09-12T06:03:10.706034+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 59649, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/tcpdump-arp.log", + "bytes": 188, + "ready_signal": "listening on", + "started_at": "2026-09-12T06:03:12.308424+00:00", + "stopped_at": "2026-09-12T06:03:56.242875+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 61472, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.log", + "bytes": 40096, + "ready_signal": "time=\"2026-09-11T23:03:57-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:03:57.305226+00:00", + "stopped_at": "2026-09-12T06:04:00.903719+00:00" + } + ], + "failures": { + "checks": [ + "probe: probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed" + ], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/keeper-3" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/keeper-3/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-probe.txt new file mode 100644 index 0000000..fd110af --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-probe.txt @@ -0,0 +1,1132 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:17:26:43 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:c0:e0:7c | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch a7826682-25b6-433c-a551-e24d71fdc0aa (incus-net28-ls-int) + port incus-net28-ls-int-lsp-router + type: router + router-port: incus-net28-lr-lrp-int + port incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0 + addresses: ["10:66:6a:c0:e0:7c dynamic"] + port incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0 + addresses: ["10:66:6a:17:26:43 dynamic"] +switch 14954deb-8379-447e-b124-b298724c2e18 (incus-net28-ls-ext) + port incus-net28-ls-ext-lsp-router + type: router + router-port: incus-net28-lr-lrp-ext + port incus-net28-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 3f25ce24-878f-44ba-816c-f3879a9246d9 (incus-net28-lr) + port incus-net28-lr-lrp-ext + mac: "10:66:6a:14:21:7e" + ipv6-lla: "fe80::1266:6aff:fe14:217e" + networks: ["10.10.40.65/24"] + port incus-net28-lr-lrp-int + mac: "10:66:6a:14:21:7e" + ipv6-lla: "fe80::1266:6aff:fe14:217e" + networks: ["10.253.73.1/24"] + nat b7be98b3-6219-4570-b703-10742584342d + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net28-lr-lrp-ext + Port_Binding incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 129d3583-97f3-4472-97d6-175385631e23 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 9d73b755-94be-4b3f-b088-f5d310cca707 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:14:21:7e" +name : incus-net28-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : ecd52c27-ef90-4b46-8e3c-3f3436f561f5 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:14:21:7e" +name : incus-net28-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 909852c0-afa5-460a-bebb-828ee9a761a3 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 58cdf306-a3c4-40f7-bad0-0c40c8570600 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 688ab81f-fff2-4182-875d-41568113f0a5 +logical_port : cr-incus-net28-lr-lrp-ext +mac : ["10:66:6a:14:21:7e 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net28-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192981200926", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03252|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192981201051", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03253|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192981258870", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03254|poll_loop|INFO|Dropped 12476 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192981259079", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03255|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192982200967", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03256|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192982201129", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192983201042", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03258|dpif|WARN|Dropped 2144 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192983201301", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192983224547", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03260|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192983224608", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03261|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789192984200968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03262|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192984201077", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192984580285", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03264|bridge|INFO|bridge br-int: added interface veth9470b3e9 on port 22" + }, + { + "at": "1789192985200827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03265|dpif|WARN|Dropped 1956 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192985200973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192986200741", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03267|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192986200996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192987200775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03269|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192987200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192987258777", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03271|poll_loop|INFO|Dropped 12221 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192987258896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03272|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192988200598", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03273|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192988200708", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192989200894", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03275|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192989201118", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192990201014", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03277|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192990201308", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192991200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03279|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192991201082", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192992200937", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03281|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192992201069", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192993200564", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03283|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192993200784", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192993258668", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03285|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192993258795", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03286|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192994200903", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03287|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192994201132", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192995200903", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03289|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192995201170", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192996200630", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03291|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192996200772", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192997200880", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03293|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192997201141", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03294|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192998200916", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03295|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192998201156", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192999200682", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03297|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192999200797", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192999258844", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03299|poll_loop|INFO|Dropped 12062 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192999259061", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193000201155", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03301|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193000201290", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193001200811", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03303|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193001201065", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03304|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193002200845", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03305|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193002201077", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03306|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193003200861", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03307|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193003201073", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03308|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193004200808", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03309|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193004200921", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03310|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193005200998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03311|dpif|WARN|Dropped 1978 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193005201233", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03312|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193005258779", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03313|poll_loop|INFO|Dropped 11922 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193005258866", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03314|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193006200847", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03315|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193006201005", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03316|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193007200675", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03317|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193007201008", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03318|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193007283643", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03319|connmgr|INFO|br-int<->unix#7: 949 flow_mods in the 7 s starting 24 s ago (854 adds, 65 deletes, 30 modifications)" + }, + { + "at": "1789193008200750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03320|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193008200953", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03321|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193009200726", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03322|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193009200830", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193010200762", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03324|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193010200876", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03325|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193011200669", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03326|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193011200778", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03327|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193011258735", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03328|poll_loop|INFO|Dropped 12075 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193011258939", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03329|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193012200783", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03330|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193012200898", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03331|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193013200738", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03332|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193013200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03333|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193014139536", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03334|bridge|WARN|Dropped 123487 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193014139662", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03335|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789193014200924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03336|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193014201093", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03337|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193015201055", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03338|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193015201281", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03339|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193016200730", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03340|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193016200873", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193017201029", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03342|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193017201353", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03343|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193017258909", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03344|poll_loop|INFO|Dropped 12011 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193017258991", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193018200938", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03346|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193018201052", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03347|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193019200573", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03348|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193019200706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03349|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193020200659", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03350|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193020200868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03351|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193021200731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03352|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193021200933", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03353|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193022200673", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03354|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193022200791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03355|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193023200570", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03356|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193023200680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03357|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193023258905", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03358|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193023259061", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03359|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193024200878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03360|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193024200991", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03361|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193025200562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03362|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193025200815", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03363|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193026200827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03364|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193026201025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03365|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193027200565", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03366|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193027200680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03367|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193028200820", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03368|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193028201063", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03369|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193029200895", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03370|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193029201097", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193029258663", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03372|poll_loop|INFO|Dropped 12183 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193029258719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03373|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193030200770", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03374|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193030200896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193031201073", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03376|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193031201277", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193032200680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03378|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193032200780", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193033200976", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03380|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193033201216", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03381|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193034200851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03382|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193034200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193035200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03384|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193035200915", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193035258700", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03386|poll_loop|INFO|Dropped 12168 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193035258751", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03387|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193036200608", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03388|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193036200719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983217463", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00143|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983218383", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00144|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789193007277481", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00145|connmgr|INFO|br-int<->unix#7: 942 flow_mods in the 7 s starting 24 s ago (851 adds, 91 deletes)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983223973", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983224172", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192985536173", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00155|bridge|INFO|bridge br-int: added interface vethc3c8caab on port 20" + }, + { + "at": "1789193007283241", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00156|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 24 s ago (868 adds, 96 deletes)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983207988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00147|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983208267", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00148|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16" + }, + { + "at": "1789193007278102", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00149|connmgr|INFO|br-int<->unix#7: 998 flow_mods in the 7 s starting 24 s ago (879 adds, 119 deletes)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-teardown.txt new file mode 100644 index 0000000..ad4dbac --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-after-teardown.txt @@ -0,0 +1,1146 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192981200926", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03252|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192981201051", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03253|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192981258870", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03254|poll_loop|INFO|Dropped 12476 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192981259079", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03255|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192982200967", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03256|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192982201129", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192983201042", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03258|dpif|WARN|Dropped 2144 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192983201301", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192983224547", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03260|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192983224608", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03261|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789192984200968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03262|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192984201077", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192984580285", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03264|bridge|INFO|bridge br-int: added interface veth9470b3e9 on port 22" + }, + { + "at": "1789192985200827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03265|dpif|WARN|Dropped 1956 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192985200973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192986200741", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03267|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192986200996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192987200775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03269|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192987200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192987258777", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03271|poll_loop|INFO|Dropped 12221 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192987258896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03272|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192988200598", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03273|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192988200708", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192989200894", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03275|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192989201118", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192990201014", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03277|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192990201308", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192991200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03279|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192991201082", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192992200937", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03281|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192992201069", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192993200564", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03283|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192993200784", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192993258668", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03285|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192993258795", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03286|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192994200903", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03287|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192994201132", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192995200903", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03289|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192995201170", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03290|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192996200630", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03291|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192996200772", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192997200880", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03293|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192997201141", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03294|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192998200916", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03295|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192998201156", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192999200682", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03297|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192999200797", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192999258844", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03299|poll_loop|INFO|Dropped 12062 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192999259061", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03300|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193000201155", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03301|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193000201290", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193001200811", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03303|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193001201065", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03304|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193002200845", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03305|dpif|WARN|Dropped 1981 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193002201077", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03306|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193003200861", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03307|dpif|WARN|Dropped 1972 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193003201073", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03308|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193004200808", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03309|dpif|WARN|Dropped 1974 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193004200921", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03310|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193005200998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03311|dpif|WARN|Dropped 1978 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193005201233", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03312|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193005258779", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03313|poll_loop|INFO|Dropped 11922 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193005258866", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03314|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193006200847", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03315|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193006201005", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03316|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193007200675", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03317|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193007201008", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03318|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193007283643", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03319|connmgr|INFO|br-int<->unix#7: 949 flow_mods in the 7 s starting 24 s ago (854 adds, 65 deletes, 30 modifications)" + }, + { + "at": "1789193008200750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03320|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193008200953", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03321|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193009200726", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03322|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193009200830", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03323|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193010200762", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03324|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193010200876", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03325|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193011200669", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03326|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193011200778", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03327|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193011258735", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03328|poll_loop|INFO|Dropped 12075 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193011258939", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03329|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193012200783", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03330|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193012200898", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03331|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193013200738", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03332|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193013200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03333|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193014139536", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03334|bridge|WARN|Dropped 123487 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193014139662", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03335|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789193014200924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03336|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193014201093", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03337|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193015201055", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03338|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193015201281", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03339|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193016200730", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03340|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193016200873", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193017201029", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03342|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193017201353", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03343|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193017258909", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03344|poll_loop|INFO|Dropped 12011 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193017258991", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03345|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193018200938", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03346|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193018201052", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03347|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193019200573", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03348|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193019200706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03349|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193020200659", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03350|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193020200868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03351|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193021200731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03352|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193021200933", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03353|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193022200673", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03354|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193022200791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03355|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193023200570", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03356|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193023200680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03357|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193023258905", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03358|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193023259061", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03359|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193024200878", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03360|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193024200991", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03361|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193025200562", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03362|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193025200815", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03363|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193026200827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03364|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193026201025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03365|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193027200565", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03366|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193027200680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03367|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193028200820", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03368|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193028201063", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03369|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193029200895", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03370|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193029201097", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193029258663", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03372|poll_loop|INFO|Dropped 12183 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193029258719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03373|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193030200770", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03374|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193030200896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193031201073", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03376|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193031201277", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193032200680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03378|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193032200780", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193033200976", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03380|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193033201216", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03381|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193034200851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03382|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193034200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193035200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03384|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193035200915", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193035258700", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03386|poll_loop|INFO|Dropped 12168 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193035258751", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03387|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193036200608", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03388|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193036200719", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193037201027", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03390|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193037201247", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193037937201", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03392|bridge|INFO|bridge br-int: deleted interface veth9470b3e9 on port 22" + }, + { + "at": "1789193038200976", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03393|dpif|WARN|Dropped 1951 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193038201069", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03394|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193039200656", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03395|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193039200761", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03396|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193040200712", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03397|dpif|WARN|Dropped 2083 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193040200919", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03398|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193040244856", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03399|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789193040244918", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03400|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789193041200950", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03401|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193041201149", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03402|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193041258571", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03403|poll_loop|INFO|Dropped 12358 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193041258630", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03404|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983217463", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00143|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983218383", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00144|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14" + }, + { + "at": "1789193007277481", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00145|connmgr|INFO|br-int<->unix#7: 942 flow_mods in the 7 s starting 24 s ago (851 adds, 91 deletes)" + }, + { + "at": "1789193040238365", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00146|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789193040238653", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00147|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983223973", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983224172", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192985536173", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00155|bridge|INFO|bridge br-int: added interface vethc3c8caab on port 20" + }, + { + "at": "1789193007283241", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00156|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 24 s ago (868 adds, 96 deletes)" + }, + { + "at": "1789193038919275", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00157|bridge|INFO|bridge br-int: deleted interface vethc3c8caab on port 20" + }, + { + "at": "1789193040235660", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00158|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789193040235774", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00159|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983207988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00147|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983208267", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00148|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16" + }, + { + "at": "1789193007278102", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00149|connmgr|INFO|br-int<->unix#7: 998 flow_mods in the 7 s starting 24 s ago (879 adds, 119 deletes)" + }, + { + "at": "1789193040248550", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00150|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789193040248768", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00151|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-before-probe.txt new file mode 100644 index 0000000..c5e3590 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/diagnostics-before-probe.txt @@ -0,0 +1,460 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab03 + - nas01 + - lab01 + - lab02 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:17:26:43 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:c0:e0:7c | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch a7826682-25b6-433c-a551-e24d71fdc0aa (incus-net28-ls-int) + port incus-net28-ls-int-lsp-router + type: router + router-port: incus-net28-lr-lrp-int + port incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0 + addresses: ["10:66:6a:c0:e0:7c dynamic"] + port incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0 + addresses: ["10:66:6a:17:26:43 dynamic"] +switch 14954deb-8379-447e-b124-b298724c2e18 (incus-net28-ls-ext) + port incus-net28-ls-ext-lsp-router + type: router + router-port: incus-net28-lr-lrp-ext + port incus-net28-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 3f25ce24-878f-44ba-816c-f3879a9246d9 (incus-net28-lr) + port incus-net28-lr-lrp-ext + mac: "10:66:6a:14:21:7e" + ipv6-lla: "fe80::1266:6aff:fe14:217e" + networks: ["10.10.40.65/24"] + port incus-net28-lr-lrp-int + mac: "10:66:6a:14:21:7e" + ipv6-lla: "fe80::1266:6aff:fe14:217e" + networks: ["10.253.73.1/24"] + nat b7be98b3-6219-4570-b703-10742584342d + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net28-instance-c6c5b77e-49a5-40a5-9a20-669f7bea4d63-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net28-lr-lrp-ext + Port_Binding incus-net28-instance-87f23f8a-492f-4897-a8a2-f9ea297830ae-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 129d3583-97f3-4472-97d6-175385631e23 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 9d73b755-94be-4b3f-b088-f5d310cca707 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:14:21:7e" +name : incus-net28-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : ecd52c27-ef90-4b46-8e3c-3f3436f561f5 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:14:21:7e" +name : incus-net28-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 909852c0-afa5-460a-bebb-828ee9a761a3 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : 58cdf306-a3c4-40f7-bad0-0c40c8570600 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 688ab81f-fff2-4182-875d-41568113f0a5 +logical_port : cr-incus-net28-lr-lrp-ext +mac : ["10:66:6a:14:21:7e 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net28-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:6c:ad:18 PROBE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192981200926", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03252|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192981201051", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03253|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192981258870", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03254|poll_loop|INFO|Dropped 12476 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192981259079", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03255|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192982200967", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03256|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192982201129", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192983201042", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03258|dpif|WARN|Dropped 2144 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192983201301", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192983224547", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03260|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 4" + }, + { + "at": "1789192983224608", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03261|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789192984200968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03262|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192984201077", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192984580285", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03264|bridge|INFO|bridge br-int: added interface veth9470b3e9 on port 22" + }, + { + "at": "1789192985200827", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03265|dpif|WARN|Dropped 1956 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192985200973", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192986200741", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03267|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192986200996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192987200775", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03269|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192987200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192987258777", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03271|poll_loop|INFO|Dropped 12221 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192987258896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03272|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789192988200598", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03273|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192988200708", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192989200894", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03275|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192989201118", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03276|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192990201014", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03277|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192990201308", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192991200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03279|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789192991201082", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983217463", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00143|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983218383", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00144|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 14" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983223973", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983224172", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 19" + }, + { + "at": "1789192985536173", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00155|bridge|INFO|bridge br-int: added interface vethc3c8caab on port 20" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789192983207988", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00147|bridge|INFO|bridge incusovn16: added interface patch-incus-net28-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789192983208267", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00148|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net28-ls-ext-lsp-provider on port 16" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.debug.log new file mode 100644 index 0000000..c8a1403 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:03:01-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.log new file mode 100644 index 0000000..be8659c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-create.log @@ -0,0 +1,542 @@ +time="2026-09-12T06:03:01Z" level=debug msg="[nas01] Event listener server handler started" id=255997ce-a667-45ad-9184-0838fe396d2e local="10.10.10.14:8443" remote="100.122.142.76:62509" +time="2026-09-12T06:03:01Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:03:01Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62527" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62528" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62529" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62530" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62531" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62532" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62533" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62534" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Completed heartbeat round" duration=6.461060751s +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62535" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62536" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:14:21:7e" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.28 +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net28 driver=ovn memberID=1 network=default priority=9291 project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62537" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62538" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62539" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62540" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62541" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62542" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62543" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62544" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62545" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Event listener server handler started" id=8c47cfc6-100d-4fd3-9eb3-901bf55a6255 local="10.10.10.14:8443" remote="100.122.142.76:62545" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62546" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=fdbe359d-e1a9-4807-910b-d9caef972be9 project=image-build +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=fdbe359d-e1a9-4807-910b-d9caef972be9 project=image-build +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62547" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Event listener server handler started" id=a76ec7e5-4bc7-4844-9168-5c55e024aaf6 local="10.10.10.14:8443" remote="100.122.142.76:62547" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62548" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=e121bd03-68d0-4520-b0fa-125980b2bad5 project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=e121bd03-68d0-4520-b0fa-125980b2bad5 project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=e121bd03-68d0-4520-b0fa-125980b2bad5 project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62549" method=GET protocol=tls url="/1.0/operations/e121bd03-68d0-4520-b0fa-125980b2bad5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=e121bd03-68d0-4520-b0fa-125980b2bad5 project=ac-ovn-spike +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a76ec7e5-4bc7-4844-9168-5c55e024aaf6 local="10.10.10.14:8443" remote="100.122.142.76:62547" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8c47cfc6-100d-4fd3-9eb3-901bf55a6255 local="10.10.10.14:8443" remote="100.122.142.76:62545" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62550" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62551" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T06:03:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"b2aa45d8-4392-4cf3-b0af-38f1e33dd515\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:03:03.94197694Z\",\n\t\t\"updated_at\": \"2026-09-12T06:03:03.94197694Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62552" method=GET protocol=tls url="/1.0/operations/b2aa45d8-4392-4cf3-b0af-38f1e33dd515/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:04Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:03:04Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62553" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62554" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62555" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Event listener server handler started" id=ba0bde50-f16d-4464-8aa2-0b2ad01336ce local="10.10.10.14:8443" remote="100.122.142.76:62555" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62556" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:04Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 06:03:04.028158519 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62557" method=GET protocol=tls url="/1.0/operations/96787d35-e1a2-4916-a6d9-8245d70a4dce?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:04Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 06:03:04.028158519 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ba0bde50-f16d-4464-8aa2-0b2ad01336ce local="10.10.10.14:8443" remote="100.122.142.76:62555" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62558" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62559" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"bd9c2bab-2699-4687-a4e8-3bf9942b654a\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:03:04.925516716Z\",\n\t\t\"updated_at\": \"2026-09-12T06:03:04.925516716Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62560" method=GET protocol=tls url="/1.0/operations/bd9c2bab-2699-4687-a4e8-3bf9942b654a/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:04Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:03:05Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62561" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62562" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62563" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Event listener server handler started" id=58d0d1e2-170b-4018-b6c5-63ef8d63c204 local="10.10.10.14:8443" remote="100.122.142.76:62563" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62564" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:05Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 06:03:04.977165511 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62565" method=GET protocol=tls url="/1.0/operations/53feedb8-122c-4b40-b2ab-33800cb84284?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:05Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 06:03:04.977165511 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Event listener server handler stopped" listener=58d0d1e2-170b-4018-b6c5-63ef8d63c204 local="10.10.10.14:8443" remote="100.122.142.76:62563" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62566" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62567" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62568" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62569" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62570" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62571" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62572" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62573" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62574" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Event listener server handler started" id=104e1ca0-b897-4c05-b45d-1807053e505c local="10.10.10.14:8443" remote="100.122.142.76:62575" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62575" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62576" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62577" method=GET protocol=tls url="/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=febfbea105bfc7371dec2c6b7b58dd0ed2e05ea224601756debe5f968ce72c47" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=febfbea105bfc7371dec2c6b7b58dd0ed2e05ea224601756debe5f968ce72c47" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62577" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62578" method=GET protocol=tls url="/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=563fceb4dea8947c76646dd0281c81ef1c06fdae523f40eed9815e8be9912513" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62578" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=563fceb4dea8947c76646dd0281c81ef1c06fdae523f40eed9815e8be9912513" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62579" method=GET protocol=tls url="/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=823430e7e9126c9097ced8fd46209c29d9d8ecb1215fb09604144f68411665bb" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62579" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=823430e7e9126c9097ced8fd46209c29d9d8ecb1215fb09604144f68411665bb" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62580" method=GET protocol=tls url="/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=2ab04707c6e518aed756dfa3a63f8a7aaad40bb297916bcd630e7fcf3af03ad8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62580" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf/websocket?secret=2ab04707c6e518aed756dfa3a63f8a7aaad40bb297916bcd630e7fcf3af03ad8" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62578" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62581" method=GET protocol=tls url="/1.0/operations/25725bcd-9804-4f89-a14c-0a4a8e95fcdf?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62577" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62579" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62580" +time="2026-09-12T06:03:06Z" level=debug msg="[nas01] Event listener server handler stopped" listener=104e1ca0-b897-4c05-b45d-1807053e505c local="10.10.10.14:8443" remote="100.122.142.76:62575" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62582" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62583" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62584" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62585" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Event listener server handler started" id=ba7e385c-c91f-47e4-b690-86698445da77 local="10.10.10.14:8443" remote="100.122.142.76:62585" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62586" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62587" method=GET protocol=tls url="/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=7c65ebb969db5df0de791a31ee4eef567f0fdf04204dd73debbf01c1c5f6e89e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=7c65ebb969db5df0de791a31ee4eef567f0fdf04204dd73debbf01c1c5f6e89e" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62587" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62588" method=GET protocol=tls url="/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=11e3d91802b843cc26e4e710335df387ea1c3260d83d69497d45c16aaebd039d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=11e3d91802b843cc26e4e710335df387ea1c3260d83d69497d45c16aaebd039d" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62588" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62589" method=GET protocol=tls url="/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=e608468d85c9c344b4020680eddef4c292e016ed134f77e3d54b6086c8579c96" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=e608468d85c9c344b4020680eddef4c292e016ed134f77e3d54b6086c8579c96" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62589" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62590" method=GET protocol=tls url="/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=92a90e06e040fd3e916f6119f6140674a4319780a599bd00d5179a4861f61bd7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4/websocket?secret=92a90e06e040fd3e916f6119f6140674a4319780a599bd00d5179a4861f61bd7" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62590" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62588" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62587" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62590" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62589" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62591" method=GET protocol=tls url="/1.0/operations/33746d4f-7a5e-414a-b3fa-2ee92c94f2e4?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ba7e385c-c91f-47e4-b690-86698445da77 local="10.10.10.14:8443" remote="100.122.142.76:62585" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62592" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62593" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Event listener server handler started" id=44c59790-e01e-4fba-b888-8bf9bffb394f local="10.10.10.14:8443" remote="100.122.142.76:62593" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62594" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62595" method=GET protocol=tls url="/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=c858d1dcb1ff03ce239595596c6ed07c585919ca339374ca2a07de7fbcb1ee8c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=c858d1dcb1ff03ce239595596c6ed07c585919ca339374ca2a07de7fbcb1ee8c" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62595" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62596" method=GET protocol=tls url="/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=5c05237a2be8b0cf8ed657dd6b5c52a714a7329a188f554326afe1a416bca86a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=5c05237a2be8b0cf8ed657dd6b5c52a714a7329a188f554326afe1a416bca86a" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62596" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62597" method=GET protocol=tls url="/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=5ffa642a9f935957f8d3e80d4e02d50ea65090eceb87a7739ec5e3b61d86c5f2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62597" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=5ffa642a9f935957f8d3e80d4e02d50ea65090eceb87a7739ec5e3b61d86c5f2" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62598" method=GET protocol=tls url="/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=ba18bed2f83da89dcfbc3dd12374e8348357fbc43d6c589661511d2eb119b51e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771/websocket?secret=ba18bed2f83da89dcfbc3dd12374e8348357fbc43d6c589661511d2eb119b51e" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62598" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62596" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62599" method=GET protocol=tls url="/1.0/operations/fa35bf95-6365-4956-a5e6-7ba54bb6d771?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62595" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62598" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62597" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Event listener server handler stopped" listener=44c59790-e01e-4fba-b888-8bf9bffb394f local="10.10.10.14:8443" remote="100.122.142.76:62593" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62600" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62601" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62602" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62603" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Event listener server handler started" id=a11dc016-83ee-44a8-9be9-e4308c8331cc local="10.10.10.14:8443" remote="100.122.142.76:62603" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62604" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62605" method=GET protocol=tls url="/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=65985c80383fcd56a338e1e79b46a71d8aacf28cb828a7ffe183724b8cb28561" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=65985c80383fcd56a338e1e79b46a71d8aacf28cb828a7ffe183724b8cb28561" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62605" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62606" method=GET protocol=tls url="/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=c3259e05f37d800f707f6382bc1d8ffbf5d86f68f0b9959b6dc33887517c96c0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=c3259e05f37d800f707f6382bc1d8ffbf5d86f68f0b9959b6dc33887517c96c0" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62606" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62607" method=GET protocol=tls url="/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=bfd20be0a78ed533898bc6acfd6c4eec7b3c82d52d8fb1267688ea7b65ca8ea9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62607" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=bfd20be0a78ed533898bc6acfd6c4eec7b3c82d52d8fb1267688ea7b65ca8ea9" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62608" method=GET protocol=tls url="/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=657f4a46a17493c4b0d76485c44247befd0a4fa2776156d97ae5f54305c2f863" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6/websocket?secret=657f4a46a17493c4b0d76485c44247befd0a4fa2776156d97ae5f54305c2f863" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62608" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62606" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62609" method=GET protocol=tls url="/1.0/operations/76fa2718-8173-4248-85aa-2cfc78cfc9d6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62607" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62608" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62605" +time="2026-09-12T06:03:08Z" level=debug msg="[nas01] Event listener server handler stopped" listener=a11dc016-83ee-44a8-9be9-e4308c8331cc local="10.10.10.14:8443" remote="100.122.142.76:62603" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62610" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Event listener server handler started" id=3cb8f857-b3f9-4598-a0d8-7ca7fa78362b local="10.10.10.14:8443" remote="100.122.142.76:62611" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62611" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62612" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62613" method=GET protocol=tls url="/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=f2b3f228c919b3b71dacf54b099d11673e826cc64a4417bb81e68650b7b63e1d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=f2b3f228c919b3b71dacf54b099d11673e826cc64a4417bb81e68650b7b63e1d" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62613" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62614" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62614" method=GET protocol=tls url="/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=082f8f103aa7f7be809b27988d604cfc0d0e92b309e7d664ad715e5fa1070b8f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=082f8f103aa7f7be809b27988d604cfc0d0e92b309e7d664ad715e5fa1070b8f" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62615" method=GET protocol=tls url="/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=337ade652b47d355eab08305ddb409886dd0a8994547498b448b3ed397cf21d5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62615" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=337ade652b47d355eab08305ddb409886dd0a8994547498b448b3ed397cf21d5" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62616" method=GET protocol=tls url="/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=fe78e30f00b8b1d4f5227b1a62b1711fe22fe73b652890b8444f0f8d53e2f2fb" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62616" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6/websocket?secret=fe78e30f00b8b1d4f5227b1a62b1711fe22fe73b652890b8444f0f8d53e2f2fb" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62614" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62617" method=GET protocol=tls url="/1.0/operations/cae5e9a5-ae7c-40ed-b9d8-fc7bb19216a6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62615" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62613" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62616" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Event listener server handler stopped" listener=3cb8f857-b3f9-4598-a0d8-7ca7fa78362b local="10.10.10.14:8443" remote="100.122.142.76:62611" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62618" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62619" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Event listener server handler started" id=d385d2d4-9329-45a3-ac66-5711a3718e98 local="10.10.10.14:8443" remote="100.122.142.76:62619" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62620" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62621" method=GET protocol=tls url="/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=13d4551a6cdd03d470466c7b8f04cd6e661f03ad349c75ed42da0d2fae1ea041" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62621" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=13d4551a6cdd03d470466c7b8f04cd6e661f03ad349c75ed42da0d2fae1ea041" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62622" method=GET protocol=tls url="/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=f23a420cb8b02fa2b1f735cb03c3fb460f52b21ff61c1ad169f1533b420ba640" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62622" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=f23a420cb8b02fa2b1f735cb03c3fb460f52b21ff61c1ad169f1533b420ba640" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62623" method=GET protocol=tls url="/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=9fe7f91a2934fc45e806aa5db5aabe463b9ea97a144ff8ec405d9616ef4cef43" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62623" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=9fe7f91a2934fc45e806aa5db5aabe463b9ea97a144ff8ec405d9616ef4cef43" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62624" method=GET protocol=tls url="/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=15794ce0dc3ba1b71f6c673bda9ab83b1bbd4a9ba9052f681755af4e234507d5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c/websocket?secret=15794ce0dc3ba1b71f6c673bda9ab83b1bbd4a9ba9052f681755af4e234507d5" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:62624" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62622" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62625" method=GET protocol=tls url="/1.0/operations/fb09fdf4-48eb-4766-a481-a42cd7d4821c?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62624" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62623" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:62621" +time="2026-09-12T06:03:09Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d385d2d4-9329-45a3-ac66-5711a3718e98 local="10.10.10.14:8443" remote="100.122.142.76:62619" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62626" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Event listener server handler started" id=68fc14ef-4638-4fe5-a4e3-ecc0adc26941 local="10.10.10.14:8443" remote="100.122.142.76:62627" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62627" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62628" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62629" method=GET protocol=tls url="/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=07424b13ed6b8a5ebad61f761afbfef8d92a537956c6a0ab172e0a6ddc74f851" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=07424b13ed6b8a5ebad61f761afbfef8d92a537956c6a0ab172e0a6ddc74f851" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62629" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62630" method=GET protocol=tls url="/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=4c7345ffd30e578e4ea6c508600c9969452930557ca2948458a4feb52f7292c9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=4c7345ffd30e578e4ea6c508600c9969452930557ca2948458a4feb52f7292c9" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62630" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62631" method=GET protocol=tls url="/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=3d08c35f6abb8f688c90b83c03ae661220ce0a6f41279fc27d54e2084f73237c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62631" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=3d08c35f6abb8f688c90b83c03ae661220ce0a6f41279fc27d54e2084f73237c" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62632" method=GET protocol=tls url="/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=95a67517ecd36ee4f596f4f35a952fa1fa819ba642736763325a14a6cb171623" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:62632" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee/websocket?secret=95a67517ecd36ee4f596f4f35a952fa1fa819ba642736763325a14a6cb171623" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62630" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62633" method=GET protocol=tls url="/1.0/operations/ed4a78ad-efc4-41b3-9b24-b595a43e06ee?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62629" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62632" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:62631" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Event listener server handler stopped" listener=68fc14ef-4638-4fe5-a4e3-ecc0adc26941 local="10.10.10.14:8443" remote="100.122.142.76:62627" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62634" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62635" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:03:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.debug.log new file mode 100644 index 0000000..6e4c6be --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:03:57-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.log new file mode 100644 index 0000000..35eb874 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/monitor-delete.log @@ -0,0 +1,164 @@ +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Event listener server handler started" id=db8430a4-11eb-4487-90cf-a62a0319ce7a local="10.10.10.14:8443" remote="100.122.142.76:62810" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62811" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62812" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62813" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62814" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:03:04.028158519Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:03:04.70671227Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:03:04.977165511Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:03:05.618869203Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62815" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62816" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62817" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Event listener server handler started" id=4ee4eed6-3dcf-4937-9ad3-801820910ce4 local="10.10.10.14:8443" remote="100.122.142.76:62817" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62818" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:03:57Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 06:03:04.028158519 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:03:04.70671227 +0000 UTC" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62819" method=GET protocol=tls url="/1.0/operations/40671ce4-b412-414a-9eef-cee4cad14892?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62820" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:58Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 06:03:04.028158519 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:03:04.70671227 +0000 UTC" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62821" method=GET protocol=tls url="/1.0/operations/c67fc074-195f-4624-a289-1d9e928b4476?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:03:58Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 06:03:04.028158519 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:03:04.70671227 +0000 UTC" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Event listener server handler stopped" listener=4ee4eed6-3dcf-4937-9ad3-801820910ce4 local="10.10.10.14:8443" remote="100.122.142.76:62817" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62822" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62823" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62824" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Event listener server handler started" id=47ae1f63-ee34-44d2-8064-ed1e83ab28b4 local="10.10.10.14:8443" remote="100.122.142.76:62824" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62825" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:58Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 06:03:04.977165511 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:03:05.618869203 +0000 UTC" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62826" method=GET protocol=tls url="/1.0/operations/b1eb02a4-42b4-4e2e-a4cc-36a18981fc53?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62829" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:59Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 06:03:04.977165511 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:03:05.618869203 +0000 UTC" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62830" method=GET protocol=tls url="/1.0/operations/353f78ef-0c19-45bd-a3f8-67a85692f9e7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 06:03:04.977165511 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:03:05.618869203 +0000 UTC" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Event listener server handler stopped" listener=47ae1f63-ee34-44d2-8064-ed1e83ab28b4 local="10.10.10.14:8443" remote="100.122.142.76:62824" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62831" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62832" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62833" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:03:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62834" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62835" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62836" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62837" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62838" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62839" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62840" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62841" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62842" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62843" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62844" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62845" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62846" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62847" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Event listener server handler started" id=dc4d0c7d-9f5b-4c79-a432-5cf02a62630b local="10.10.10.14:8443" remote="100.122.142.76:62847" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62848" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=406637c9-43db-44b3-bba4-6118b77abfec project=ac-ovn-spike +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=406637c9-43db-44b3-bba4-6118b77abfec project=ac-ovn-spike +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=406637c9-43db-44b3-bba4-6118b77abfec project=ac-ovn-spike +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62849" method=GET protocol=tls url="/1.0/operations/406637c9-43db-44b3-bba4-6118b77abfec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Event listener server handler stopped" listener=dc4d0c7d-9f5b-4c79-a432-5cf02a62630b local="10.10.10.14:8443" remote="100.122.142.76:62847" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62850" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:62851" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:04:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/probe.stderr.txt new file mode 100644 index 0000000..2041e75 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/probe.stderr.txt @@ -0,0 +1,8 @@ +probe: gateway ping one -> 10.10.40.1 failed +probe: gateway ping two -> 10.10.40.1 failed +probe: dns lookup example.com from one via 10.10.40.1 failed +probe: dns lookup example.com from two via 10.10.40.1 failed +probe: internet egress curl from one failed +probe: internet egress curl from two failed +probe: workstation curl of forward-url failed +probe: 7 datapath checks failed diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/keeper-3/probe.stdout.txt new file mode 100644 index 0000000..bc26962 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/probe.stdout.txt @@ -0,0 +1,107 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.096 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.106 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"9f0ee7ab-55de-448b-a76c-e79b17649762","volatile.eth0.host_name":"veth9470b3e9","volatile.eth0.hwaddr":"10:66:6a:17:26:43","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"87f23f8a-492f-4897-a8a2-f9ea297830ae","volatile.uuid.generation":"87f23f8a-492f-4897-a8a2-f9ea297830ae"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:03:04.028158519Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"9f0ee7ab-55de-448b-a76c-e79b17649762","volatile.eth0.host_name":"veth9470b3e9","volatile.eth0.hwaddr":"10:66:6a:17:26:43","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"87f23f8a-492f-4897-a8a2-f9ea297830ae","volatile.uuid.generation":"87f23f8a-492f-4897-a8a2-f9ea297830ae"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:03:04.70671227Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9957376,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe17:2643","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:17:26:43","host_name":"veth9470b3e9","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4073065,"processes":4,"cpu":{"usage":478372000,"allocated_time":24000000000},"started_at":"2026-09-12T06:03:03.730000019Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"b470f7df-29e6-4afa-a0c5-86617e09f7af","volatile.eth0.host_name":"vethc3c8caab","volatile.eth0.hwaddr":"10:66:6a:c0:e0:7c","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"c6c5b77e-49a5-40a5-9a20-669f7bea4d63","volatile.uuid.generation":"c6c5b77e-49a5-40a5-9a20-669f7bea4d63"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:03:04.977165511Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"b470f7df-29e6-4afa-a0c5-86617e09f7af","volatile.eth0.host_name":"vethc3c8caab","volatile.eth0.hwaddr":"10:66:6a:c0:e0:7c","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"c6c5b77e-49a5-40a5-9a20-669f7bea4d63","volatile.uuid.generation":"c6c5b77e-49a5-40a5-9a20-669f7bea4d63"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:03:05.618869203Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11526144,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fec0:e07c","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:c0:e0:7c","host_name":"vethc3c8caab","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":14492,"processes":4,"cpu":{"usage":490199000,"allocated_time":24000000000},"started_at":"2026-09-12T06:03:05.630000114Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.117 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.325 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.301 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.278 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.797 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.352 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.352/0.809/1.278 ms +elapsed_seconds=2.275 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=0.905 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.796 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.351 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.351/0.684/0.905 ms +elapsed_seconds=2.265 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.299 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.775 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.308 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.235 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5002 milliseconds +elapsed_seconds=5.254 exit=28 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5001 milliseconds +elapsed_seconds=5.289 exit=28 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +curl: (28) Failed to connect to 10.10.40.79 port 8080 after 5006 ms: Timeout was reached +elapsed_seconds=5.035 exit=28 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.116984 bytes_per_second=854817752 +elapsed_seconds=0.363 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.533 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.136481 bytes_per_second=732702720 +elapsed_seconds=0.909 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.537 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/keeper-3/tcpdump-arp.log new file mode 100644 index 0000000..4431c9a --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/tcpdump-arp.log @@ -0,0 +1,3 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/keeper-3/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/keeper-3/topology.jsonl new file mode 100644 index 0000000..a044db8 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/keeper-3/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.122, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.101, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/keeper\"\n\t]\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.098, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.134, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.256, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.109, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.123, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.286, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.491, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:03:03.94197694Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"b2aa45d8-4392-4cf3-b0af-38f1e33dd515\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:03:03.94197694Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.49, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.47, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:03:04.925516716Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"bd9c2bab-2699-4687-a4e8-3bf9942b654a\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:03:04.925516716Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.406, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.223, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 134257000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 6369280,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe17:2643\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth9470b3e9\",\n\t\t\t\"hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4073065,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:03:03.730000019Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.24, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 134359000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6451200,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fec0:e07c\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 860,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"vethc3c8caab\",\n\t\t\t\"hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 14492,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:03:05.630000114Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.112, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t},\n\t\"created_at\": \"2026-09-12T06:03:04.028158519Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:03:04.70671227Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.117, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t},\n\t\"created_at\": \"2026-09-12T06:03:04.977165511Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:03:05.618869203Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.545, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.249 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.249/1.249/1.249 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.365, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.204, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.344, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.38, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-yg25a42q/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.757, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.347, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.594, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.061275 seconds, 1.5GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.621, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.027614 seconds, 3.4GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.181, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:03:04.028158519Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f0ee7ab-55de-448b-a76c-e79b17649762\",\n\t\t\t\"volatile.eth0.host_name\": \"veth9470b3e9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:17:26:43\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\",\n\t\t\t\"volatile.uuid.generation\": \"87f23f8a-492f-4897-a8a2-f9ea297830ae\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:03:04.70671227Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:03:04.977165511Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"b470f7df-29e6-4afa-a0c5-86617e09f7af\",\n\t\t\t\"volatile.eth0.host_name\": \"vethc3c8caab\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:c0:e0:7c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\",\n\t\t\t\"volatile.uuid.generation\": \"c6c5b77e-49a5-40a5-9a20-669f7bea4d63\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:03:05.618869203Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.97, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.08, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.1, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.146, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.181, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.103, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T06:03:05.021377265Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T06:03:03.814276703Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.144, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.185, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/lab01-first-ovs-conflict.json b/spikes/ovn/diagnosis-2026-09-12/lab01-first-ovs-conflict.json new file mode 100644 index 0000000..b46980d --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/lab01-first-ovs-conflict.json @@ -0,0 +1,82 @@ +[ + { + "at": "1789192054044824", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044833", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044844", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054139872", + "member": "lab01.glab.lol", + "message": "ovs|01274|dpif|WARN|Dropped 873 log messages in last 10015 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192054139987", + "member": "lab01.glab.lol", + "message": "ovs|01275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054140034", + "member": "lab01.glab.lol", + "message": "ovs|01276|bridge|WARN|Dropped 11077 log messages in last 10020 seconds (most recently, 10014 seconds ago) due to excessive rate" + }, + { + "at": "1789192054140071", + "member": "lab01.glab.lol", + "message": "ovs|01277|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054140111", + "member": "lab01.glab.lol", + "message": "ovs|01278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789192054140137", + "member": "lab01.glab.lol", + "message": "ovs|01279|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789192054140429", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler101)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789192054140562", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler101)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789192054140601", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789192054140639", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789192054140672", + "member": "lab01.glab.lol", + "message": " my_disc:0x59c6c3e your_disc:0x0" + }, + { + "at": "1789192054140716", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789192054140744", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/lab01-original-ovs-journal.json b/spikes/ovn/diagnosis-2026-09-12/lab01-original-ovs-journal.json new file mode 100644 index 0000000..a31504c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/lab01-original-ovs-journal.json @@ -0,0 +1,5487 @@ +[ + { + "at": "1789181554581259", + "member": "lab01.glab.lol", + "message": "ovs|00047|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789181554581363", + "member": "lab01.glab.lol", + "message": "ovs|00049|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789181554678404", + "member": "lab01.glab.lol", + "message": "ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554678541", + "member": "lab01.glab.lol", + "message": "ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181554680378", + "member": "lab01.glab.lol", + "message": "ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554680420", + "member": "lab01.glab.lol", + "message": "ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181554680462", + "member": "lab01.glab.lol", + "message": "ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554680504", + "member": "lab01.glab.lol", + "message": "ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181554681215", + "member": "lab01.glab.lol", + "message": "ovs|00059|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554681324", + "member": "lab01.glab.lol", + "message": "ovs|00060|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181554683954", + "member": "lab01.glab.lol", + "message": "ovs|00061|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554683985", + "member": "lab01.glab.lol", + "message": "ovs|00062|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181554685521", + "member": "lab01.glab.lol", + "message": "ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554685553", + "member": "lab01.glab.lol", + "message": "ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554685782", + "member": "lab01.glab.lol", + "message": "ovs|00065|bridge|INFO|bridge incusovn16: added interface patch-incus-net17-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789181554685861", + "member": "lab01.glab.lol", + "message": "ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181554687558", + "member": "lab01.glab.lol", + "message": "ovs|00068|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181555681570", + "member": "lab01.glab.lol", + "message": "ovs|00069|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181555681641", + "member": "lab01.glab.lol", + "message": "ovs|00070|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181556681879", + "member": "lab01.glab.lol", + "message": "ovs|00072|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181556682080", + "member": "lab01.glab.lol", + "message": "ovs|00073|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181557681875", + "member": "lab01.glab.lol", + "message": "ovs|00084|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181557682016", + "member": "lab01.glab.lol", + "message": "ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181558681878", + "member": "lab01.glab.lol", + "message": "ovs|00086|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181558681980", + "member": "lab01.glab.lol", + "message": "ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181559681852", + "member": "lab01.glab.lol", + "message": "ovs|00088|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181559682115", + "member": "lab01.glab.lol", + "message": "ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181560681861", + "member": "lab01.glab.lol", + "message": "ovs|00090|dpif|WARN|Dropped 2087 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181560682083", + "member": "lab01.glab.lol", + "message": "ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181561682024", + "member": "lab01.glab.lol", + "message": "ovs|00092|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181561682262", + "member": "lab01.glab.lol", + "message": "ovs|00093|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181562681821", + "member": "lab01.glab.lol", + "message": "ovs|00094|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181562681948", + "member": "lab01.glab.lol", + "message": "ovs|00095|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181563006206", + "member": "lab01.glab.lol", + "message": "ovs|00096|poll_loop|INFO|Dropped 12233 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181563681820", + "member": "lab01.glab.lol", + "message": "ovs|00098|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181563681944", + "member": "lab01.glab.lol", + "message": "ovs|00099|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181564681919", + "member": "lab01.glab.lol", + "message": "ovs|00101|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181564682021", + "member": "lab01.glab.lol", + "message": "ovs|00102|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181565681999", + "member": "lab01.glab.lol", + "message": "ovs|00103|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181565682210", + "member": "lab01.glab.lol", + "message": "ovs|00104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181566682010", + "member": "lab01.glab.lol", + "message": "ovs|00105|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181566682252", + "member": "lab01.glab.lol", + "message": "ovs|00106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181567681851", + "member": "lab01.glab.lol", + "message": "ovs|00107|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181567681964", + "member": "lab01.glab.lol", + "message": "ovs|00108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181568681671", + "member": "lab01.glab.lol", + "message": "ovs|00109|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181568681900", + "member": "lab01.glab.lol", + "message": "ovs|00110|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181569006059", + "member": "lab01.glab.lol", + "message": "ovs|00111|poll_loop|INFO|Dropped 12283 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181569681826", + "member": "lab01.glab.lol", + "message": "ovs|00113|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181569682085", + "member": "lab01.glab.lol", + "message": "ovs|00114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181570681902", + "member": "lab01.glab.lol", + "message": "ovs|00115|dpif|WARN|Dropped 2097 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181570682167", + "member": "lab01.glab.lol", + "message": "ovs|00116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181571682029", + "member": "lab01.glab.lol", + "message": "ovs|00117|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181571682254", + "member": "lab01.glab.lol", + "message": "ovs|00118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181572681636", + "member": "lab01.glab.lol", + "message": "ovs|00119|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181572681763", + "member": "lab01.glab.lol", + "message": "ovs|00120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181573681975", + "member": "lab01.glab.lol", + "message": "ovs|00121|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181573682212", + "member": "lab01.glab.lol", + "message": "ovs|00122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181574681753", + "member": "lab01.glab.lol", + "message": "ovs|00123|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181574681894", + "member": "lab01.glab.lol", + "message": "ovs|00124|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181575005951", + "member": "lab01.glab.lol", + "message": "ovs|00125|poll_loop|INFO|Dropped 12340 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181575681837", + "member": "lab01.glab.lol", + "message": "ovs|00127|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181575681961", + "member": "lab01.glab.lol", + "message": "ovs|00128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181576681795", + "member": "lab01.glab.lol", + "message": "ovs|00129|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181576682103", + "member": "lab01.glab.lol", + "message": "ovs|00130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181577681908", + "member": "lab01.glab.lol", + "message": "ovs|00131|dpif|WARN|Dropped 2113 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181577682176", + "member": "lab01.glab.lol", + "message": "ovs|00132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181578682082", + "member": "lab01.glab.lol", + "message": "ovs|00133|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181578682316", + "member": "lab01.glab.lol", + "message": "ovs|00134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181579681649", + "member": "lab01.glab.lol", + "message": "ovs|00135|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181579681790", + "member": "lab01.glab.lol", + "message": "ovs|00136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181580682050", + "member": "lab01.glab.lol", + "message": "ovs|00137|dpif|WARN|Dropped 2101 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181580682283", + "member": "lab01.glab.lol", + "message": "ovs|00138|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181581005684", + "member": "lab01.glab.lol", + "message": "ovs|00139|poll_loop|INFO|Dropped 12479 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181581681985", + "member": "lab01.glab.lol", + "message": "ovs|00141|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181581682128", + "member": "lab01.glab.lol", + "message": "ovs|00142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181582681698", + "member": "lab01.glab.lol", + "message": "ovs|00143|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181582681804", + "member": "lab01.glab.lol", + "message": "ovs|00144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181583682018", + "member": "lab01.glab.lol", + "message": "ovs|00145|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181583682231", + "member": "lab01.glab.lol", + "message": "ovs|00146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181584681632", + "member": "lab01.glab.lol", + "message": "ovs|00147|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181584681794", + "member": "lab01.glab.lol", + "message": "ovs|00148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181585681932", + "member": "lab01.glab.lol", + "message": "ovs|00149|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181585682234", + "member": "lab01.glab.lol", + "message": "ovs|00150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181586681641", + "member": "lab01.glab.lol", + "message": "ovs|00151|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181586681793", + "member": "lab01.glab.lol", + "message": "ovs|00152|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181587005828", + "member": "lab01.glab.lol", + "message": "ovs|00153|poll_loop|INFO|Dropped 12318 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181587681860", + "member": "lab01.glab.lol", + "message": "ovs|00155|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181587681965", + "member": "lab01.glab.lol", + "message": "ovs|00156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181588681858", + "member": "lab01.glab.lol", + "message": "ovs|00157|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181588682114", + "member": "lab01.glab.lol", + "message": "ovs|00158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181589682126", + "member": "lab01.glab.lol", + "message": "ovs|00159|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181589682464", + "member": "lab01.glab.lol", + "message": "ovs|00160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181590681866", + "member": "lab01.glab.lol", + "message": "ovs|00161|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181590682005", + "member": "lab01.glab.lol", + "message": "ovs|00162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181591681803", + "member": "lab01.glab.lol", + "message": "ovs|00163|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181591682059", + "member": "lab01.glab.lol", + "message": "ovs|00164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181592682125", + "member": "lab01.glab.lol", + "message": "ovs|00165|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181592682380", + "member": "lab01.glab.lol", + "message": "ovs|00166|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181593005551", + "member": "lab01.glab.lol", + "message": "ovs|00167|poll_loop|INFO|Dropped 12434 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181593682196", + "member": "lab01.glab.lol", + "message": "ovs|00169|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181593682417", + "member": "lab01.glab.lol", + "message": "ovs|00170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181594682057", + "member": "lab01.glab.lol", + "message": "ovs|00171|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181594682196", + "member": "lab01.glab.lol", + "message": "ovs|00172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181595681954", + "member": "lab01.glab.lol", + "message": "ovs|00173|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181595682206", + "member": "lab01.glab.lol", + "message": "ovs|00174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181596681833", + "member": "lab01.glab.lol", + "message": "ovs|00175|dpif|WARN|Dropped 2120 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181596681944", + "member": "lab01.glab.lol", + "message": "ovs|00176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181597681727", + "member": "lab01.glab.lol", + "message": "ovs|00177|dpif|WARN|Dropped 2099 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181597681927", + "member": "lab01.glab.lol", + "message": "ovs|00178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181598681600", + "member": "lab01.glab.lol", + "message": "ovs|00179|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181598681733", + "member": "lab01.glab.lol", + "message": "ovs|00180|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181599005976", + "member": "lab01.glab.lol", + "message": "ovs|00181|poll_loop|INFO|Dropped 12582 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181599681825", + "member": "lab01.glab.lol", + "message": "ovs|00183|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181599681930", + "member": "lab01.glab.lol", + "message": "ovs|00184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181600681855", + "member": "lab01.glab.lol", + "message": "ovs|00186|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181600681975", + "member": "lab01.glab.lol", + "message": "ovs|00187|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181601681784", + "member": "lab01.glab.lol", + "message": "ovs|00188|dpif|WARN|Dropped 2102 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181601682030", + "member": "lab01.glab.lol", + "message": "ovs|00189|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181602304267", + "member": "lab01.glab.lol", + "message": "ovs|00190|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789181602304331", + "member": "lab01.glab.lol", + "message": "ovs|00191|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net17-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789181604277082", + "member": "lab01.glab.lol", + "message": "ovs|00193|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789181604277377", + "member": "lab01.glab.lol", + "message": "ovs|00195|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789181604374510", + "member": "lab01.glab.lol", + "message": "ovs|00199|dpif|WARN|Dropped 1343 log messages in last 3 seconds (most recently, 2 seconds ago) due to excessive rate" + }, + { + "at": "1789181604374629", + "member": "lab01.glab.lol", + "message": "ovs|00200|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181604376968", + "member": "lab01.glab.lol", + "message": "ovs|00201|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181604385301", + "member": "lab01.glab.lol", + "message": "ovs|00202|bridge|INFO|bridge incusovn16: added interface patch-incus-net18-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789181604681614", + "member": "lab01.glab.lol", + "message": "ovs|00204|dpif|WARN|Dropped 558 log messages in last 0 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181604681685", + "member": "lab01.glab.lol", + "message": "ovs|00205|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181605681654", + "member": "lab01.glab.lol", + "message": "ovs|00206|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181605681869", + "member": "lab01.glab.lol", + "message": "ovs|00207|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181606681838", + "member": "lab01.glab.lol", + "message": "ovs|00209|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181606682028", + "member": "lab01.glab.lol", + "message": "ovs|00210|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181607681704", + "member": "lab01.glab.lol", + "message": "ovs|00211|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181607681855", + "member": "lab01.glab.lol", + "message": "ovs|00212|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181608005800", + "member": "lab01.glab.lol", + "message": "ovs|00213|poll_loop|INFO|Dropped 8216 log messages in last 9 seconds (most recently, 3 seconds ago) due to excessive rate" + }, + { + "at": "1789181608681943", + "member": "lab01.glab.lol", + "message": "ovs|00215|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181608682150", + "member": "lab01.glab.lol", + "message": "ovs|00216|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181609681841", + "member": "lab01.glab.lol", + "message": "ovs|00217|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181609681949", + "member": "lab01.glab.lol", + "message": "ovs|00218|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181610681625", + "member": "lab01.glab.lol", + "message": "ovs|00219|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181610681850", + "member": "lab01.glab.lol", + "message": "ovs|00220|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181611005540", + "member": "lab01.glab.lol", + "message": "ovs|00221|poll_loop|INFO|Dropped 6143 log messages in last 3 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181611681873", + "member": "lab01.glab.lol", + "message": "ovs|00223|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181611682059", + "member": "lab01.glab.lol", + "message": "ovs|00224|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181612681582", + "member": "lab01.glab.lol", + "message": "ovs|00225|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181612681709", + "member": "lab01.glab.lol", + "message": "ovs|00226|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181613681879", + "member": "lab01.glab.lol", + "message": "ovs|00227|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181613682096", + "member": "lab01.glab.lol", + "message": "ovs|00228|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181614677561", + "member": "lab01.glab.lol", + "message": "ovs|00229|bridge|WARN|Dropped 119327 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181614677661", + "member": "lab01.glab.lol", + "message": "ovs|00230|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181614681838", + "member": "lab01.glab.lol", + "message": "ovs|00231|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181614681897", + "member": "lab01.glab.lol", + "message": "ovs|00232|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181615681597", + "member": "lab01.glab.lol", + "message": "ovs|00233|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181615681703", + "member": "lab01.glab.lol", + "message": "ovs|00234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181616682006", + "member": "lab01.glab.lol", + "message": "ovs|00235|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181616682192", + "member": "lab01.glab.lol", + "message": "ovs|00236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181617005964", + "member": "lab01.glab.lol", + "message": "ovs|00237|poll_loop|INFO|Dropped 12341 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181617681835", + "member": "lab01.glab.lol", + "message": "ovs|00239|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181617681947", + "member": "lab01.glab.lol", + "message": "ovs|00240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181618681794", + "member": "lab01.glab.lol", + "message": "ovs|00241|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181618681997", + "member": "lab01.glab.lol", + "message": "ovs|00242|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181619681895", + "member": "lab01.glab.lol", + "message": "ovs|00243|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181619682116", + "member": "lab01.glab.lol", + "message": "ovs|00244|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181620681787", + "member": "lab01.glab.lol", + "message": "ovs|00245|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181620681939", + "member": "lab01.glab.lol", + "message": "ovs|00246|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181621681688", + "member": "lab01.glab.lol", + "message": "ovs|00247|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181621681787", + "member": "lab01.glab.lol", + "message": "ovs|00248|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181622681857", + "member": "lab01.glab.lol", + "message": "ovs|00249|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181622682074", + "member": "lab01.glab.lol", + "message": "ovs|00250|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181623005794", + "member": "lab01.glab.lol", + "message": "ovs|00251|poll_loop|INFO|Dropped 12216 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181623681621", + "member": "lab01.glab.lol", + "message": "ovs|00253|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181623681733", + "member": "lab01.glab.lol", + "message": "ovs|00254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181624681734", + "member": "lab01.glab.lol", + "message": "ovs|00256|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181624681810", + "member": "lab01.glab.lol", + "message": "ovs|00257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181625681511", + "member": "lab01.glab.lol", + "message": "ovs|00258|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181625681726", + "member": "lab01.glab.lol", + "message": "ovs|00259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181626681510", + "member": "lab01.glab.lol", + "message": "ovs|00260|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181626681742", + "member": "lab01.glab.lol", + "message": "ovs|00261|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181627681837", + "member": "lab01.glab.lol", + "message": "ovs|00262|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181627682067", + "member": "lab01.glab.lol", + "message": "ovs|00263|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181628682003", + "member": "lab01.glab.lol", + "message": "ovs|00264|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181628682196", + "member": "lab01.glab.lol", + "message": "ovs|00265|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181629005715", + "member": "lab01.glab.lol", + "message": "ovs|00266|poll_loop|INFO|Dropped 12294 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181629681839", + "member": "lab01.glab.lol", + "message": "ovs|00268|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181629681954", + "member": "lab01.glab.lol", + "message": "ovs|00269|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181630681868", + "member": "lab01.glab.lol", + "message": "ovs|00270|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181630682112", + "member": "lab01.glab.lol", + "message": "ovs|00271|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181631681858", + "member": "lab01.glab.lol", + "message": "ovs|00272|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181631681997", + "member": "lab01.glab.lol", + "message": "ovs|00273|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181632681888", + "member": "lab01.glab.lol", + "message": "ovs|00274|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181632682033", + "member": "lab01.glab.lol", + "message": "ovs|00275|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181633681796", + "member": "lab01.glab.lol", + "message": "ovs|00276|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181633681919", + "member": "lab01.glab.lol", + "message": "ovs|00277|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181634681626", + "member": "lab01.glab.lol", + "message": "ovs|00278|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181634681861", + "member": "lab01.glab.lol", + "message": "ovs|00279|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181635005603", + "member": "lab01.glab.lol", + "message": "ovs|00280|poll_loop|INFO|Dropped 12226 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181635681911", + "member": "lab01.glab.lol", + "message": "ovs|00282|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181635682129", + "member": "lab01.glab.lol", + "message": "ovs|00283|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181636681910", + "member": "lab01.glab.lol", + "message": "ovs|00284|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181636682014", + "member": "lab01.glab.lol", + "message": "ovs|00285|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181637681854", + "member": "lab01.glab.lol", + "message": "ovs|00286|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181637682007", + "member": "lab01.glab.lol", + "message": "ovs|00287|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181638681843", + "member": "lab01.glab.lol", + "message": "ovs|00288|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181638682057", + "member": "lab01.glab.lol", + "message": "ovs|00289|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181639682062", + "member": "lab01.glab.lol", + "message": "ovs|00290|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181639682300", + "member": "lab01.glab.lol", + "message": "ovs|00291|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181640681660", + "member": "lab01.glab.lol", + "message": "ovs|00292|dpif|WARN|Dropped 2088 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181640681774", + "member": "lab01.glab.lol", + "message": "ovs|00293|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181641005823", + "member": "lab01.glab.lol", + "message": "ovs|00294|poll_loop|INFO|Dropped 12313 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181641681909", + "member": "lab01.glab.lol", + "message": "ovs|00296|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181641682000", + "member": "lab01.glab.lol", + "message": "ovs|00297|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181642681788", + "member": "lab01.glab.lol", + "message": "ovs|00298|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181642717693", + "member": "lab01.glab.lol", + "message": "ovs|00299|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181643681893", + "member": "lab01.glab.lol", + "message": "ovs|00300|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181643682118", + "member": "lab01.glab.lol", + "message": "ovs|00301|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181644681701", + "member": "lab01.glab.lol", + "message": "ovs|00302|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181644681850", + "member": "lab01.glab.lol", + "message": "ovs|00303|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181645681567", + "member": "lab01.glab.lol", + "message": "ovs|00304|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181645681778", + "member": "lab01.glab.lol", + "message": "ovs|00305|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181646681823", + "member": "lab01.glab.lol", + "message": "ovs|00306|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181646682039", + "member": "lab01.glab.lol", + "message": "ovs|00307|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181647005700", + "member": "lab01.glab.lol", + "message": "ovs|00308|poll_loop|INFO|Dropped 12266 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181647681621", + "member": "lab01.glab.lol", + "message": "ovs|00310|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181647681737", + "member": "lab01.glab.lol", + "message": "ovs|00311|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181648681732", + "member": "lab01.glab.lol", + "message": "ovs|00312|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181648682060", + "member": "lab01.glab.lol", + "message": "ovs|00313|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181649681694", + "member": "lab01.glab.lol", + "message": "ovs|00314|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181649681794", + "member": "lab01.glab.lol", + "message": "ovs|00315|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181650681671", + "member": "lab01.glab.lol", + "message": "ovs|00316|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181650681780", + "member": "lab01.glab.lol", + "message": "ovs|00317|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181651681889", + "member": "lab01.glab.lol", + "message": "ovs|00318|dpif|WARN|Dropped 2053 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181651682130", + "member": "lab01.glab.lol", + "message": "ovs|00319|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181652681947", + "member": "lab01.glab.lol", + "message": "ovs|00320|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181652682231", + "member": "lab01.glab.lol", + "message": "ovs|00321|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181653005914", + "member": "lab01.glab.lol", + "message": "ovs|00322|poll_loop|INFO|Dropped 12309 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181653681946", + "member": "lab01.glab.lol", + "message": "ovs|00324|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181653682256", + "member": "lab01.glab.lol", + "message": "ovs|00325|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181654681677", + "member": "lab01.glab.lol", + "message": "ovs|00326|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181654681806", + "member": "lab01.glab.lol", + "message": "ovs|00327|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181655681533", + "member": "lab01.glab.lol", + "message": "ovs|00328|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181655681775", + "member": "lab01.glab.lol", + "message": "ovs|00329|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181656681544", + "member": "lab01.glab.lol", + "message": "ovs|00330|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181656681754", + "member": "lab01.glab.lol", + "message": "ovs|00331|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181657682013", + "member": "lab01.glab.lol", + "message": "ovs|00332|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181657716354", + "member": "lab01.glab.lol", + "message": "ovs|00333|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181658681630", + "member": "lab01.glab.lol", + "message": "ovs|00334|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181658681758", + "member": "lab01.glab.lol", + "message": "ovs|00335|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181659005552", + "member": "lab01.glab.lol", + "message": "ovs|00336|poll_loop|INFO|Dropped 12262 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181659681849", + "member": "lab01.glab.lol", + "message": "ovs|00338|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181659681978", + "member": "lab01.glab.lol", + "message": "ovs|00339|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181660682148", + "member": "lab01.glab.lol", + "message": "ovs|00340|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181660682405", + "member": "lab01.glab.lol", + "message": "ovs|00341|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181661681841", + "member": "lab01.glab.lol", + "message": "ovs|00342|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181661681985", + "member": "lab01.glab.lol", + "message": "ovs|00343|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181662681858", + "member": "lab01.glab.lol", + "message": "ovs|00344|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181662682111", + "member": "lab01.glab.lol", + "message": "ovs|00345|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181663681964", + "member": "lab01.glab.lol", + "message": "ovs|00346|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181663682225", + "member": "lab01.glab.lol", + "message": "ovs|00347|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181664681783", + "member": "lab01.glab.lol", + "message": "ovs|00348|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181664681924", + "member": "lab01.glab.lol", + "message": "ovs|00349|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181665005744", + "member": "lab01.glab.lol", + "message": "ovs|00350|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181665681789", + "member": "lab01.glab.lol", + "message": "ovs|00352|dpif|WARN|Dropped 2105 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181665681937", + "member": "lab01.glab.lol", + "message": "ovs|00353|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181666681963", + "member": "lab01.glab.lol", + "message": "ovs|00354|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181666682240", + "member": "lab01.glab.lol", + "message": "ovs|00355|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181667682081", + "member": "lab01.glab.lol", + "message": "ovs|00356|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181667682359", + "member": "lab01.glab.lol", + "message": "ovs|00357|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181668682103", + "member": "lab01.glab.lol", + "message": "ovs|00358|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181668682359", + "member": "lab01.glab.lol", + "message": "ovs|00359|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181669681544", + "member": "lab01.glab.lol", + "message": "ovs|00360|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181669681668", + "member": "lab01.glab.lol", + "message": "ovs|00361|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181670681707", + "member": "lab01.glab.lol", + "message": "ovs|00362|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181670681988", + "member": "lab01.glab.lol", + "message": "ovs|00363|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181671005761", + "member": "lab01.glab.lol", + "message": "ovs|00364|poll_loop|INFO|Dropped 12244 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181671681732", + "member": "lab01.glab.lol", + "message": "ovs|00366|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181671681852", + "member": "lab01.glab.lol", + "message": "ovs|00367|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181672681869", + "member": "lab01.glab.lol", + "message": "ovs|00368|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181672682101", + "member": "lab01.glab.lol", + "message": "ovs|00369|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181673681782", + "member": "lab01.glab.lol", + "message": "ovs|00370|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181673681892", + "member": "lab01.glab.lol", + "message": "ovs|00371|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181674677949", + "member": "lab01.glab.lol", + "message": "ovs|00372|bridge|WARN|Dropped 122637 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181674678064", + "member": "lab01.glab.lol", + "message": "ovs|00373|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181674681587", + "member": "lab01.glab.lol", + "message": "ovs|00374|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181674681669", + "member": "lab01.glab.lol", + "message": "ovs|00375|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181675681648", + "member": "lab01.glab.lol", + "message": "ovs|00376|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181675681960", + "member": "lab01.glab.lol", + "message": "ovs|00377|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181676681864", + "member": "lab01.glab.lol", + "message": "ovs|00378|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181676682115", + "member": "lab01.glab.lol", + "message": "ovs|00379|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181677006102", + "member": "lab01.glab.lol", + "message": "ovs|00380|poll_loop|INFO|Dropped 12186 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181677681914", + "member": "lab01.glab.lol", + "message": "ovs|00382|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181677682136", + "member": "lab01.glab.lol", + "message": "ovs|00383|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181678681896", + "member": "lab01.glab.lol", + "message": "ovs|00384|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181678682012", + "member": "lab01.glab.lol", + "message": "ovs|00385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181679681837", + "member": "lab01.glab.lol", + "message": "ovs|00386|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181679682073", + "member": "lab01.glab.lol", + "message": "ovs|00387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181680681925", + "member": "lab01.glab.lol", + "message": "ovs|00388|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181680682084", + "member": "lab01.glab.lol", + "message": "ovs|00389|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181681681670", + "member": "lab01.glab.lol", + "message": "ovs|00390|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181681681795", + "member": "lab01.glab.lol", + "message": "ovs|00391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181682681994", + "member": "lab01.glab.lol", + "message": "ovs|00392|dpif|WARN|Dropped 2053 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181682682217", + "member": "lab01.glab.lol", + "message": "ovs|00393|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181683005986", + "member": "lab01.glab.lol", + "message": "ovs|00394|poll_loop|INFO|Dropped 12201 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181683681836", + "member": "lab01.glab.lol", + "message": "ovs|00396|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181683681948", + "member": "lab01.glab.lol", + "message": "ovs|00397|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181684681867", + "member": "lab01.glab.lol", + "message": "ovs|00399|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181684681952", + "member": "lab01.glab.lol", + "message": "ovs|00400|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181685681896", + "member": "lab01.glab.lol", + "message": "ovs|00401|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181685682132", + "member": "lab01.glab.lol", + "message": "ovs|00402|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181686681513", + "member": "lab01.glab.lol", + "message": "ovs|00403|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181686681650", + "member": "lab01.glab.lol", + "message": "ovs|00404|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181687681953", + "member": "lab01.glab.lol", + "message": "ovs|00405|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181687682193", + "member": "lab01.glab.lol", + "message": "ovs|00406|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181688681558", + "member": "lab01.glab.lol", + "message": "ovs|00407|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181688681703", + "member": "lab01.glab.lol", + "message": "ovs|00408|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181689005874", + "member": "lab01.glab.lol", + "message": "ovs|00409|poll_loop|INFO|Dropped 12242 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181689681658", + "member": "lab01.glab.lol", + "message": "ovs|00411|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181689681827", + "member": "lab01.glab.lol", + "message": "ovs|00412|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181690681789", + "member": "lab01.glab.lol", + "message": "ovs|00413|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181690682028", + "member": "lab01.glab.lol", + "message": "ovs|00414|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181691681908", + "member": "lab01.glab.lol", + "message": "ovs|00415|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181691682176", + "member": "lab01.glab.lol", + "message": "ovs|00416|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181692681534", + "member": "lab01.glab.lol", + "message": "ovs|00417|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181692681671", + "member": "lab01.glab.lol", + "message": "ovs|00418|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181693681864", + "member": "lab01.glab.lol", + "message": "ovs|00419|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181693682137", + "member": "lab01.glab.lol", + "message": "ovs|00420|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181694681672", + "member": "lab01.glab.lol", + "message": "ovs|00421|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181694681798", + "member": "lab01.glab.lol", + "message": "ovs|00422|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181695005981", + "member": "lab01.glab.lol", + "message": "ovs|00423|poll_loop|INFO|Dropped 12184 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181695682225", + "member": "lab01.glab.lol", + "message": "ovs|00425|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181695682352", + "member": "lab01.glab.lol", + "message": "ovs|00426|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181696681983", + "member": "lab01.glab.lol", + "message": "ovs|00427|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181696682233", + "member": "lab01.glab.lol", + "message": "ovs|00428|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181697681810", + "member": "lab01.glab.lol", + "message": "ovs|00429|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181697681953", + "member": "lab01.glab.lol", + "message": "ovs|00430|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181698681701", + "member": "lab01.glab.lol", + "message": "ovs|00431|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181698681926", + "member": "lab01.glab.lol", + "message": "ovs|00432|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181699682034", + "member": "lab01.glab.lol", + "message": "ovs|00433|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181699682316", + "member": "lab01.glab.lol", + "message": "ovs|00434|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181700681989", + "member": "lab01.glab.lol", + "message": "ovs|00435|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181700682100", + "member": "lab01.glab.lol", + "message": "ovs|00436|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181701006112", + "member": "lab01.glab.lol", + "message": "ovs|00437|poll_loop|INFO|Dropped 12136 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181701681611", + "member": "lab01.glab.lol", + "message": "ovs|00439|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181701681729", + "member": "lab01.glab.lol", + "message": "ovs|00440|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181702681869", + "member": "lab01.glab.lol", + "message": "ovs|00441|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181702682114", + "member": "lab01.glab.lol", + "message": "ovs|00442|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181703681515", + "member": "lab01.glab.lol", + "message": "ovs|00443|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181703681633", + "member": "lab01.glab.lol", + "message": "ovs|00444|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181704681679", + "member": "lab01.glab.lol", + "message": "ovs|00445|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181704681948", + "member": "lab01.glab.lol", + "message": "ovs|00446|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181705681891", + "member": "lab01.glab.lol", + "message": "ovs|00447|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181705682189", + "member": "lab01.glab.lol", + "message": "ovs|00448|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181706681565", + "member": "lab01.glab.lol", + "message": "ovs|00449|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181706681733", + "member": "lab01.glab.lol", + "message": "ovs|00450|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181707005677", + "member": "lab01.glab.lol", + "message": "ovs|00451|poll_loop|INFO|Dropped 12166 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181707681756", + "member": "lab01.glab.lol", + "message": "ovs|00453|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181707681885", + "member": "lab01.glab.lol", + "message": "ovs|00454|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181708681862", + "member": "lab01.glab.lol", + "message": "ovs|00455|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181708682136", + "member": "lab01.glab.lol", + "message": "ovs|00456|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181709681723", + "member": "lab01.glab.lol", + "message": "ovs|00457|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181709681861", + "member": "lab01.glab.lol", + "message": "ovs|00458|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181710682066", + "member": "lab01.glab.lol", + "message": "ovs|00459|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181710682552", + "member": "lab01.glab.lol", + "message": "ovs|00460|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181711681700", + "member": "lab01.glab.lol", + "message": "ovs|00461|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181711681823", + "member": "lab01.glab.lol", + "message": "ovs|00462|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181712681737", + "member": "lab01.glab.lol", + "message": "ovs|00463|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181712681976", + "member": "lab01.glab.lol", + "message": "ovs|00464|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181713005689", + "member": "lab01.glab.lol", + "message": "ovs|00465|poll_loop|INFO|Dropped 12186 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181713681661", + "member": "lab01.glab.lol", + "message": "ovs|00467|dpif|WARN|Dropped 2072 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181713681787", + "member": "lab01.glab.lol", + "message": "ovs|00468|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181714681879", + "member": "lab01.glab.lol", + "message": "ovs|00469|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181714682145", + "member": "lab01.glab.lol", + "message": "ovs|00470|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181715681616", + "member": "lab01.glab.lol", + "message": "ovs|00471|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181715681769", + "member": "lab01.glab.lol", + "message": "ovs|00472|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181716681568", + "member": "lab01.glab.lol", + "message": "ovs|00473|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181716681809", + "member": "lab01.glab.lol", + "message": "ovs|00474|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181717681964", + "member": "lab01.glab.lol", + "message": "ovs|00475|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181717682224", + "member": "lab01.glab.lol", + "message": "ovs|00476|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181718681560", + "member": "lab01.glab.lol", + "message": "ovs|00477|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181718681688", + "member": "lab01.glab.lol", + "message": "ovs|00478|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181719006200", + "member": "lab01.glab.lol", + "message": "ovs|00479|poll_loop|INFO|Dropped 12214 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181719681924", + "member": "lab01.glab.lol", + "message": "ovs|00481|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181719682038", + "member": "lab01.glab.lol", + "message": "ovs|00482|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181720681947", + "member": "lab01.glab.lol", + "message": "ovs|00483|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181720682200", + "member": "lab01.glab.lol", + "message": "ovs|00484|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181721681893", + "member": "lab01.glab.lol", + "message": "ovs|00485|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181721682052", + "member": "lab01.glab.lol", + "message": "ovs|00486|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181722681593", + "member": "lab01.glab.lol", + "message": "ovs|00487|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181722681698", + "member": "lab01.glab.lol", + "message": "ovs|00488|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181723681621", + "member": "lab01.glab.lol", + "message": "ovs|00489|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181723681864", + "member": "lab01.glab.lol", + "message": "ovs|00490|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181724681928", + "member": "lab01.glab.lol", + "message": "ovs|00491|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181724682163", + "member": "lab01.glab.lol", + "message": "ovs|00492|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181725005911", + "member": "lab01.glab.lol", + "message": "ovs|00493|poll_loop|INFO|Dropped 12147 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181725681783", + "member": "lab01.glab.lol", + "message": "ovs|00495|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181725681882", + "member": "lab01.glab.lol", + "message": "ovs|00496|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181726681648", + "member": "lab01.glab.lol", + "message": "ovs|00497|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181726681892", + "member": "lab01.glab.lol", + "message": "ovs|00498|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181727681895", + "member": "lab01.glab.lol", + "message": "ovs|00499|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181727682150", + "member": "lab01.glab.lol", + "message": "ovs|00500|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181728681933", + "member": "lab01.glab.lol", + "message": "ovs|00501|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181728682189", + "member": "lab01.glab.lol", + "message": "ovs|00502|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181729681638", + "member": "lab01.glab.lol", + "message": "ovs|00503|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181729681783", + "member": "lab01.glab.lol", + "message": "ovs|00504|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181730681751", + "member": "lab01.glab.lol", + "message": "ovs|00505|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181730681992", + "member": "lab01.glab.lol", + "message": "ovs|00506|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181731005690", + "member": "lab01.glab.lol", + "message": "ovs|00507|poll_loop|INFO|Dropped 12192 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181731681928", + "member": "lab01.glab.lol", + "message": "ovs|00509|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181731682182", + "member": "lab01.glab.lol", + "message": "ovs|00510|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181732681620", + "member": "lab01.glab.lol", + "message": "ovs|00511|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181732681732", + "member": "lab01.glab.lol", + "message": "ovs|00512|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181733681802", + "member": "lab01.glab.lol", + "message": "ovs|00513|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181733682066", + "member": "lab01.glab.lol", + "message": "ovs|00514|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181734677854", + "member": "lab01.glab.lol", + "message": "ovs|00515|bridge|WARN|Dropped 121835 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181734677970", + "member": "lab01.glab.lol", + "message": "ovs|00516|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181734681875", + "member": "lab01.glab.lol", + "message": "ovs|00517|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181734682019", + "member": "lab01.glab.lol", + "message": "ovs|00518|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181735681556", + "member": "lab01.glab.lol", + "message": "ovs|00519|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181735681703", + "member": "lab01.glab.lol", + "message": "ovs|00520|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181736681885", + "member": "lab01.glab.lol", + "message": "ovs|00521|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181736682164", + "member": "lab01.glab.lol", + "message": "ovs|00522|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181737005718", + "member": "lab01.glab.lol", + "message": "ovs|00523|poll_loop|INFO|Dropped 12164 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181737681775", + "member": "lab01.glab.lol", + "message": "ovs|00525|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181737681906", + "member": "lab01.glab.lol", + "message": "ovs|00526|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181738681753", + "member": "lab01.glab.lol", + "message": "ovs|00527|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181738681871", + "member": "lab01.glab.lol", + "message": "ovs|00528|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181739681655", + "member": "lab01.glab.lol", + "message": "ovs|00529|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181739681935", + "member": "lab01.glab.lol", + "message": "ovs|00530|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181740682024", + "member": "lab01.glab.lol", + "message": "ovs|00531|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181740682253", + "member": "lab01.glab.lol", + "message": "ovs|00532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181741681966", + "member": "lab01.glab.lol", + "message": "ovs|00533|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181741682233", + "member": "lab01.glab.lol", + "message": "ovs|00534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181742681779", + "member": "lab01.glab.lol", + "message": "ovs|00535|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181742681889", + "member": "lab01.glab.lol", + "message": "ovs|00536|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181743005796", + "member": "lab01.glab.lol", + "message": "ovs|00537|poll_loop|INFO|Dropped 12166 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181743681539", + "member": "lab01.glab.lol", + "message": "ovs|00539|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181743681638", + "member": "lab01.glab.lol", + "message": "ovs|00540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181744681694", + "member": "lab01.glab.lol", + "message": "ovs|00541|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181744681901", + "member": "lab01.glab.lol", + "message": "ovs|00542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181745681860", + "member": "lab01.glab.lol", + "message": "ovs|00543|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181745682124", + "member": "lab01.glab.lol", + "message": "ovs|00544|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181746681868", + "member": "lab01.glab.lol", + "message": "ovs|00545|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181746682115", + "member": "lab01.glab.lol", + "message": "ovs|00546|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181747681707", + "member": "lab01.glab.lol", + "message": "ovs|00547|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181747681802", + "member": "lab01.glab.lol", + "message": "ovs|00548|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181748681524", + "member": "lab01.glab.lol", + "message": "ovs|00549|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181748681875", + "member": "lab01.glab.lol", + "message": "ovs|00550|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181749005546", + "member": "lab01.glab.lol", + "message": "ovs|00551|poll_loop|INFO|Dropped 12243 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181749681902", + "member": "lab01.glab.lol", + "message": "ovs|00553|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181749682115", + "member": "lab01.glab.lol", + "message": "ovs|00554|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181750681995", + "member": "lab01.glab.lol", + "message": "ovs|00555|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181750682224", + "member": "lab01.glab.lol", + "message": "ovs|00556|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181751681941", + "member": "lab01.glab.lol", + "message": "ovs|00557|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181751682054", + "member": "lab01.glab.lol", + "message": "ovs|00558|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181752681757", + "member": "lab01.glab.lol", + "message": "ovs|00559|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181752681866", + "member": "lab01.glab.lol", + "message": "ovs|00560|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181753681970", + "member": "lab01.glab.lol", + "message": "ovs|00561|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181753682288", + "member": "lab01.glab.lol", + "message": "ovs|00562|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181754682004", + "member": "lab01.glab.lol", + "message": "ovs|00563|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181754682253", + "member": "lab01.glab.lol", + "message": "ovs|00564|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181755005799", + "member": "lab01.glab.lol", + "message": "ovs|00565|poll_loop|INFO|Dropped 12157 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181755681683", + "member": "lab01.glab.lol", + "message": "ovs|00567|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181755681765", + "member": "lab01.glab.lol", + "message": "ovs|00568|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181756681887", + "member": "lab01.glab.lol", + "message": "ovs|00569|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181756682166", + "member": "lab01.glab.lol", + "message": "ovs|00570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181757681714", + "member": "lab01.glab.lol", + "message": "ovs|00571|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181757681867", + "member": "lab01.glab.lol", + "message": "ovs|00572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181758681931", + "member": "lab01.glab.lol", + "message": "ovs|00573|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181758682176", + "member": "lab01.glab.lol", + "message": "ovs|00574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181759681520", + "member": "lab01.glab.lol", + "message": "ovs|00575|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181759681628", + "member": "lab01.glab.lol", + "message": "ovs|00576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181760681964", + "member": "lab01.glab.lol", + "message": "ovs|00577|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181760682179", + "member": "lab01.glab.lol", + "message": "ovs|00578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181761005738", + "member": "lab01.glab.lol", + "message": "ovs|00579|poll_loop|INFO|Dropped 12282 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181761681577", + "member": "lab01.glab.lol", + "message": "ovs|00581|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181761681666", + "member": "lab01.glab.lol", + "message": "ovs|00582|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181762681972", + "member": "lab01.glab.lol", + "message": "ovs|00583|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181762682202", + "member": "lab01.glab.lol", + "message": "ovs|00584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181763681701", + "member": "lab01.glab.lol", + "message": "ovs|00585|dpif|WARN|Dropped 2068 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181763681806", + "member": "lab01.glab.lol", + "message": "ovs|00586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181764681943", + "member": "lab01.glab.lol", + "message": "ovs|00587|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181764682249", + "member": "lab01.glab.lol", + "message": "ovs|00588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181765681574", + "member": "lab01.glab.lol", + "message": "ovs|00589|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181765681727", + "member": "lab01.glab.lol", + "message": "ovs|00590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181766681780", + "member": "lab01.glab.lol", + "message": "ovs|00591|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181766716454", + "member": "lab01.glab.lol", + "message": "ovs|00592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181767005702", + "member": "lab01.glab.lol", + "message": "ovs|00593|poll_loop|INFO|Dropped 12225 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181767681745", + "member": "lab01.glab.lol", + "message": "ovs|00595|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181767681891", + "member": "lab01.glab.lol", + "message": "ovs|00596|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181768681930", + "member": "lab01.glab.lol", + "message": "ovs|00597|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181768682186", + "member": "lab01.glab.lol", + "message": "ovs|00598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181769681706", + "member": "lab01.glab.lol", + "message": "ovs|00599|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181769681860", + "member": "lab01.glab.lol", + "message": "ovs|00600|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181770640079", + "member": "lab01.glab.lol", + "message": "ovs|00601|bridge|INFO|bridge incusovn16: added interface patch-incus-net20-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789181770681766", + "member": "lab01.glab.lol", + "message": "ovs|00603|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181770681874", + "member": "lab01.glab.lol", + "message": "ovs|00604|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181771682043", + "member": "lab01.glab.lol", + "message": "ovs|00605|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181771682299", + "member": "lab01.glab.lol", + "message": "ovs|00606|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181772681929", + "member": "lab01.glab.lol", + "message": "ovs|00608|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181772682102", + "member": "lab01.glab.lol", + "message": "ovs|00609|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181773006024", + "member": "lab01.glab.lol", + "message": "ovs|00610|poll_loop|INFO|Dropped 12198 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181773681882", + "member": "lab01.glab.lol", + "message": "ovs|00612|dpif|WARN|Dropped 2119 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181773681993", + "member": "lab01.glab.lol", + "message": "ovs|00613|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181774239847", + "member": "lab01.glab.lol", + "message": "ovs|00614|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net18-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789181774513589", + "member": "lab01.glab.lol", + "message": "ovs|00616|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789181774513697", + "member": "lab01.glab.lol", + "message": "ovs|00617|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net20-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789181776460967", + "member": "lab01.glab.lol", + "message": "ovs|00619|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789181776461261", + "member": "lab01.glab.lol", + "message": "ovs|00621|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789181776559613", + "member": "lab01.glab.lol", + "message": "ovs|00625|dpif|WARN|Dropped 1708 log messages in last 3 seconds (most recently, 2 seconds ago) due to excessive rate" + }, + { + "at": "1789181776559661", + "member": "lab01.glab.lol", + "message": "ovs|00626|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181776559709", + "member": "lab01.glab.lol", + "message": "ovs|00627|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181776565673", + "member": "lab01.glab.lol", + "message": "ovs|00628|bridge|INFO|bridge incusovn16: added interface patch-incus-net21-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789181776681548", + "member": "lab01.glab.lol", + "message": "ovs|00630|dpif|WARN|Dropped 196 log messages in last 0 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181776681612", + "member": "lab01.glab.lol", + "message": "ovs|00631|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181777681905", + "member": "lab01.glab.lol", + "message": "ovs|00632|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181777682011", + "member": "lab01.glab.lol", + "message": "ovs|00633|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181778681637", + "member": "lab01.glab.lol", + "message": "ovs|00635|dpif|WARN|Dropped 1977 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181778681859", + "member": "lab01.glab.lol", + "message": "ovs|00636|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181779040972", + "member": "lab01.glab.lol", + "message": "ovs|00637|poll_loop|INFO|Dropped 3187 log messages in last 6 seconds (most recently, 4 seconds ago) due to excessive rate" + }, + { + "at": "1789181779682016", + "member": "lab01.glab.lol", + "message": "ovs|00639|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181779682241", + "member": "lab01.glab.lol", + "message": "ovs|00640|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181780681639", + "member": "lab01.glab.lol", + "message": "ovs|00642|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181780681713", + "member": "lab01.glab.lol", + "message": "ovs|00643|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181781681912", + "member": "lab01.glab.lol", + "message": "ovs|00644|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181781682179", + "member": "lab01.glab.lol", + "message": "ovs|00645|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181782682080", + "member": "lab01.glab.lol", + "message": "ovs|00646|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181782682321", + "member": "lab01.glab.lol", + "message": "ovs|00647|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181783681985", + "member": "lab01.glab.lol", + "message": "ovs|00648|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181783682131", + "member": "lab01.glab.lol", + "message": "ovs|00649|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181784682149", + "member": "lab01.glab.lol", + "message": "ovs|00650|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181784682325", + "member": "lab01.glab.lol", + "message": "ovs|00651|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181785005830", + "member": "lab01.glab.lol", + "message": "ovs|00652|poll_loop|INFO|Dropped 12260 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181785681748", + "member": "lab01.glab.lol", + "message": "ovs|00654|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181785681860", + "member": "lab01.glab.lol", + "message": "ovs|00655|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181786681715", + "member": "lab01.glab.lol", + "message": "ovs|00656|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181786681954", + "member": "lab01.glab.lol", + "message": "ovs|00657|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181787681669", + "member": "lab01.glab.lol", + "message": "ovs|00658|dpif|WARN|Dropped 2079 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181787681809", + "member": "lab01.glab.lol", + "message": "ovs|00659|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181788681842", + "member": "lab01.glab.lol", + "message": "ovs|00660|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181788682100", + "member": "lab01.glab.lol", + "message": "ovs|00661|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181789681809", + "member": "lab01.glab.lol", + "message": "ovs|00662|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181789681945", + "member": "lab01.glab.lol", + "message": "ovs|00663|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181790682035", + "member": "lab01.glab.lol", + "message": "ovs|00664|dpif|WARN|Dropped 2076 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181790682266", + "member": "lab01.glab.lol", + "message": "ovs|00665|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181791005714", + "member": "lab01.glab.lol", + "message": "ovs|00666|poll_loop|INFO|Dropped 12459 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181791682020", + "member": "lab01.glab.lol", + "message": "ovs|00668|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181791682115", + "member": "lab01.glab.lol", + "message": "ovs|00669|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181792681709", + "member": "lab01.glab.lol", + "message": "ovs|00670|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181792681830", + "member": "lab01.glab.lol", + "message": "ovs|00671|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181793681670", + "member": "lab01.glab.lol", + "message": "ovs|00672|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181793681893", + "member": "lab01.glab.lol", + "message": "ovs|00673|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181794677684", + "member": "lab01.glab.lol", + "message": "ovs|00674|bridge|WARN|Dropped 118241 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181794677793", + "member": "lab01.glab.lol", + "message": "ovs|00675|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181794681597", + "member": "lab01.glab.lol", + "message": "ovs|00676|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181794681668", + "member": "lab01.glab.lol", + "message": "ovs|00677|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181795681726", + "member": "lab01.glab.lol", + "message": "ovs|00678|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181795681972", + "member": "lab01.glab.lol", + "message": "ovs|00679|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181796681682", + "member": "lab01.glab.lol", + "message": "ovs|00680|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181796681799", + "member": "lab01.glab.lol", + "message": "ovs|00681|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181797005993", + "member": "lab01.glab.lol", + "message": "ovs|00682|poll_loop|INFO|Dropped 12254 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181797681643", + "member": "lab01.glab.lol", + "message": "ovs|00684|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181797681786", + "member": "lab01.glab.lol", + "message": "ovs|00685|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181798681747", + "member": "lab01.glab.lol", + "message": "ovs|00686|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181798681955", + "member": "lab01.glab.lol", + "message": "ovs|00687|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181799681982", + "member": "lab01.glab.lol", + "message": "ovs|00688|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181799682212", + "member": "lab01.glab.lol", + "message": "ovs|00689|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181800682021", + "member": "lab01.glab.lol", + "message": "ovs|00690|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181800682217", + "member": "lab01.glab.lol", + "message": "ovs|00691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181801681813", + "member": "lab01.glab.lol", + "message": "ovs|00692|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181801681958", + "member": "lab01.glab.lol", + "message": "ovs|00693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181802681838", + "member": "lab01.glab.lol", + "message": "ovs|00694|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181802682085", + "member": "lab01.glab.lol", + "message": "ovs|00695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181803005771", + "member": "lab01.glab.lol", + "message": "ovs|00696|poll_loop|INFO|Dropped 12162 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181803681773", + "member": "lab01.glab.lol", + "message": "ovs|00698|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181803682048", + "member": "lab01.glab.lol", + "message": "ovs|00699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181804681884", + "member": "lab01.glab.lol", + "message": "ovs|00700|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181804681983", + "member": "lab01.glab.lol", + "message": "ovs|00701|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181805681794", + "member": "lab01.glab.lol", + "message": "ovs|00702|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181805682045", + "member": "lab01.glab.lol", + "message": "ovs|00703|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181806681957", + "member": "lab01.glab.lol", + "message": "ovs|00704|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181806682191", + "member": "lab01.glab.lol", + "message": "ovs|00705|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181807681765", + "member": "lab01.glab.lol", + "message": "ovs|00706|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181807681918", + "member": "lab01.glab.lol", + "message": "ovs|00707|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181808681868", + "member": "lab01.glab.lol", + "message": "ovs|00708|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181808682121", + "member": "lab01.glab.lol", + "message": "ovs|00709|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181809006067", + "member": "lab01.glab.lol", + "message": "ovs|00710|poll_loop|INFO|Dropped 12307 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181809681864", + "member": "lab01.glab.lol", + "message": "ovs|00712|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181809681985", + "member": "lab01.glab.lol", + "message": "ovs|00713|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181810682065", + "member": "lab01.glab.lol", + "message": "ovs|00714|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181810682325", + "member": "lab01.glab.lol", + "message": "ovs|00715|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181811681861", + "member": "lab01.glab.lol", + "message": "ovs|00716|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181811681995", + "member": "lab01.glab.lol", + "message": "ovs|00717|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181812681987", + "member": "lab01.glab.lol", + "message": "ovs|00718|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181812682217", + "member": "lab01.glab.lol", + "message": "ovs|00719|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181813681614", + "member": "lab01.glab.lol", + "message": "ovs|00720|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181813681730", + "member": "lab01.glab.lol", + "message": "ovs|00721|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181814681725", + "member": "lab01.glab.lol", + "message": "ovs|00722|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181814682010", + "member": "lab01.glab.lol", + "message": "ovs|00723|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181815005597", + "member": "lab01.glab.lol", + "message": "ovs|00724|poll_loop|INFO|Dropped 12243 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181815681787", + "member": "lab01.glab.lol", + "message": "ovs|00726|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181815681997", + "member": "lab01.glab.lol", + "message": "ovs|00727|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181816681725", + "member": "lab01.glab.lol", + "message": "ovs|00728|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181816681866", + "member": "lab01.glab.lol", + "message": "ovs|00729|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181817681985", + "member": "lab01.glab.lol", + "message": "ovs|00730|dpif|WARN|Dropped 2095 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181817682235", + "member": "lab01.glab.lol", + "message": "ovs|00731|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181818681827", + "member": "lab01.glab.lol", + "message": "ovs|00732|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181818681928", + "member": "lab01.glab.lol", + "message": "ovs|00733|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181819681843", + "member": "lab01.glab.lol", + "message": "ovs|00734|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181819682094", + "member": "lab01.glab.lol", + "message": "ovs|00735|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181820681832", + "member": "lab01.glab.lol", + "message": "ovs|00736|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181820681966", + "member": "lab01.glab.lol", + "message": "ovs|00737|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181821005646", + "member": "lab01.glab.lol", + "message": "ovs|00738|poll_loop|INFO|Dropped 12333 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181821682029", + "member": "lab01.glab.lol", + "message": "ovs|00740|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181821682218", + "member": "lab01.glab.lol", + "message": "ovs|00741|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181822681917", + "member": "lab01.glab.lol", + "message": "ovs|00742|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181822682055", + "member": "lab01.glab.lol", + "message": "ovs|00743|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181823681664", + "member": "lab01.glab.lol", + "message": "ovs|00744|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181823681771", + "member": "lab01.glab.lol", + "message": "ovs|00745|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181824681889", + "member": "lab01.glab.lol", + "message": "ovs|00746|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181824682148", + "member": "lab01.glab.lol", + "message": "ovs|00747|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181825681802", + "member": "lab01.glab.lol", + "message": "ovs|00748|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181825681931", + "member": "lab01.glab.lol", + "message": "ovs|00749|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181826681708", + "member": "lab01.glab.lol", + "message": "ovs|00750|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181826681823", + "member": "lab01.glab.lol", + "message": "ovs|00751|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181827005650", + "member": "lab01.glab.lol", + "message": "ovs|00752|poll_loop|INFO|Dropped 12264 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181827682110", + "member": "lab01.glab.lol", + "message": "ovs|00754|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181827682281", + "member": "lab01.glab.lol", + "message": "ovs|00755|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181828681961", + "member": "lab01.glab.lol", + "message": "ovs|00756|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181828682204", + "member": "lab01.glab.lol", + "message": "ovs|00757|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181829681741", + "member": "lab01.glab.lol", + "message": "ovs|00758|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181829681856", + "member": "lab01.glab.lol", + "message": "ovs|00759|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181830681978", + "member": "lab01.glab.lol", + "message": "ovs|00760|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181830682178", + "member": "lab01.glab.lol", + "message": "ovs|00761|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181831681750", + "member": "lab01.glab.lol", + "message": "ovs|00762|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181831681900", + "member": "lab01.glab.lol", + "message": "ovs|00763|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181832681631", + "member": "lab01.glab.lol", + "message": "ovs|00764|dpif|WARN|Dropped 2093 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181832681867", + "member": "lab01.glab.lol", + "message": "ovs|00765|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181833005668", + "member": "lab01.glab.lol", + "message": "ovs|00766|poll_loop|INFO|Dropped 12518 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181833681737", + "member": "lab01.glab.lol", + "message": "ovs|00768|dpif|WARN|Dropped 2085 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181833681916", + "member": "lab01.glab.lol", + "message": "ovs|00769|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181834682019", + "member": "lab01.glab.lol", + "message": "ovs|00770|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181834682345", + "member": "lab01.glab.lol", + "message": "ovs|00771|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181835681815", + "member": "lab01.glab.lol", + "message": "ovs|00772|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181835681926", + "member": "lab01.glab.lol", + "message": "ovs|00773|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181836681867", + "member": "lab01.glab.lol", + "message": "ovs|00774|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181836682126", + "member": "lab01.glab.lol", + "message": "ovs|00775|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181837681638", + "member": "lab01.glab.lol", + "message": "ovs|00776|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181837681741", + "member": "lab01.glab.lol", + "message": "ovs|00777|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181838681977", + "member": "lab01.glab.lol", + "message": "ovs|00778|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181838682238", + "member": "lab01.glab.lol", + "message": "ovs|00779|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181839005785", + "member": "lab01.glab.lol", + "message": "ovs|00780|poll_loop|INFO|Dropped 12407 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181839681653", + "member": "lab01.glab.lol", + "message": "ovs|00782|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181839681788", + "member": "lab01.glab.lol", + "message": "ovs|00783|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181840682041", + "member": "lab01.glab.lol", + "message": "ovs|00785|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181840682153", + "member": "lab01.glab.lol", + "message": "ovs|00786|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181841681683", + "member": "lab01.glab.lol", + "message": "ovs|00787|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181841681904", + "member": "lab01.glab.lol", + "message": "ovs|00788|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181842681718", + "member": "lab01.glab.lol", + "message": "ovs|00789|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181842681918", + "member": "lab01.glab.lol", + "message": "ovs|00790|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181843682070", + "member": "lab01.glab.lol", + "message": "ovs|00791|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181843682323", + "member": "lab01.glab.lol", + "message": "ovs|00792|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181844682018", + "member": "lab01.glab.lol", + "message": "ovs|00793|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181844682174", + "member": "lab01.glab.lol", + "message": "ovs|00794|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181845005763", + "member": "lab01.glab.lol", + "message": "ovs|00795|poll_loop|INFO|Dropped 12252 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181845681793", + "member": "lab01.glab.lol", + "message": "ovs|00797|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181845681897", + "member": "lab01.glab.lol", + "message": "ovs|00798|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181846682160", + "member": "lab01.glab.lol", + "message": "ovs|00799|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181846682427", + "member": "lab01.glab.lol", + "message": "ovs|00800|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181847681622", + "member": "lab01.glab.lol", + "message": "ovs|00801|dpif|WARN|Dropped 2089 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181847681760", + "member": "lab01.glab.lol", + "message": "ovs|00802|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181848681688", + "member": "lab01.glab.lol", + "message": "ovs|00803|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181848681943", + "member": "lab01.glab.lol", + "message": "ovs|00804|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181849681970", + "member": "lab01.glab.lol", + "message": "ovs|00805|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181849682232", + "member": "lab01.glab.lol", + "message": "ovs|00806|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181850681921", + "member": "lab01.glab.lol", + "message": "ovs|00807|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181850682048", + "member": "lab01.glab.lol", + "message": "ovs|00808|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181851005898", + "member": "lab01.glab.lol", + "message": "ovs|00809|poll_loop|INFO|Dropped 12268 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181851682078", + "member": "lab01.glab.lol", + "message": "ovs|00811|dpif|WARN|Dropped 2051 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181851682323", + "member": "lab01.glab.lol", + "message": "ovs|00812|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181852681679", + "member": "lab01.glab.lol", + "message": "ovs|00813|dpif|WARN|Dropped 2106 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181852681833", + "member": "lab01.glab.lol", + "message": "ovs|00814|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181853681691", + "member": "lab01.glab.lol", + "message": "ovs|00815|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181853681941", + "member": "lab01.glab.lol", + "message": "ovs|00816|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181854678050", + "member": "lab01.glab.lol", + "message": "ovs|00817|bridge|WARN|Dropped 123090 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181854678166", + "member": "lab01.glab.lol", + "message": "ovs|00818|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181854682106", + "member": "lab01.glab.lol", + "message": "ovs|00819|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181854682298", + "member": "lab01.glab.lol", + "message": "ovs|00820|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181855681754", + "member": "lab01.glab.lol", + "message": "ovs|00821|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181855681895", + "member": "lab01.glab.lol", + "message": "ovs|00822|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181856681899", + "member": "lab01.glab.lol", + "message": "ovs|00823|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181856682096", + "member": "lab01.glab.lol", + "message": "ovs|00824|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181857005969", + "member": "lab01.glab.lol", + "message": "ovs|00825|poll_loop|INFO|Dropped 12340 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181857681916", + "member": "lab01.glab.lol", + "message": "ovs|00827|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181857682138", + "member": "lab01.glab.lol", + "message": "ovs|00828|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181858681742", + "member": "lab01.glab.lol", + "message": "ovs|00829|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181858681866", + "member": "lab01.glab.lol", + "message": "ovs|00830|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181859681870", + "member": "lab01.glab.lol", + "message": "ovs|00831|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181859682113", + "member": "lab01.glab.lol", + "message": "ovs|00832|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181860681917", + "member": "lab01.glab.lol", + "message": "ovs|00833|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181860682168", + "member": "lab01.glab.lol", + "message": "ovs|00834|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181861681776", + "member": "lab01.glab.lol", + "message": "ovs|00835|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181861681921", + "member": "lab01.glab.lol", + "message": "ovs|00836|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181862682066", + "member": "lab01.glab.lol", + "message": "ovs|00837|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181862682330", + "member": "lab01.glab.lol", + "message": "ovs|00838|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181863006127", + "member": "lab01.glab.lol", + "message": "ovs|00839|poll_loop|INFO|Dropped 12329 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181863681940", + "member": "lab01.glab.lol", + "message": "ovs|00841|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181863682032", + "member": "lab01.glab.lol", + "message": "ovs|00842|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181864681726", + "member": "lab01.glab.lol", + "message": "ovs|00843|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181864681935", + "member": "lab01.glab.lol", + "message": "ovs|00844|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181865681943", + "member": "lab01.glab.lol", + "message": "ovs|00845|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181865682169", + "member": "lab01.glab.lol", + "message": "ovs|00846|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181866681998", + "member": "lab01.glab.lol", + "message": "ovs|00847|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181866682242", + "member": "lab01.glab.lol", + "message": "ovs|00848|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181867681567", + "member": "lab01.glab.lol", + "message": "ovs|00849|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181867681682", + "member": "lab01.glab.lol", + "message": "ovs|00850|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181868682028", + "member": "lab01.glab.lol", + "message": "ovs|00851|dpif|WARN|Dropped 2047 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181868682355", + "member": "lab01.glab.lol", + "message": "ovs|00852|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181869005978", + "member": "lab01.glab.lol", + "message": "ovs|00853|poll_loop|INFO|Dropped 12298 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181869682093", + "member": "lab01.glab.lol", + "message": "ovs|00855|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181869682370", + "member": "lab01.glab.lol", + "message": "ovs|00856|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181870681672", + "member": "lab01.glab.lol", + "message": "ovs|00857|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181870681814", + "member": "lab01.glab.lol", + "message": "ovs|00858|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181871681735", + "member": "lab01.glab.lol", + "message": "ovs|00859|dpif|WARN|Dropped 2087 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181871681981", + "member": "lab01.glab.lol", + "message": "ovs|00860|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181872681939", + "member": "lab01.glab.lol", + "message": "ovs|00861|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181872682183", + "member": "lab01.glab.lol", + "message": "ovs|00862|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181873681673", + "member": "lab01.glab.lol", + "message": "ovs|00863|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181873681834", + "member": "lab01.glab.lol", + "message": "ovs|00864|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181874681638", + "member": "lab01.glab.lol", + "message": "ovs|00865|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181874681902", + "member": "lab01.glab.lol", + "message": "ovs|00866|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181875005915", + "member": "lab01.glab.lol", + "message": "ovs|00867|poll_loop|INFO|Dropped 12310 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181875681678", + "member": "lab01.glab.lol", + "message": "ovs|00869|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181875681923", + "member": "lab01.glab.lol", + "message": "ovs|00870|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181876682064", + "member": "lab01.glab.lol", + "message": "ovs|00871|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181876682325", + "member": "lab01.glab.lol", + "message": "ovs|00872|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181877682075", + "member": "lab01.glab.lol", + "message": "ovs|00873|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181877682297", + "member": "lab01.glab.lol", + "message": "ovs|00874|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181878682150", + "member": "lab01.glab.lol", + "message": "ovs|00875|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181878682458", + "member": "lab01.glab.lol", + "message": "ovs|00876|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181879681691", + "member": "lab01.glab.lol", + "message": "ovs|00877|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181879681813", + "member": "lab01.glab.lol", + "message": "ovs|00878|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181880681793", + "member": "lab01.glab.lol", + "message": "ovs|00879|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181880681999", + "member": "lab01.glab.lol", + "message": "ovs|00880|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181881005803", + "member": "lab01.glab.lol", + "message": "ovs|00881|poll_loop|INFO|Dropped 12113 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181881681818", + "member": "lab01.glab.lol", + "message": "ovs|00883|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181881682014", + "member": "lab01.glab.lol", + "message": "ovs|00884|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181882681641", + "member": "lab01.glab.lol", + "message": "ovs|00885|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181882681767", + "member": "lab01.glab.lol", + "message": "ovs|00886|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181883682082", + "member": "lab01.glab.lol", + "message": "ovs|00887|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181883682314", + "member": "lab01.glab.lol", + "message": "ovs|00888|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181884681706", + "member": "lab01.glab.lol", + "message": "ovs|00889|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181884681857", + "member": "lab01.glab.lol", + "message": "ovs|00890|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181885682050", + "member": "lab01.glab.lol", + "message": "ovs|00891|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181885682314", + "member": "lab01.glab.lol", + "message": "ovs|00892|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181886682006", + "member": "lab01.glab.lol", + "message": "ovs|00893|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181886682138", + "member": "lab01.glab.lol", + "message": "ovs|00894|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181887005984", + "member": "lab01.glab.lol", + "message": "ovs|00895|poll_loop|INFO|Dropped 12312 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181887681726", + "member": "lab01.glab.lol", + "message": "ovs|00897|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181887681847", + "member": "lab01.glab.lol", + "message": "ovs|00898|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181888681810", + "member": "lab01.glab.lol", + "message": "ovs|00899|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181888682092", + "member": "lab01.glab.lol", + "message": "ovs|00900|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181889681648", + "member": "lab01.glab.lol", + "message": "ovs|00901|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181889681784", + "member": "lab01.glab.lol", + "message": "ovs|00902|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181890681971", + "member": "lab01.glab.lol", + "message": "ovs|00903|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181890682223", + "member": "lab01.glab.lol", + "message": "ovs|00904|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181891682090", + "member": "lab01.glab.lol", + "message": "ovs|00905|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181891682308", + "member": "lab01.glab.lol", + "message": "ovs|00906|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181892681657", + "member": "lab01.glab.lol", + "message": "ovs|00907|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181892681772", + "member": "lab01.glab.lol", + "message": "ovs|00908|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181893005798", + "member": "lab01.glab.lol", + "message": "ovs|00909|poll_loop|INFO|Dropped 12398 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181893681994", + "member": "lab01.glab.lol", + "message": "ovs|00911|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181893682122", + "member": "lab01.glab.lol", + "message": "ovs|00912|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181894681994", + "member": "lab01.glab.lol", + "message": "ovs|00913|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181894682237", + "member": "lab01.glab.lol", + "message": "ovs|00914|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181895681783", + "member": "lab01.glab.lol", + "message": "ovs|00915|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181895681907", + "member": "lab01.glab.lol", + "message": "ovs|00916|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181896681924", + "member": "lab01.glab.lol", + "message": "ovs|00917|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181896682249", + "member": "lab01.glab.lol", + "message": "ovs|00918|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181897681702", + "member": "lab01.glab.lol", + "message": "ovs|00919|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181897681892", + "member": "lab01.glab.lol", + "message": "ovs|00920|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181898681859", + "member": "lab01.glab.lol", + "message": "ovs|00921|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181898682099", + "member": "lab01.glab.lol", + "message": "ovs|00922|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181899006126", + "member": "lab01.glab.lol", + "message": "ovs|00923|poll_loop|INFO|Dropped 12297 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181899681619", + "member": "lab01.glab.lol", + "message": "ovs|00925|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181899681758", + "member": "lab01.glab.lol", + "message": "ovs|00926|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181900681806", + "member": "lab01.glab.lol", + "message": "ovs|00927|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181900682076", + "member": "lab01.glab.lol", + "message": "ovs|00928|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181901681795", + "member": "lab01.glab.lol", + "message": "ovs|00929|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181901681939", + "member": "lab01.glab.lol", + "message": "ovs|00930|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181902681632", + "member": "lab01.glab.lol", + "message": "ovs|00931|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181902681740", + "member": "lab01.glab.lol", + "message": "ovs|00932|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181903681522", + "member": "lab01.glab.lol", + "message": "ovs|00933|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181903681748", + "member": "lab01.glab.lol", + "message": "ovs|00934|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181904681814", + "member": "lab01.glab.lol", + "message": "ovs|00935|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181904682077", + "member": "lab01.glab.lol", + "message": "ovs|00936|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181905005954", + "member": "lab01.glab.lol", + "message": "ovs|00937|poll_loop|INFO|Dropped 12194 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181905681929", + "member": "lab01.glab.lol", + "message": "ovs|00939|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181905682109", + "member": "lab01.glab.lol", + "message": "ovs|00940|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181906681571", + "member": "lab01.glab.lol", + "message": "ovs|00941|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181906681687", + "member": "lab01.glab.lol", + "message": "ovs|00942|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181907681860", + "member": "lab01.glab.lol", + "message": "ovs|00943|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181907682081", + "member": "lab01.glab.lol", + "message": "ovs|00944|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181908681724", + "member": "lab01.glab.lol", + "message": "ovs|00945|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181908681854", + "member": "lab01.glab.lol", + "message": "ovs|00946|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181909681878", + "member": "lab01.glab.lol", + "message": "ovs|00947|dpif|WARN|Dropped 2036 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181909682104", + "member": "lab01.glab.lol", + "message": "ovs|00948|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181910681936", + "member": "lab01.glab.lol", + "message": "ovs|00949|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181910682177", + "member": "lab01.glab.lol", + "message": "ovs|00950|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181911006078", + "member": "lab01.glab.lol", + "message": "ovs|00951|poll_loop|INFO|Dropped 12318 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181911682109", + "member": "lab01.glab.lol", + "message": "ovs|00953|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181911682360", + "member": "lab01.glab.lol", + "message": "ovs|00954|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181912681727", + "member": "lab01.glab.lol", + "message": "ovs|00955|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181912681884", + "member": "lab01.glab.lol", + "message": "ovs|00956|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181913681770", + "member": "lab01.glab.lol", + "message": "ovs|00957|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181913682023", + "member": "lab01.glab.lol", + "message": "ovs|00958|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181914677833", + "member": "lab01.glab.lol", + "message": "ovs|00959|bridge|WARN|Dropped 122964 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181914677972", + "member": "lab01.glab.lol", + "message": "ovs|00960|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181914682023", + "member": "lab01.glab.lol", + "message": "ovs|00961|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181914682186", + "member": "lab01.glab.lol", + "message": "ovs|00962|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181915681885", + "member": "lab01.glab.lol", + "message": "ovs|00963|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181915682019", + "member": "lab01.glab.lol", + "message": "ovs|00964|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181916681985", + "member": "lab01.glab.lol", + "message": "ovs|00965|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181916682244", + "member": "lab01.glab.lol", + "message": "ovs|00966|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181917005967", + "member": "lab01.glab.lol", + "message": "ovs|00967|poll_loop|INFO|Dropped 12308 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181917681817", + "member": "lab01.glab.lol", + "message": "ovs|00969|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181917681951", + "member": "lab01.glab.lol", + "message": "ovs|00970|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181918681967", + "member": "lab01.glab.lol", + "message": "ovs|00971|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181918682214", + "member": "lab01.glab.lol", + "message": "ovs|00972|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181919682115", + "member": "lab01.glab.lol", + "message": "ovs|00973|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181919682366", + "member": "lab01.glab.lol", + "message": "ovs|00974|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181920681519", + "member": "lab01.glab.lol", + "message": "ovs|00975|dpif|WARN|Dropped 1986 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181920681637", + "member": "lab01.glab.lol", + "message": "ovs|00976|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181921681555", + "member": "lab01.glab.lol", + "message": "ovs|00977|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181921681763", + "member": "lab01.glab.lol", + "message": "ovs|00978|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181922681901", + "member": "lab01.glab.lol", + "message": "ovs|00979|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181922682148", + "member": "lab01.glab.lol", + "message": "ovs|00980|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181923005574", + "member": "lab01.glab.lol", + "message": "ovs|00981|poll_loop|INFO|Dropped 12070 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181923681904", + "member": "lab01.glab.lol", + "message": "ovs|00983|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181923682131", + "member": "lab01.glab.lol", + "message": "ovs|00984|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181924681671", + "member": "lab01.glab.lol", + "message": "ovs|00985|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181924681810", + "member": "lab01.glab.lol", + "message": "ovs|00986|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181925681717", + "member": "lab01.glab.lol", + "message": "ovs|00987|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181925681958", + "member": "lab01.glab.lol", + "message": "ovs|00988|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181926681988", + "member": "lab01.glab.lol", + "message": "ovs|00989|dpif|WARN|Dropped 2058 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181926682238", + "member": "lab01.glab.lol", + "message": "ovs|00990|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181927681841", + "member": "lab01.glab.lol", + "message": "ovs|00991|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181927681964", + "member": "lab01.glab.lol", + "message": "ovs|00992|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181928681803", + "member": "lab01.glab.lol", + "message": "ovs|00993|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181928682104", + "member": "lab01.glab.lol", + "message": "ovs|00994|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181929005896", + "member": "lab01.glab.lol", + "message": "ovs|00995|poll_loop|INFO|Dropped 12251 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181929681798", + "member": "lab01.glab.lol", + "message": "ovs|00997|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181929681918", + "member": "lab01.glab.lol", + "message": "ovs|00998|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181930681658", + "member": "lab01.glab.lol", + "message": "ovs|00999|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181930681804", + "member": "lab01.glab.lol", + "message": "ovs|01000|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181931681801", + "member": "lab01.glab.lol", + "message": "ovs|01001|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181931682147", + "member": "lab01.glab.lol", + "message": "ovs|01002|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181932681700", + "member": "lab01.glab.lol", + "message": "ovs|01003|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181932681846", + "member": "lab01.glab.lol", + "message": "ovs|01004|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181933682109", + "member": "lab01.glab.lol", + "message": "ovs|01005|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181933682318", + "member": "lab01.glab.lol", + "message": "ovs|01006|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181934681882", + "member": "lab01.glab.lol", + "message": "ovs|01007|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181934682029", + "member": "lab01.glab.lol", + "message": "ovs|01008|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181935005917", + "member": "lab01.glab.lol", + "message": "ovs|01009|poll_loop|INFO|Dropped 12249 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181935681755", + "member": "lab01.glab.lol", + "message": "ovs|01011|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181935681866", + "member": "lab01.glab.lol", + "message": "ovs|01012|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181936682109", + "member": "lab01.glab.lol", + "message": "ovs|01013|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181936682360", + "member": "lab01.glab.lol", + "message": "ovs|01014|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181937681706", + "member": "lab01.glab.lol", + "message": "ovs|01015|dpif|WARN|Dropped 1988 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181937681813", + "member": "lab01.glab.lol", + "message": "ovs|01016|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181938681692", + "member": "lab01.glab.lol", + "message": "ovs|01017|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181938681910", + "member": "lab01.glab.lol", + "message": "ovs|01018|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181939681615", + "member": "lab01.glab.lol", + "message": "ovs|01019|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181939681758", + "member": "lab01.glab.lol", + "message": "ovs|01020|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181940682008", + "member": "lab01.glab.lol", + "message": "ovs|01021|dpif|WARN|Dropped 2066 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181940682239", + "member": "lab01.glab.lol", + "message": "ovs|01022|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181941005684", + "member": "lab01.glab.lol", + "message": "ovs|01023|poll_loop|INFO|Dropped 12165 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181941682072", + "member": "lab01.glab.lol", + "message": "ovs|01025|dpif|WARN|Dropped 2090 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181941682303", + "member": "lab01.glab.lol", + "message": "ovs|01026|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181942682065", + "member": "lab01.glab.lol", + "message": "ovs|01027|dpif|WARN|Dropped 2051 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181942731789", + "member": "lab01.glab.lol", + "message": "ovs|01028|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181943681807", + "member": "lab01.glab.lol", + "message": "ovs|01029|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181943681928", + "member": "lab01.glab.lol", + "message": "ovs|01030|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181944681945", + "member": "lab01.glab.lol", + "message": "ovs|01031|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181944682166", + "member": "lab01.glab.lol", + "message": "ovs|01032|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181945681967", + "member": "lab01.glab.lol", + "message": "ovs|01033|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181945682210", + "member": "lab01.glab.lol", + "message": "ovs|01034|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181946682037", + "member": "lab01.glab.lol", + "message": "ovs|01035|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181946682300", + "member": "lab01.glab.lol", + "message": "ovs|01036|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181947005873", + "member": "lab01.glab.lol", + "message": "ovs|01037|poll_loop|INFO|Dropped 12191 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181947681605", + "member": "lab01.glab.lol", + "message": "ovs|01039|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181947681746", + "member": "lab01.glab.lol", + "message": "ovs|01040|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181948682062", + "member": "lab01.glab.lol", + "message": "ovs|01041|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181948682417", + "member": "lab01.glab.lol", + "message": "ovs|01042|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181949682005", + "member": "lab01.glab.lol", + "message": "ovs|01043|dpif|WARN|Dropped 2075 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181949682160", + "member": "lab01.glab.lol", + "message": "ovs|01044|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181950681755", + "member": "lab01.glab.lol", + "message": "ovs|01045|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181950681879", + "member": "lab01.glab.lol", + "message": "ovs|01046|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181951681886", + "member": "lab01.glab.lol", + "message": "ovs|01047|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181951682155", + "member": "lab01.glab.lol", + "message": "ovs|01048|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181952681883", + "member": "lab01.glab.lol", + "message": "ovs|01049|dpif|WARN|Dropped 2048 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181952681993", + "member": "lab01.glab.lol", + "message": "ovs|01050|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181953006116", + "member": "lab01.glab.lol", + "message": "ovs|01051|poll_loop|INFO|Dropped 12229 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181953681839", + "member": "lab01.glab.lol", + "message": "ovs|01053|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181953681925", + "member": "lab01.glab.lol", + "message": "ovs|01054|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181954682019", + "member": "lab01.glab.lol", + "message": "ovs|01055|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181954682256", + "member": "lab01.glab.lol", + "message": "ovs|01056|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181955682001", + "member": "lab01.glab.lol", + "message": "ovs|01057|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181955682149", + "member": "lab01.glab.lol", + "message": "ovs|01058|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181956681642", + "member": "lab01.glab.lol", + "message": "ovs|01059|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181956681808", + "member": "lab01.glab.lol", + "message": "ovs|01060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181957681863", + "member": "lab01.glab.lol", + "message": "ovs|01061|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181957682130", + "member": "lab01.glab.lol", + "message": "ovs|01062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181958681665", + "member": "lab01.glab.lol", + "message": "ovs|01063|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181958681803", + "member": "lab01.glab.lol", + "message": "ovs|01064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181959005950", + "member": "lab01.glab.lol", + "message": "ovs|01065|poll_loop|INFO|Dropped 12168 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181959681929", + "member": "lab01.glab.lol", + "message": "ovs|01067|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181959682111", + "member": "lab01.glab.lol", + "message": "ovs|01068|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181960681737", + "member": "lab01.glab.lol", + "message": "ovs|01069|dpif|WARN|Dropped 1973 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181960682006", + "member": "lab01.glab.lol", + "message": "ovs|01070|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181961681928", + "member": "lab01.glab.lol", + "message": "ovs|01071|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181961682167", + "member": "lab01.glab.lol", + "message": "ovs|01072|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181962682018", + "member": "lab01.glab.lol", + "message": "ovs|01073|dpif|WARN|Dropped 1976 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181962682260", + "member": "lab01.glab.lol", + "message": "ovs|01074|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181963681918", + "member": "lab01.glab.lol", + "message": "ovs|01075|dpif|WARN|Dropped 1992 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181963682033", + "member": "lab01.glab.lol", + "message": "ovs|01076|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181964682137", + "member": "lab01.glab.lol", + "message": "ovs|01077|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181964682390", + "member": "lab01.glab.lol", + "message": "ovs|01078|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181965006547", + "member": "lab01.glab.lol", + "message": "ovs|01079|poll_loop|INFO|Dropped 11951 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181965681964", + "member": "lab01.glab.lol", + "message": "ovs|01081|dpif|WARN|Dropped 2000 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181965682131", + "member": "lab01.glab.lol", + "message": "ovs|01082|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181966682026", + "member": "lab01.glab.lol", + "message": "ovs|01083|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181966682263", + "member": "lab01.glab.lol", + "message": "ovs|01084|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181967681776", + "member": "lab01.glab.lol", + "message": "ovs|01085|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181967681934", + "member": "lab01.glab.lol", + "message": "ovs|01086|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181968681758", + "member": "lab01.glab.lol", + "message": "ovs|01087|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181968682020", + "member": "lab01.glab.lol", + "message": "ovs|01088|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181969681783", + "member": "lab01.glab.lol", + "message": "ovs|01089|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181969682046", + "member": "lab01.glab.lol", + "message": "ovs|01090|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181970681909", + "member": "lab01.glab.lol", + "message": "ovs|01091|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181970682171", + "member": "lab01.glab.lol", + "message": "ovs|01092|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181971006027", + "member": "lab01.glab.lol", + "message": "ovs|01093|poll_loop|INFO|Dropped 12072 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181971682063", + "member": "lab01.glab.lol", + "message": "ovs|01095|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181971682305", + "member": "lab01.glab.lol", + "message": "ovs|01096|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181972681940", + "member": "lab01.glab.lol", + "message": "ovs|01097|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181972682088", + "member": "lab01.glab.lol", + "message": "ovs|01098|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181973681819", + "member": "lab01.glab.lol", + "message": "ovs|01099|dpif|WARN|Dropped 2053 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181973681970", + "member": "lab01.glab.lol", + "message": "ovs|01100|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181974678062", + "member": "lab01.glab.lol", + "message": "ovs|01101|bridge|WARN|Dropped 121521 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181974678317", + "member": "lab01.glab.lol", + "message": "ovs|01102|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789181974681792", + "member": "lab01.glab.lol", + "message": "ovs|01103|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181974681833", + "member": "lab01.glab.lol", + "message": "ovs|01104|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181975681735", + "member": "lab01.glab.lol", + "message": "ovs|01105|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181975681992", + "member": "lab01.glab.lol", + "message": "ovs|01106|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181976681918", + "member": "lab01.glab.lol", + "message": "ovs|01107|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181976682144", + "member": "lab01.glab.lol", + "message": "ovs|01108|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181977005903", + "member": "lab01.glab.lol", + "message": "ovs|01109|poll_loop|INFO|Dropped 12188 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181977681936", + "member": "lab01.glab.lol", + "message": "ovs|01111|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181977682196", + "member": "lab01.glab.lol", + "message": "ovs|01112|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181978681946", + "member": "lab01.glab.lol", + "message": "ovs|01113|dpif|WARN|Dropped 1996 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181978682057", + "member": "lab01.glab.lol", + "message": "ovs|01114|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181979681761", + "member": "lab01.glab.lol", + "message": "ovs|01115|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181979681920", + "member": "lab01.glab.lol", + "message": "ovs|01116|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181980681839", + "member": "lab01.glab.lol", + "message": "ovs|01117|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181980682088", + "member": "lab01.glab.lol", + "message": "ovs|01118|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181981681645", + "member": "lab01.glab.lol", + "message": "ovs|01119|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181981681796", + "member": "lab01.glab.lol", + "message": "ovs|01120|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181982681527", + "member": "lab01.glab.lol", + "message": "ovs|01121|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181982681792", + "member": "lab01.glab.lol", + "message": "ovs|01122|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181983005703", + "member": "lab01.glab.lol", + "message": "ovs|01123|poll_loop|INFO|Dropped 12087 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181983681857", + "member": "lab01.glab.lol", + "message": "ovs|01125|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181983682118", + "member": "lab01.glab.lol", + "message": "ovs|01126|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181984681885", + "member": "lab01.glab.lol", + "message": "ovs|01127|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181984682112", + "member": "lab01.glab.lol", + "message": "ovs|01128|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181985681935", + "member": "lab01.glab.lol", + "message": "ovs|01129|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181985682169", + "member": "lab01.glab.lol", + "message": "ovs|01130|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181986681874", + "member": "lab01.glab.lol", + "message": "ovs|01131|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181986681990", + "member": "lab01.glab.lol", + "message": "ovs|01132|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181987681945", + "member": "lab01.glab.lol", + "message": "ovs|01133|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181987682130", + "member": "lab01.glab.lol", + "message": "ovs|01134|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181988681695", + "member": "lab01.glab.lol", + "message": "ovs|01135|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181988681836", + "member": "lab01.glab.lol", + "message": "ovs|01136|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181989005821", + "member": "lab01.glab.lol", + "message": "ovs|01137|poll_loop|INFO|Dropped 12025 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181989681772", + "member": "lab01.glab.lol", + "message": "ovs|01139|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181989681881", + "member": "lab01.glab.lol", + "message": "ovs|01140|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181990681886", + "member": "lab01.glab.lol", + "message": "ovs|01141|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181990682212", + "member": "lab01.glab.lol", + "message": "ovs|01142|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181991681895", + "member": "lab01.glab.lol", + "message": "ovs|01143|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181991682143", + "member": "lab01.glab.lol", + "message": "ovs|01144|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181992681949", + "member": "lab01.glab.lol", + "message": "ovs|01145|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181992682162", + "member": "lab01.glab.lol", + "message": "ovs|01146|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181993681775", + "member": "lab01.glab.lol", + "message": "ovs|01147|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181993681903", + "member": "lab01.glab.lol", + "message": "ovs|01148|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181994681648", + "member": "lab01.glab.lol", + "message": "ovs|01149|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181994681914", + "member": "lab01.glab.lol", + "message": "ovs|01150|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181995005767", + "member": "lab01.glab.lol", + "message": "ovs|01151|poll_loop|INFO|Dropped 12058 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181995681624", + "member": "lab01.glab.lol", + "message": "ovs|01153|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181995681802", + "member": "lab01.glab.lol", + "message": "ovs|01154|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181996681895", + "member": "lab01.glab.lol", + "message": "ovs|01155|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181996682171", + "member": "lab01.glab.lol", + "message": "ovs|01156|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181997681979", + "member": "lab01.glab.lol", + "message": "ovs|01157|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181997682229", + "member": "lab01.glab.lol", + "message": "ovs|01158|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181998681661", + "member": "lab01.glab.lol", + "message": "ovs|01159|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181998681821", + "member": "lab01.glab.lol", + "message": "ovs|01160|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789181999681617", + "member": "lab01.glab.lol", + "message": "ovs|01161|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789181999681861", + "member": "lab01.glab.lol", + "message": "ovs|01162|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182000681745", + "member": "lab01.glab.lol", + "message": "ovs|01163|dpif|WARN|Dropped 2045 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182000682025", + "member": "lab01.glab.lol", + "message": "ovs|01164|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182001005750", + "member": "lab01.glab.lol", + "message": "ovs|01165|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182001682014", + "member": "lab01.glab.lol", + "message": "ovs|01167|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182001682231", + "member": "lab01.glab.lol", + "message": "ovs|01168|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182002681693", + "member": "lab01.glab.lol", + "message": "ovs|01169|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182002681827", + "member": "lab01.glab.lol", + "message": "ovs|01170|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182003681685", + "member": "lab01.glab.lol", + "message": "ovs|01171|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182003681925", + "member": "lab01.glab.lol", + "message": "ovs|01172|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182004681739", + "member": "lab01.glab.lol", + "message": "ovs|01173|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182004682022", + "member": "lab01.glab.lol", + "message": "ovs|01174|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182005681777", + "member": "lab01.glab.lol", + "message": "ovs|01175|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182005681995", + "member": "lab01.glab.lol", + "message": "ovs|01176|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182006681636", + "member": "lab01.glab.lol", + "message": "ovs|01177|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182006681741", + "member": "lab01.glab.lol", + "message": "ovs|01178|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182007005948", + "member": "lab01.glab.lol", + "message": "ovs|01179|poll_loop|INFO|Dropped 12127 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182007681810", + "member": "lab01.glab.lol", + "message": "ovs|01181|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182007681960", + "member": "lab01.glab.lol", + "message": "ovs|01182|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182008681722", + "member": "lab01.glab.lol", + "message": "ovs|01183|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182008681972", + "member": "lab01.glab.lol", + "message": "ovs|01184|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182009681746", + "member": "lab01.glab.lol", + "message": "ovs|01185|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182009682020", + "member": "lab01.glab.lol", + "message": "ovs|01186|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182010681725", + "member": "lab01.glab.lol", + "message": "ovs|01187|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182010681826", + "member": "lab01.glab.lol", + "message": "ovs|01188|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182011681752", + "member": "lab01.glab.lol", + "message": "ovs|01189|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182011681870", + "member": "lab01.glab.lol", + "message": "ovs|01190|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182012681759", + "member": "lab01.glab.lol", + "message": "ovs|01191|dpif|WARN|Dropped 2002 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182012681893", + "member": "lab01.glab.lol", + "message": "ovs|01192|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182013005923", + "member": "lab01.glab.lol", + "message": "ovs|01193|poll_loop|INFO|Dropped 12056 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182013681703", + "member": "lab01.glab.lol", + "message": "ovs|01195|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182013681829", + "member": "lab01.glab.lol", + "message": "ovs|01196|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182014681750", + "member": "lab01.glab.lol", + "message": "ovs|01197|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182014681993", + "member": "lab01.glab.lol", + "message": "ovs|01198|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182015681979", + "member": "lab01.glab.lol", + "message": "ovs|01199|dpif|WARN|Dropped 2020 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182015682241", + "member": "lab01.glab.lol", + "message": "ovs|01200|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182016682057", + "member": "lab01.glab.lol", + "message": "ovs|01201|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182016682310", + "member": "lab01.glab.lol", + "message": "ovs|01202|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182017681665", + "member": "lab01.glab.lol", + "message": "ovs|01203|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182017681789", + "member": "lab01.glab.lol", + "message": "ovs|01204|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182018681949", + "member": "lab01.glab.lol", + "message": "ovs|01205|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182018682195", + "member": "lab01.glab.lol", + "message": "ovs|01206|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182019005728", + "member": "lab01.glab.lol", + "message": "ovs|01207|poll_loop|INFO|Dropped 12110 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182019681806", + "member": "lab01.glab.lol", + "message": "ovs|01209|dpif|WARN|Dropped 1985 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182019681912", + "member": "lab01.glab.lol", + "message": "ovs|01210|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182020681899", + "member": "lab01.glab.lol", + "message": "ovs|01211|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182020682138", + "member": "lab01.glab.lol", + "message": "ovs|01212|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182021681650", + "member": "lab01.glab.lol", + "message": "ovs|01213|dpif|WARN|Dropped 2056 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182021681763", + "member": "lab01.glab.lol", + "message": "ovs|01214|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182022681570", + "member": "lab01.glab.lol", + "message": "ovs|01215|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182022681794", + "member": "lab01.glab.lol", + "message": "ovs|01216|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182023681645", + "member": "lab01.glab.lol", + "message": "ovs|01217|dpif|WARN|Dropped 2071 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182023681876", + "member": "lab01.glab.lol", + "message": "ovs|01218|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182024681796", + "member": "lab01.glab.lol", + "message": "ovs|01219|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182024682033", + "member": "lab01.glab.lol", + "message": "ovs|01220|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182025005630", + "member": "lab01.glab.lol", + "message": "ovs|01221|poll_loop|INFO|Dropped 12254 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182025681727", + "member": "lab01.glab.lol", + "message": "ovs|01223|dpif|WARN|Dropped 2055 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182025681861", + "member": "lab01.glab.lol", + "message": "ovs|01224|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182026681998", + "member": "lab01.glab.lol", + "message": "ovs|01225|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182026682232", + "member": "lab01.glab.lol", + "message": "ovs|01226|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182027681543", + "member": "lab01.glab.lol", + "message": "ovs|01227|dpif|WARN|Dropped 2054 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182027681657", + "member": "lab01.glab.lol", + "message": "ovs|01228|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182028681840", + "member": "lab01.glab.lol", + "message": "ovs|01229|dpif|WARN|Dropped 2037 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182028682058", + "member": "lab01.glab.lol", + "message": "ovs|01230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182029681821", + "member": "lab01.glab.lol", + "message": "ovs|01231|dpif|WARN|Dropped 2069 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182029681925", + "member": "lab01.glab.lol", + "message": "ovs|01232|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182030681714", + "member": "lab01.glab.lol", + "message": "ovs|01233|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182030681817", + "member": "lab01.glab.lol", + "message": "ovs|01234|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182031005674", + "member": "lab01.glab.lol", + "message": "ovs|01235|poll_loop|INFO|Dropped 12339 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182031681899", + "member": "lab01.glab.lol", + "message": "ovs|01237|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182031682006", + "member": "lab01.glab.lol", + "message": "ovs|01238|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182032681694", + "member": "lab01.glab.lol", + "message": "ovs|01239|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182032681891", + "member": "lab01.glab.lol", + "message": "ovs|01240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182033681686", + "member": "lab01.glab.lol", + "message": "ovs|01241|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182033681797", + "member": "lab01.glab.lol", + "message": "ovs|01242|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182034677816", + "member": "lab01.glab.lol", + "message": "ovs|01243|bridge|WARN|Dropped 121460 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182034677906", + "member": "lab01.glab.lol", + "message": "ovs|01244|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789182034681611", + "member": "lab01.glab.lol", + "message": "ovs|01245|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182034681651", + "member": "lab01.glab.lol", + "message": "ovs|01246|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182035681704", + "member": "lab01.glab.lol", + "message": "ovs|01247|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182035681944", + "member": "lab01.glab.lol", + "message": "ovs|01248|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182036681666", + "member": "lab01.glab.lol", + "message": "ovs|01249|dpif|WARN|Dropped 2061 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182036681764", + "member": "lab01.glab.lol", + "message": "ovs|01250|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182036722284", + "member": "lab01.glab.lol", + "message": "ovs|01251|bridge|INFO|bridge incusovn16: added interface patch-incus-net23-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789182037005578", + "member": "lab01.glab.lol", + "message": "ovs|01253|poll_loop|INFO|Dropped 12329 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182037681990", + "member": "lab01.glab.lol", + "message": "ovs|01256|dpif|WARN|Dropped 1968 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182037682164", + "member": "lab01.glab.lol", + "message": "ovs|01257|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182038681599", + "member": "lab01.glab.lol", + "message": "ovs|01258|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182038681704", + "member": "lab01.glab.lol", + "message": "ovs|01259|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182039681719", + "member": "lab01.glab.lol", + "message": "ovs|01260|dpif|WARN|Dropped 2060 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789182039681955", + "member": "lab01.glab.lol", + "message": "ovs|01261|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789182039814773", + "member": "lab01.glab.lol", + "message": "ovs|01262|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net21-ls-ext-lsp-provider-to-br-int on port 1" + }, + { + "at": "1789182040101556", + "member": "lab01.glab.lol", + "message": "ovs|01264|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789182040101609", + "member": "lab01.glab.lol", + "message": "ovs|01265|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net23-ls-ext-lsp-provider-to-br-int on port 2" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/lab01-ovs-before-rate-limit.json b/spikes/ovn/diagnosis-2026-09-12/lab01-ovs-before-rate-limit.json new file mode 100644 index 0000000..a3b30a1 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/lab01-ovs-before-rate-limit.json @@ -0,0 +1,352 @@ +[ + { + "at": "1789192054041880", + "member": "lab01.glab.lol", + "message": "ovs|01268|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789192054042040", + "member": "lab01.glab.lol", + "message": "ovs|01269|bridge|INFO|bridge incusovn16: using datapath ID 0000261ad7c9334d" + }, + { + "at": "1789192054042059", + "member": "lab01.glab.lol", + "message": "ovs|01270|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789192054043803", + "member": "lab01.glab.lol", + "message": "ovs|01271|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054043869", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789192054043896", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054043909", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054043938", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054043949", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054043963", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054043976", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054043996", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044029", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789192054044039", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044057", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044075", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xca374396" + }, + { + "at": "1789192054044093", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044104", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044121", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044140", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044150", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044162", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044173", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044185", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044206", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044219", + "member": "lab01.glab.lol", + "message": "ovs|01272|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044233", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789192054044244", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044256", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044279", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044290", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044301", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054044311", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054044320", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044336", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789192054044354", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044371", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044380", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x6af7c434" + }, + { + "at": "1789192054044429", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044443", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044453", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044463", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044475", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044489", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044503", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044512", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044537", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789192054044550", + "member": "lab01.glab.lol", + "message": "ovs|01273|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789192054044577", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789192054044597", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789192054044610", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789192054044622", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789192054044631", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789192054044646", + "member": "lab01.glab.lol", + "message": " Detect Time: now -1506332044ms" + }, + { + "at": "1789192054044658", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor129)|INFO|monitor thread created" + }, + { + "at": "1789192054044671", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -1506332044ms" + }, + { + "at": "1789192054044684", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1506332044ms" + }, + { + "at": "1789192054044701", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789192054044710", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789192054044729", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044741", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xdc50ac8c" + }, + { + "at": "1789192054044756", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789192054044765", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044775", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789192054044793", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789192054044802", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789192054044813", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789192054044824", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789192054044833", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789192054044844", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/lab01-parent-consumer.json b/spikes/ovn/diagnosis-2026-09-12/lab01-parent-consumer.json new file mode 100644 index 0000000..7537f52 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/lab01-parent-consumer.json @@ -0,0 +1,18 @@ +{ + "observed_during": "after keeper cycle 1", + "member": "lab01", + "project": "default", + "instance": "soak01", + "commands": [ + "incus query 'nas01:/1.0/instances/soak01?project=default' | jq '{name, status, expanded_devices}'", + "incus query 'nas01:/1.0/instances/soak01/state?project=default' | jq '{status,eth1:(.network.eth1|{state,host_name,mtu,type})}'" + ], + "status": "Running", + "expanded_devices": { + "eth0": {"name": "eth0", "network": "incusbr0", "type": "nic"}, + "eth1": {"nictype": "macvlan", "parent": "fast40", "type": "nic"}, + "root": {"path": "/", "pool": "data", "type": "disk"} + }, + "eth1_runtime": {"state": "up", "host_name": "fast40", "mtu": 1500, "type": "broadcast"}, + "mutations": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/lab01-post-reboot-ovs-conflict.json b/spikes/ovn/diagnosis-2026-09-12/lab01-post-reboot-ovs-conflict.json new file mode 100644 index 0000000..0b30de0 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/lab01-post-reboot-ovs-conflict.json @@ -0,0 +1,112 @@ +[ + { + "at": "1789228899373949", + "member": "lab01.glab.lol", + "message": "ovs|00049|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374056", + "member": "lab01.glab.lol", + "message": "ovs|00050|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899374277", + "member": "lab01.glab.lol", + "message": "ovs|00051|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899374330", + "member": "lab01.glab.lol", + "message": "ovs|00052|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899375364", + "member": "lab01.glab.lol", + "message": "ovs|00053|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899375439", + "member": "lab01.glab.lol", + "message": "ovs|00054|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899376218", + "member": "lab01.glab.lol", + "message": "ovs|00055|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899376241", + "member": "lab01.glab.lol", + "message": "ovs|00056|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377021", + "member": "lab01.glab.lol", + "message": "ovs|00057|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899377055", + "member": "lab01.glab.lol", + "message": "ovs|00058|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789228899377910", + "member": "lab01.glab.lol", + "message": "ovs|00060|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899379010", + "member": "lab01.glab.lol", + "message": "ovs|00062|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899379810", + "member": "lab01.glab.lol", + "message": "ovs|00063|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228899380595", + "member": "lab01.glab.lol", + "message": "ovs|00064|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228900377154", + "member": "lab01.glab.lol", + "message": "ovs|00066|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228901376717", + "member": "lab01.glab.lol", + "message": "ovs|00069|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228902376664", + "member": "lab01.glab.lol", + "message": "ovs|00071|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228903376846", + "member": "lab01.glab.lol", + "message": "ovs|00083|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228904377088", + "member": "lab01.glab.lol", + "message": "ovs|00085|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228905376940", + "member": "lab01.glab.lol", + "message": "ovs|00087|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228906376535", + "member": "lab01.glab.lol", + "message": "ovs|00089|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789228907376589", + "member": "lab01.glab.lol", + "message": "ovs|00091|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/commands.jsonl new file mode 100644 index 0000000..12e7a82 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/commands.jsonl @@ -0,0 +1,28 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.11, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:06:01.888658+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.415, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:06:02.304611+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.11, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T06:06:02.414825+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 67193, "ready": true, "ready_signal": "time=\"2026-09-11T23:06:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:06:02.512188+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/topology.jsonl", "create"], "seconds": 8.581, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.65\",\n \"network_create_seconds\": 0.245,\n \"first_cross_member_ping_seconds\": 3.421,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:11.093253+00:00"} +{"capture": "monitor-create", "pid": 67193, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.log", "ready_signal": "time=\"2026-09-11T23:06:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:06:11.095729+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.124, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:11.220312+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.106, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:35:41:50 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:22:21:09 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:11.327179+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.134, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 9cac7f95-f139-429f-a4ce-22e30a7552b7 (incus-net29-ls-ext)\n port incus-net29-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net29-ls-ext-lsp-router\n type: router\n router-port: incus-net29-lr-lrp-ext\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch add22b21-954d-4230-88ed-ed7ddc8ce166 (incus-net29-ls-int)\n port incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0\n addresses: [\"10:66:6a:35:41:50 dynamic\"]\n port incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0\n addresses: [\"10:66:6a:22:21:09 dynamic\"]\n port incus-net29-ls-int-lsp-router\n type: router\n router-port: incus-net29-lr-lrp-int\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\nrouter 5e56666b-4683-487f-998d-2c15bca854e9 (incus-net29-lr)\n port incus-net29-lr-lrp-int\n mac: \"10:66:6a:ab:ba:f8\"\n ipv6-lla: \"fe80::1266:6aff:feab:baf8\"\n networks: [\"10.253.73.1/24\"]\n port incus-net29-lr-lrp-ext\n mac: \"10:66:6a:ab:ba:f8\"\n ipv6-lla: \"fe80::1266:6aff:feab:baf8\"\n networks: [\"10.10.40.65/24\"]\n nat f360aafe-1386-4c87-a2b0-2eb59d78acac\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net29-lr-lrp-ext\n Port_Binding incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 76fc4bc4-3d4f-4a71-af9a-95320b4b0553\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 6063d379-e039-41f1-b24f-30e534dbf026\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ab:ba:f8\"\nname : incus-net29-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 2d22de67-4c04-44a6-98d8-9e57859f7e4d\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ab:ba:f8\"\nname : incus-net29-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 50de90da-bd27-4b63-bb2d-c92bfc4a3860\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : ebbf3cd7-336c-4e39-97cb-cac765c6c4e7\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f21d4a1a-8cb1-48d3-8590-c11a25e62897\nlogical_port : cr-incus-net29-lr-lrp-ext\nmac : [\"10:66:6a:ab:ba:f8 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net29-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:11.461632+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.365, "exit_code": 0, "stdout": "10.10.40.65 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T06:06:11.827273+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.131, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193162200739\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03690|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193162201069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193163200841\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03692|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193163201182\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193164200711\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03694|dpif|WARN|Dropped 2109 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193164200814\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193164352216\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03696|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789193164352383\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03697|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789193165200742\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03698|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193165200864\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193165692366\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03700|bridge|INFO|bridge br-int: added interface veth5a72f555 on port 24\"\n },\n {\n \"at\": \"1789193166200686\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03701|dpif|WARN|Dropped 1925 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193166200781\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03702|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193167200654\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03703|dpif|WARN|Dropped 1986 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193167200913\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03704|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193167258704\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03705|poll_loop|INFO|Dropped 12284 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193167258752\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03706|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (97% CPU usage)\"\n },\n {\n \"at\": \"1789193168200955\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03707|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193168201157\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03708|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193169200637\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03709|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193169200748\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03710|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193170200615\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03711|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193170200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03712|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193171200732\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03713|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193171200938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03714|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:11.959289+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.112, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193164344334\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00149|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193164344598\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00150|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 15\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:12.072172+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.103, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193164348784\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00161|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193164349087\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00162|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789193166568181\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00163|bridge|INFO|bridge br-int: added interface veth2a53dc0a on port 22\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:12.175157+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.104, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193164336211\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193164336512\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 17\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:12.279745+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-before-probe.txt", "router_mac": "10:66:6a:ab:ba:f8", "at": "2026-09-12T06:06:12.280849+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.125, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:06:05.11191994Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:06:05.773285641Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:06:06.030413125Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:06:06.647108527Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:12.405755+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.65"], "capture": "tcpdump-arp", "pid": 67651, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T06:06:12.591966+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 43.517, "exit_code": 1, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.115 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\nelapsed_seconds=0.113 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"197a3a47-320d-47fc-8aa3-39f31be62f39\",\"volatile.eth0.host_name\":\"veth5a72f555\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:41:50\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\"volatile.uuid.generation\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:06:05.11191994Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"197a3a47-320d-47fc-8aa3-39f31be62f39\",\"volatile.eth0.host_name\":\"veth5a72f555\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:41:50\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\"volatile.uuid.generation\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:06:05.773285641Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9244672,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe35:4150\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:35:41:50\",\"host_name\":\"veth5a72f555\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4074219,\"processes\":4,\"cpu\":{\"usage\":504441000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:06:04.789999961Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"f22e8df0-d751-4187-8d7d-12416228f825\",\"volatile.eth0.host_name\":\"veth2a53dc0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:22:21:09\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"860ef436-0db1-442e-95d5-890d4960dca1\",\"volatile.uuid.generation\":\"860ef436-0db1-442e-95d5-890d4960dca1\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:06:06.030413125Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"f22e8df0-d751-4187-8d7d-12416228f825\",\"volatile.eth0.host_name\":\"veth2a53dc0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:22:21:09\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"860ef436-0db1-442e-95d5-890d4960dca1\",\"volatile.uuid.generation\":\"860ef436-0db1-442e-95d5-890d4960dca1\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:06:06.647108527Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":12267520,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe22:2109\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:22:21:09\",\"host_name\":\"veth2a53dc0a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":15215,\"processes\":4,\"cpu\":{\"usage\":473595000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:06:06.660000085Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.184 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.229 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.238 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.148 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.875 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.332 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.332/0.785/1.148 ms\nelapsed_seconds=2.325 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.181 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.668 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.379 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.379/0.742/1.181 ms\nelapsed_seconds=2.298 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.344 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.374 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.283 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.246 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.278 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.275 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5003 ms: Timeout was reached\nelapsed_seconds=5.037 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.112371 bytes_per_second=889909318\nelapsed_seconds=0.366 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.527 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.139408 bytes_per_second=717318948\nelapsed_seconds=0.901 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.527 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n", "error": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed", "at": "2026-09-12T06:06:56.110606+00:00"} +{"capture": "tcpdump-arp", "pid": 67651, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T06:06:56.112873+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.093, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:56.206462+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.091, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:35:41:50 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:22:21:09 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:56.297811+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.139, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 9cac7f95-f139-429f-a4ce-22e30a7552b7 (incus-net29-ls-ext)\n port incus-net29-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net29-ls-ext-lsp-router\n type: router\n router-port: incus-net29-lr-lrp-ext\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch add22b21-954d-4230-88ed-ed7ddc8ce166 (incus-net29-ls-int)\n port incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0\n addresses: [\"10:66:6a:35:41:50 dynamic\"]\n port incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0\n addresses: [\"10:66:6a:22:21:09 dynamic\"]\n port incus-net29-ls-int-lsp-router\n type: router\n router-port: incus-net29-lr-lrp-int\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\nrouter 5e56666b-4683-487f-998d-2c15bca854e9 (incus-net29-lr)\n port incus-net29-lr-lrp-int\n mac: \"10:66:6a:ab:ba:f8\"\n ipv6-lla: \"fe80::1266:6aff:feab:baf8\"\n networks: [\"10.253.73.1/24\"]\n port incus-net29-lr-lrp-ext\n mac: \"10:66:6a:ab:ba:f8\"\n ipv6-lla: \"fe80::1266:6aff:feab:baf8\"\n networks: [\"10.10.40.65/24\"]\n nat f360aafe-1386-4c87-a2b0-2eb59d78acac\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net29-lr-lrp-ext\n Port_Binding incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 76fc4bc4-3d4f-4a71-af9a-95320b4b0553\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 6063d379-e039-41f1-b24f-30e534dbf026\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ab:ba:f8\"\nname : incus-net29-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 2d22de67-4c04-44a6-98d8-9e57859f7e4d\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ab:ba:f8\"\nname : incus-net29-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 50de90da-bd27-4b63-bb2d-c92bfc4a3860\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : ebbf3cd7-336c-4e39-97cb-cac765c6c4e7\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : f21d4a1a-8cb1-48d3-8590-c11a25e62897\nlogical_port : cr-incus-net29-lr-lrp-ext\nmac : [\"10:66:6a:ab:ba:f8 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net29-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:56.437721+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.308, "exit_code": 0, "stdout": "10.10.40.65 dev br40 FAILED \n", "stderr": "", "error": null, "at": "2026-09-12T06:06:56.746736+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.149, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193162200739\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03690|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193162201069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193163200841\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03692|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193163201182\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193164200711\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03694|dpif|WARN|Dropped 2109 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193164200814\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193164352216\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03696|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789193164352383\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03697|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789193165200742\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03698|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193165200864\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193165692366\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03700|bridge|INFO|bridge br-int: added interface veth5a72f555 on port 24\"\n },\n {\n \"at\": \"1789193166200686\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03701|dpif|WARN|Dropped 1925 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193166200781\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03702|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193167200654\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03703|dpif|WARN|Dropped 1986 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193167200913\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03704|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193167258704\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03705|poll_loop|INFO|Dropped 12284 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193167258752\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03706|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (97% CPU usage)\"\n },\n {\n \"at\": \"1789193168200955\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03707|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193168201157\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03708|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193169200637\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03709|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193169200748\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03710|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193170200615\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03711|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193170200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03712|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193171200732\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03713|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193171200938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03714|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193172200688\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03715|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193172200836\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03716|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193173201032\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03717|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193173201293\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03718|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193173258665\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03719|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193173258771\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03720|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193174200997\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03721|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193174201133\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03722|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193174335855\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03723|connmgr|INFO|br-int<->unix#7: 975 flow_mods in the 6 s starting 10 s ago (884 adds, 91 deletes)\"\n },\n {\n \"at\": \"1789193175200725\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03724|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193175200868\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03725|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193176200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03726|dpif|WARN|Dropped 2073 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193176201222\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03727|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193177201051\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03728|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193177201273\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03729|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193178200742\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03730|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193178200882\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03731|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193179200824\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03732|dpif|WARN|Dropped 1998 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193179201106\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03733|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193179258900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03734|poll_loop|INFO|Dropped 12186 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193179258982\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03735|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193180200879\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03736|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193180201092\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03737|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193181200898\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03738|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193181201151\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03739|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193182201091\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03740|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193182201349\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03741|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193183200814\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03742|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193183200952\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03743|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193184200886\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03744|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193184201127\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03745|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193185200716\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03746|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193185200876\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03747|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193185258828\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03748|poll_loop|INFO|Dropped 12242 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193185259034\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03749|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193186200815\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03750|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193186200928\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03751|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193187200564\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03752|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193187200810\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03753|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193188200897\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03754|dpif|WARN|Dropped 2083 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193188201123\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03755|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193189201018\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03756|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193189201356\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03757|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193190200706\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03758|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193190200824\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03759|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193191200676\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03760|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193191200896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03761|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193191258601\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03762|poll_loop|INFO|Dropped 12380 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193191258653\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03763|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193192200602\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03764|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193192200741\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03765|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193193200742\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03766|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193193200935\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03767|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193194139505\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03768|bridge|WARN|Dropped 124323 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193194139680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03769|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789193194200863\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03770|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193194201034\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03771|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193195200508\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03772|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193195200631\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03773|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193196200551\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03774|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193196200783\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03775|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193197200905\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03776|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193197201103\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03777|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193197258742\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03778|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193197258791\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03779|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193198200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03780|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193198200994\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03781|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193199200819\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03782|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193199200939\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03783|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193200200540\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03784|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193200200754\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03785|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193201200826\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03786|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193201200997\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03787|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193202201006\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03788|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193202201235\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03789|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193203200948\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03790|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193203201080\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03791|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193203259018\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03792|poll_loop|INFO|Dropped 12238 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193203259090\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03793|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193204201107\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03794|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193204201387\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03795|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193205200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03796|dpif|WARN|Dropped 1998 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193205201013\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03797|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193206200787\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03798|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193206200988\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03799|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193207200657\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03800|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193207200782\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03801|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193208201009\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03802|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193208201258\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03803|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193209200555\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03804|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193209200672\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03805|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193209258750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03806|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193209258951\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03807|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193210200871\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03808|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193210201044\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03809|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193211200922\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03810|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193211201154\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03811|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193212200725\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03812|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193212200847\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03813|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193213200903\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03814|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193213201114\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03815|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193214201019\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03816|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193214201232\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03817|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193215200669\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03818|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193215200767\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03819|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193215258753\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03820|poll_loop|INFO|Dropped 12170 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193215258903\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03821|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193216200746\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03822|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193216200876\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|03823|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:56.896545+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.108, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193164344334\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00149|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193164344598\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00150|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 15\"\n },\n {\n \"at\": \"1789193174329936\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00151|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (850 adds, 90 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:57.005667+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.103, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193164348784\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00161|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193164349087\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00162|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 21\"\n },\n {\n \"at\": \"1789193166568181\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00163|bridge|INFO|bridge br-int: added interface veth2a53dc0a on port 22\"\n },\n {\n \"at\": \"1789193174335291\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00164|connmgr|INFO|br-int<->unix#7: 958 flow_mods in the 6 s starting 10 s ago (863 adds, 95 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:57.108746+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A06%3A01.777538%2B00%3A00"], "seconds": 0.1, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193164336211\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193164336512\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 17\"\n },\n {\n \"at\": \"1789193174330408\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00155|connmgr|INFO|br-int<->unix#7: 988 flow_mods in the 6 s starting 10 s ago (874 adds, 114 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:06:57.209452+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-after-probe.txt", "router_mac": "10:66:6a:ab:ba:f8", "at": "2026-09-12T06:06:57.210377+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/create.stdout.json new file mode 100644 index 0000000..bcd3392 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.245, + "first_cross_member_ping_seconds": 3.421, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/cycle.json b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/cycle.json new file mode 100644 index 0000000..2202e99 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/cycle.json @@ -0,0 +1,99 @@ +{ + "ok": false, + "datapath_ok": false, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 1, + "keep_on_failure": true, + "teardown": "retained-for-outage", + "started_at": "2026-09-12T06:06:01.777538+00:00", + "ended_at": "2026-09-12T06:06:57.210522+00:00", + "seconds": 55.432, + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:ab:ba:f8", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.245, + "first_cross_member_ping_seconds": 3.421, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": false, + "exit_code": 1, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.115 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\nelapsed_seconds=0.113 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"197a3a47-320d-47fc-8aa3-39f31be62f39\",\"volatile.eth0.host_name\":\"veth5a72f555\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:41:50\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\"volatile.uuid.generation\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:06:05.11191994Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"197a3a47-320d-47fc-8aa3-39f31be62f39\",\"volatile.eth0.host_name\":\"veth5a72f555\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:41:50\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\"volatile.uuid.generation\":\"dd40a9ad-0757-402f-b311-18b76ff92c7b\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:06:05.773285641Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9244672,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe35:4150\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:35:41:50\",\"host_name\":\"veth5a72f555\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4074219,\"processes\":4,\"cpu\":{\"usage\":504441000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:06:04.789999961Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"f22e8df0-d751-4187-8d7d-12416228f825\",\"volatile.eth0.host_name\":\"veth2a53dc0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:22:21:09\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"860ef436-0db1-442e-95d5-890d4960dca1\",\"volatile.uuid.generation\":\"860ef436-0db1-442e-95d5-890d4960dca1\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:06:06.030413125Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"f22e8df0-d751-4187-8d7d-12416228f825\",\"volatile.eth0.host_name\":\"veth2a53dc0a\",\"volatile.eth0.hwaddr\":\"10:66:6a:22:21:09\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"860ef436-0db1-442e-95d5-890d4960dca1\",\"volatile.uuid.generation\":\"860ef436-0db1-442e-95d5-890d4960dca1\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:06:06.647108527Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":12267520,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe22:2109\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:22:21:09\",\"host_name\":\"veth2a53dc0a\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":15215,\"processes\":4,\"cpu\":{\"usage\":473595000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:06:06.660000085Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.184 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.229 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.238 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.148 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.875 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.332 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.332/0.785/1.148 ms\nelapsed_seconds=2.325 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.181 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.668 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.379 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.379/0.742/1.181 ms\nelapsed_seconds=2.298 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.344 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 0 packets received, 100% packet loss\nelapsed_seconds=4.374 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.283 exit=1\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\n;; connection timed out; no servers could be reached\n\nelapsed_seconds=5.246 exit=1\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.278 exit=28\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\ncurl: (28) Resolving timed out after 5002 milliseconds\nelapsed_seconds=5.275 exit=28\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\ncurl: (28) Failed to connect to 10.10.40.79 port 8080 after 5003 ms: Timeout was reached\nelapsed_seconds=5.037 exit=28\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.112371 bytes_per_second=889909318\nelapsed_seconds=0.366 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.527 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.139408 bytes_per_second=717318948\nelapsed_seconds=0.901 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.527 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\n", + "stderr": "probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed\n" + }, + "fallback_checks": null, + "destroy": null, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 67193, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.log", + "bytes": 174878, + "ready_signal": "time=\"2026-09-11T23:06:02-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:06:02.415496+00:00", + "stopped_at": "2026-09-12T06:06:11.095384+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 67651, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture/tcpdump-arp.log", + "bytes": 480, + "ready_signal": "listening on", + "started_at": "2026-09-12T06:06:12.406371+00:00", + "stopped_at": "2026-09-12T06:06:56.112762+00:00" + } + ], + "failures": { + "checks": [ + "probe: probe: gateway ping one -> 10.10.40.1 failed\nprobe: gateway ping two -> 10.10.40.1 failed\nprobe: dns lookup example.com from one via 10.10.40.1 failed\nprobe: dns lookup example.com from two via 10.10.40.1 failed\nprobe: internet egress curl from one failed\nprobe: internet egress curl from two failed\nprobe: workstation curl of forward-url failed\nprobe: 7 datapath checks failed" + ], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage-fixture" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-after-probe.txt new file mode 100644 index 0000000..6ef9128 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-after-probe.txt @@ -0,0 +1,1108 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:35:41:50 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:22:21:09 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 9cac7f95-f139-429f-a4ce-22e30a7552b7 (incus-net29-ls-ext) + port incus-net29-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net29-ls-ext-lsp-router + type: router + router-port: incus-net29-lr-lrp-ext +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch add22b21-954d-4230-88ed-ed7ddc8ce166 (incus-net29-ls-int) + port incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0 + addresses: ["10:66:6a:35:41:50 dynamic"] + port incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0 + addresses: ["10:66:6a:22:21:09 dynamic"] + port incus-net29-ls-int-lsp-router + type: router + router-port: incus-net29-lr-lrp-int +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +router 5e56666b-4683-487f-998d-2c15bca854e9 (incus-net29-lr) + port incus-net29-lr-lrp-int + mac: "10:66:6a:ab:ba:f8" + ipv6-lla: "fe80::1266:6aff:feab:baf8" + networks: ["10.253.73.1/24"] + port incus-net29-lr-lrp-ext + mac: "10:66:6a:ab:ba:f8" + ipv6-lla: "fe80::1266:6aff:feab:baf8" + networks: ["10.10.40.65/24"] + nat f360aafe-1386-4c87-a2b0-2eb59d78acac + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net29-lr-lrp-ext + Port_Binding incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 76fc4bc4-3d4f-4a71-af9a-95320b4b0553 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 6063d379-e039-41f1-b24f-30e534dbf026 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ab:ba:f8" +name : incus-net29-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 2d22de67-4c04-44a6-98d8-9e57859f7e4d +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ab:ba:f8" +name : incus-net29-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 50de90da-bd27-4b63-bb2d-c92bfc4a3860 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : ebbf3cd7-336c-4e39-97cb-cac765c6c4e7 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f21d4a1a-8cb1-48d3-8590-c11a25e62897 +logical_port : cr-incus-net29-lr-lrp-ext +mac : ["10:66:6a:ab:ba:f8 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net29-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193162200739", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03690|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193162201069", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193163200841", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03692|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193163201182", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193164200711", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03694|dpif|WARN|Dropped 2109 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193164200814", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193164352216", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03696|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789193164352383", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03697|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789193165200742", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03698|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193165200864", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193165692366", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03700|bridge|INFO|bridge br-int: added interface veth5a72f555 on port 24" + }, + { + "at": "1789193166200686", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03701|dpif|WARN|Dropped 1925 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193166200781", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03702|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193167200654", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03703|dpif|WARN|Dropped 1986 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193167200913", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03704|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193167258704", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03705|poll_loop|INFO|Dropped 12284 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193167258752", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03706|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (97% CPU usage)" + }, + { + "at": "1789193168200955", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03707|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193168201157", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03708|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193169200637", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03709|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193169200748", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03710|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193170200615", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03711|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193170200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03712|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193171200732", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03713|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193171200938", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03714|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193172200688", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03715|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193172200836", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03716|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193173201032", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03717|dpif|WARN|Dropped 2057 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193173201293", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03718|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193173258665", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03719|poll_loop|INFO|Dropped 12143 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193173258771", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03720|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193174200997", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03721|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193174201133", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03722|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193174335855", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03723|connmgr|INFO|br-int<->unix#7: 975 flow_mods in the 6 s starting 10 s ago (884 adds, 91 deletes)" + }, + { + "at": "1789193175200725", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03724|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193175200868", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03725|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193176200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03726|dpif|WARN|Dropped 2073 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193176201222", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03727|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193177201051", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03728|dpif|WARN|Dropped 2029 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193177201273", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03729|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193178200742", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03730|dpif|WARN|Dropped 2032 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193178200882", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03731|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193179200824", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03732|dpif|WARN|Dropped 1998 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193179201106", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03733|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193179258900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03734|poll_loop|INFO|Dropped 12186 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193179258982", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03735|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193180200879", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03736|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193180201092", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03737|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193181200898", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03738|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193181201151", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03739|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193182201091", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03740|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193182201349", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03741|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193183200814", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03742|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193183200952", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03743|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193184200886", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03744|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193184201127", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03745|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193185200716", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03746|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193185200876", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03747|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193185258828", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03748|poll_loop|INFO|Dropped 12242 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193185259034", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03749|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193186200815", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03750|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193186200928", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03751|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193187200564", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03752|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193187200810", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03753|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193188200897", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03754|dpif|WARN|Dropped 2083 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193188201123", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03755|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193189201018", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03756|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193189201356", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03757|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193190200706", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03758|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193190200824", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03759|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193191200676", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03760|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193191200896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03761|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193191258601", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03762|poll_loop|INFO|Dropped 12380 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193191258653", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03763|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193192200602", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03764|dpif|WARN|Dropped 2050 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193192200741", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03765|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193193200742", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03766|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193193200935", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03767|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193194139505", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03768|bridge|WARN|Dropped 124323 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193194139680", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03769|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789193194200863", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03770|dpif|WARN|Dropped 2035 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193194201034", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03771|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193195200508", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03772|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193195200631", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03773|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193196200551", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03774|dpif|WARN|Dropped 2059 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193196200783", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03775|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193197200905", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03776|dpif|WARN|Dropped 2067 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193197201103", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03777|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193197258742", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03778|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193197258791", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03779|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193198200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03780|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193198200994", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03781|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193199200819", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03782|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193199200939", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03783|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193200200540", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03784|dpif|WARN|Dropped 2078 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193200200754", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03785|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193201200826", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03786|dpif|WARN|Dropped 2039 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193201200997", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03787|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193202201006", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03788|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193202201235", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03789|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193203200948", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03790|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193203201080", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03791|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193203259018", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03792|poll_loop|INFO|Dropped 12238 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193203259090", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03793|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193204201107", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03794|dpif|WARN|Dropped 2041 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193204201387", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03795|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193205200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03796|dpif|WARN|Dropped 1998 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193205201013", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03797|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193206200787", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03798|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193206200988", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03799|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193207200657", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03800|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193207200782", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03801|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193208201009", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03802|dpif|WARN|Dropped 2086 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193208201258", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03803|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193209200555", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03804|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193209200672", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03805|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193209258750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03806|poll_loop|INFO|Dropped 12275 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193209258951", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03807|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193210200871", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03808|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193210201044", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03809|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193211200922", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03810|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193211201154", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03811|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193212200725", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03812|dpif|WARN|Dropped 2062 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193212200847", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03813|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193213200903", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03814|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193213201114", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03815|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193214201019", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03816|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193214201232", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03817|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193215200669", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03818|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193215200767", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03819|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193215258753", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03820|poll_loop|INFO|Dropped 12170 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193215258903", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03821|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193216200746", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03822|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193216200876", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03823|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193164344334", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00149|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193164344598", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00150|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 15" + }, + { + "at": "1789193174329936", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00151|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (850 adds, 90 deletes)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193164348784", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00161|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193164349087", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00162|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789193166568181", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00163|bridge|INFO|bridge br-int: added interface veth2a53dc0a on port 22" + }, + { + "at": "1789193174335291", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00164|connmgr|INFO|br-int<->unix#7: 958 flow_mods in the 6 s starting 10 s ago (863 adds, 95 deletes)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193164336211", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193164336512", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 17" + }, + { + "at": "1789193174330408", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00155|connmgr|INFO|br-int<->unix#7: 988 flow_mods in the 6 s starting 10 s ago (874 adds, 114 deletes)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-before-probe.txt new file mode 100644 index 0000000..95c69f8 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/diagnostics-before-probe.txt @@ -0,0 +1,436 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:35:41:50 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:22:21:09 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 9cac7f95-f139-429f-a4ce-22e30a7552b7 (incus-net29-ls-ext) + port incus-net29-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net29-ls-ext-lsp-router + type: router + router-port: incus-net29-lr-lrp-ext +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch add22b21-954d-4230-88ed-ed7ddc8ce166 (incus-net29-ls-int) + port incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0 + addresses: ["10:66:6a:35:41:50 dynamic"] + port incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0 + addresses: ["10:66:6a:22:21:09 dynamic"] + port incus-net29-ls-int-lsp-router + type: router + router-port: incus-net29-lr-lrp-int +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +router 5e56666b-4683-487f-998d-2c15bca854e9 (incus-net29-lr) + port incus-net29-lr-lrp-int + mac: "10:66:6a:ab:ba:f8" + ipv6-lla: "fe80::1266:6aff:feab:baf8" + networks: ["10.253.73.1/24"] + port incus-net29-lr-lrp-ext + mac: "10:66:6a:ab:ba:f8" + ipv6-lla: "fe80::1266:6aff:feab:baf8" + networks: ["10.10.40.65/24"] + nat f360aafe-1386-4c87-a2b0-2eb59d78acac + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net29-instance-860ef436-0db1-442e-95d5-890d4960dca1-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net29-lr-lrp-ext + Port_Binding incus-net29-instance-dd40a9ad-0757-402f-b311-18b76ff92c7b-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 76fc4bc4-3d4f-4a71-af9a-95320b4b0553 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 6063d379-e039-41f1-b24f-30e534dbf026 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ab:ba:f8" +name : incus-net29-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 2d22de67-4c04-44a6-98d8-9e57859f7e4d +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ab:ba:f8" +name : incus-net29-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 50de90da-bd27-4b63-bb2d-c92bfc4a3860 +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : ebbf3cd7-336c-4e39-97cb-cac765c6c4e7 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : f21d4a1a-8cb1-48d3-8590-c11a25e62897 +logical_port : cr-incus-net29-lr-lrp-ext +mac : ["10:66:6a:ab:ba:f8 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net29-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 FAILED +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193162200739", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03690|dpif|WARN|Dropped 2070 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193162201069", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03691|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193163200841", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03692|dpif|WARN|Dropped 2091 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193163201182", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03693|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193164200711", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03694|dpif|WARN|Dropped 2109 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193164200814", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03695|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193164352216", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03696|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789193164352383", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03697|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789193165200742", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03698|dpif|WARN|Dropped 2065 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193165200864", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03699|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193165692366", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03700|bridge|INFO|bridge br-int: added interface veth5a72f555 on port 24" + }, + { + "at": "1789193166200686", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03701|dpif|WARN|Dropped 1925 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193166200781", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03702|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193167200654", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03703|dpif|WARN|Dropped 1986 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193167200913", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03704|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193167258704", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03705|poll_loop|INFO|Dropped 12284 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193167258752", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03706|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (97% CPU usage)" + }, + { + "at": "1789193168200955", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03707|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193168201157", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03708|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193169200637", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03709|dpif|WARN|Dropped 2038 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193169200748", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03710|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193170200615", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03711|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193170200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03712|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193171200732", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03713|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193171200938", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|03714|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193164344334", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00149|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193164344598", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00150|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 15" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193164348784", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00161|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193164349087", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00162|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 21" + }, + { + "at": "1789193166568181", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00163|bridge|INFO|bridge br-int: added interface veth2a53dc0a on port 22" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193164336211", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00153|bridge|INFO|bridge incusovn16: added interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193164336512", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00154|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 17" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.debug.log new file mode 100644 index 0000000..2782786 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:06:02-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.log new file mode 100644 index 0000000..a3dfbce --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/monitor-create.log @@ -0,0 +1,536 @@ +time="2026-09-12T06:06:02Z" level=debug msg="[nas01] Event listener server handler started" id=fb1063aa-9bd5-4361-87ea-6e00df0161a0 local="10.10.10.14:8443" remote="100.122.142.76:62982" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63000" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63001" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63002" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:03Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63003" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63004" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63005" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63006" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63007" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63008" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63009" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:ab:ba:f8" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.29 +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net29 driver=ovn memberID=1 network=default priority=4166 project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63010" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63011" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63012" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63013" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63014" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63015" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63016" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63017" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63018" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Event listener server handler started" id=36ed429b-576c-4bec-a699-ce29e6ef7200 local="10.10.10.14:8443" remote="100.122.142.76:63018" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63019" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=90e8e73a-c849-4d27-ba40-2bc06c178b4f project=image-build +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=90e8e73a-c849-4d27-ba40-2bc06c178b4f project=image-build +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63020" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Event listener server handler started" id=2ed5f092-cf01-4143-a000-895f5097dbfa local="10.10.10.14:8443" remote="100.122.142.76:63020" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63021" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=57b13771-e1e4-48e5-b8c9-8ddd11f529b0 project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=57b13771-e1e4-48e5-b8c9-8ddd11f529b0 project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63022" method=GET protocol=tls url="/1.0/operations/57b13771-e1e4-48e5-b8c9-8ddd11f529b0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=57b13771-e1e4-48e5-b8c9-8ddd11f529b0 project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=57b13771-e1e4-48e5-b8c9-8ddd11f529b0 project=ac-ovn-spike +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=36ed429b-576c-4bec-a699-ce29e6ef7200 local="10.10.10.14:8443" remote="100.122.142.76:63018" +time="2026-09-12T06:06:04Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2ed5f092-cf01-4143-a000-895f5097dbfa local="10.10.10.14:8443" remote="100.122.142.76:63020" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63023" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63024" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"7a55aa64-b25a-400d-8a51-bbbccc3f5078\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:06:05.036788815Z\",\n\t\t\"updated_at\": \"2026-09-12T06:06:05.036788815Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T06:06:05Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63025" method=GET protocol=tls url="/1.0/operations/7a55aa64-b25a-400d-8a51-bbbccc3f5078/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63026" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63027" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63028" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Event listener server handler started" id=8fbb8d45-f888-4689-9e91-d0e8542a99ab local="10.10.10.14:8443" remote="100.122.142.76:63028" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63029" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:05Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 06:06:05.11191994 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63030" method=GET protocol=tls url="/1.0/operations/d35cc8f8-70e4-4bf3-86a0-0a0cb72fc9a6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 06:06:05.11191994 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8fbb8d45-f888-4689-9e91-d0e8542a99ab local="10.10.10.14:8443" remote="100.122.142.76:63028" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63031" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63032" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:06:05Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"802a591c-6416-4134-a010-f67480baf8e5\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:06:05.982921405Z\",\n\t\t\"updated_at\": \"2026-09-12T06:06:05.982921405Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63033" method=GET protocol=tls url="/1.0/operations/802a591c-6416-4134-a010-f67480baf8e5/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:06Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:06:06Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63034" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63035" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63036" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Event listener server handler started" id=02d1ae1c-4d72-4ccb-9a43-11c56a61a013 local="10.10.10.14:8443" remote="100.122.142.76:63036" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63037" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 06:06:06.030413125 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63038" method=GET protocol=tls url="/1.0/operations/b4b46173-b62d-47e3-985d-83c7e8c3dcdc?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:06:06Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 06:06:06.030413125 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Event listener server handler stopped" listener=02d1ae1c-4d72-4ccb-9a43-11c56a61a013 local="10.10.10.14:8443" remote="100.122.142.76:63036" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63039" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63040" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:06Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63041" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63042" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63043" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63044" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63045" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63046" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63047" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63048" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Event listener server handler started" id=9eb911d3-2bed-48db-95e4-31de6a6dc43d local="10.10.10.14:8443" remote="100.122.142.76:63048" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63049" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63050" method=GET protocol=tls url="/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=793fb2c291f67fa950c576258390dc980a032c90b538001a8a8ec5015d703861" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=793fb2c291f67fa950c576258390dc980a032c90b538001a8a8ec5015d703861" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63050" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63051" method=GET protocol=tls url="/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=1ca6c85273192ea2a9dc32cec4457eb302afb530bce83c489cc9579b0593f81d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63051" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=1ca6c85273192ea2a9dc32cec4457eb302afb530bce83c489cc9579b0593f81d" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63052" method=GET protocol=tls url="/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=abb1a64b4ad15046b2fe72b5b540cde804fef3d4f3874e9832a14f5bd53f97cc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=abb1a64b4ad15046b2fe72b5b540cde804fef3d4f3874e9832a14f5bd53f97cc" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63052" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63053" method=GET protocol=tls url="/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=13eb590a11aff6c80b0bd3e2b591ac0eedc95b98296f22d767e3e933ad7ccc17" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35/websocket?secret=13eb590a11aff6c80b0bd3e2b591ac0eedc95b98296f22d767e3e933ad7ccc17" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63053" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63051" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63054" method=GET protocol=tls url="/1.0/operations/32507d42-5c21-41c4-ba38-19c238afce35?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63050" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63053" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63052" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Event listener server handler stopped" listener=9eb911d3-2bed-48db-95e4-31de6a6dc43d local="10.10.10.14:8443" remote="100.122.142.76:63048" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63055" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63056" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:07Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63057" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63058" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Event listener server handler started" id=06d6de59-04c8-415c-a27e-b261cdf88d0b local="10.10.10.14:8443" remote="100.122.142.76:63058" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63059" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63060" method=GET protocol=tls url="/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=74e6c6589a477e37bc2d53c335eb8222d0b33203350a9655b744d4023634ba74" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=74e6c6589a477e37bc2d53c335eb8222d0b33203350a9655b744d4023634ba74" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63060" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63061" method=GET protocol=tls url="/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=5c4de93231e41d2ce91aefb448602167819857603686fb05d46d94ec0671eab8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=5c4de93231e41d2ce91aefb448602167819857603686fb05d46d94ec0671eab8" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63061" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63062" method=GET protocol=tls url="/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=2d82ecd61e08353d1b777957d3f19ffd38a7805f9a2ddca5ea8c39d942927520" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=2d82ecd61e08353d1b777957d3f19ffd38a7805f9a2ddca5ea8c39d942927520" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63062" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63063" method=GET protocol=tls url="/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=b9ce08f010897ba21361fa0dc0739d5c99f40927848ba41f7998ddc4770206fe" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a/websocket?secret=b9ce08f010897ba21361fa0dc0739d5c99f40927848ba41f7998ddc4770206fe" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63063" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63061" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63064" method=GET protocol=tls url="/1.0/operations/7d950fa8-825d-4867-a694-d1427304364a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63062" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63060" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63063" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Event listener server handler stopped" listener=06d6de59-04c8-415c-a27e-b261cdf88d0b local="10.10.10.14:8443" remote="100.122.142.76:63058" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63065" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63066" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Event listener server handler started" id=6d4fad88-d71c-4ead-a410-225f479cb610 local="10.10.10.14:8443" remote="100.122.142.76:63066" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63067" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63068" method=GET protocol=tls url="/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=9a311035408c1b6b469dbe5dd30143b4ad90a2c7d82bc307c9a7169a235d32d3" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63068" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=9a311035408c1b6b469dbe5dd30143b4ad90a2c7d82bc307c9a7169a235d32d3" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63069" method=GET protocol=tls url="/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=7a23945feae0dbc855e0e9c7bd1d7a7308b7feb3cfddd54b6418afb1048b5ce3" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63069" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=7a23945feae0dbc855e0e9c7bd1d7a7308b7feb3cfddd54b6418afb1048b5ce3" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63070" method=GET protocol=tls url="/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=20c5e8326f78e106bb0f0e04dd79013650a835588c2fbaa6155dbfed56e4f742" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63070" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=20c5e8326f78e106bb0f0e04dd79013650a835588c2fbaa6155dbfed56e4f742" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63071" method=GET protocol=tls url="/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=7fe1a0f8d5b8635a12b4ea95186972befb4938b55b042755e46ace9b3aa4b203" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8/websocket?secret=7fe1a0f8d5b8635a12b4ea95186972befb4938b55b042755e46ace9b3aa4b203" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63071" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63069" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63072" method=GET protocol=tls url="/1.0/operations/0c0a261a-dcec-47f3-bfbd-b7b548fcc2d8?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63068" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63071" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63070" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Event listener server handler stopped" listener=6d4fad88-d71c-4ead-a410-225f479cb610 local="10.10.10.14:8443" remote="100.122.142.76:63066" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63073" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63074" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:08Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63075" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63076" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Event listener server handler started" id=8dd89c5b-9c26-4f2f-9a87-6205c4804287 local="10.10.10.14:8443" remote="100.122.142.76:63076" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63077" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63078" method=GET protocol=tls url="/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=a2915def2d36e3a6eb1770652890f28b347b3c6b3c249e351c5c556f750422d2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=a2915def2d36e3a6eb1770652890f28b347b3c6b3c249e351c5c556f750422d2" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63078" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63079" method=GET protocol=tls url="/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=49090a6e86c6abe7a6b6f36be6c0f49f10aa4f605906cdb724e8978b698af5c8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=49090a6e86c6abe7a6b6f36be6c0f49f10aa4f605906cdb724e8978b698af5c8" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63079" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63080" method=GET protocol=tls url="/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=c62abc777a560ee448c4cacb0cd9b03b05ecfba1fac8538ba20e0c05bc8bb940" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=c62abc777a560ee448c4cacb0cd9b03b05ecfba1fac8538ba20e0c05bc8bb940" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63080" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63081" method=GET protocol=tls url="/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=6950a9d9cadd8d970ecf63f9fc28a639bda8bbdfe3b6ebc87ef4c6eabfdd4b63" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5/websocket?secret=6950a9d9cadd8d970ecf63f9fc28a639bda8bbdfe3b6ebc87ef4c6eabfdd4b63" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63081" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63079" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63082" method=GET protocol=tls url="/1.0/operations/13611979-64df-4d07-93e5-976a3e999bf5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63078" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63081" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63080" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8dd89c5b-9c26-4f2f-9a87-6205c4804287 local="10.10.10.14:8443" remote="100.122.142.76:63076" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63083" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63084" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Event listener server handler started" id=2b0806c3-82dc-4f8e-989b-b92931e3cc18 local="10.10.10.14:8443" remote="100.122.142.76:63084" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63085" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63086" method=GET protocol=tls url="/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=babc462524c5702851b0de6f38eae4b2e9bbe56335839e6644cf693b68a34265" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63086" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=babc462524c5702851b0de6f38eae4b2e9bbe56335839e6644cf693b68a34265" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63087" method=GET protocol=tls url="/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=b1cb1e3be878cb5627ddcf5bac2a20877718ed4356d78bd6e3a8776465d152fc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63087" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=b1cb1e3be878cb5627ddcf5bac2a20877718ed4356d78bd6e3a8776465d152fc" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63088" method=GET protocol=tls url="/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=d2950ac3dd17fc439149360e365201a8722caa584cc4745f45994f45b155250c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63088" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=d2950ac3dd17fc439149360e365201a8722caa584cc4745f45994f45b155250c" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63089" method=GET protocol=tls url="/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=71ddea4f3d5f557f9cffc275d345be7512664380059ea9f88220354d8751f17a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63089" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88/websocket?secret=71ddea4f3d5f557f9cffc275d345be7512664380059ea9f88220354d8751f17a" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63087" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63090" method=GET protocol=tls url="/1.0/operations/82f73a2a-2766-43e1-b2e0-8f09270fab88?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63086" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63089" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63088" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2b0806c3-82dc-4f8e-989b-b92931e3cc18 local="10.10.10.14:8443" remote="100.122.142.76:63084" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63091" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63092" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Event listener server handler started" id=d7ecf986-0153-4ae6-a514-f087eef8fde8 local="10.10.10.14:8443" remote="100.122.142.76:63092" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63093" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63094" method=GET protocol=tls url="/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=2f8fd34b101f5f6236eaa010576dc7a27f8975a762cc440064623df2cb98ecf4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=2f8fd34b101f5f6236eaa010576dc7a27f8975a762cc440064623df2cb98ecf4" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63094" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63095" method=GET protocol=tls url="/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=d9a473cdb51626cd2a701e6e8c6ad52deaff4af7a6c50134c3ae53e1e792a001" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63095" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=d9a473cdb51626cd2a701e6e8c6ad52deaff4af7a6c50134c3ae53e1e792a001" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63096" method=GET protocol=tls url="/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=10488392d04580cfd0c338b980e7482eeb54b4160abb72ee738707833ca59535" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63096" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=10488392d04580cfd0c338b980e7482eeb54b4160abb72ee738707833ca59535" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63097" method=GET protocol=tls url="/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=7521f3a66744122e6627e18fbfb5cb7d2a79fc5a1323b99174345ec2e25e797e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63097" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22/websocket?secret=7521f3a66744122e6627e18fbfb5cb7d2a79fc5a1323b99174345ec2e25e797e" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63095" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63098" method=GET protocol=tls url="/1.0/operations/d08a7eb1-a721-4358-947c-987abfbbce22?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:09Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63094" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63096" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63097" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d7ecf986-0153-4ae6-a514-f087eef8fde8 local="10.10.10.14:8443" remote="100.122.142.76:63092" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63099" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63100" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Event listener server handler started" id=19757ae4-17e0-47b7-ae3b-eb51096a3f55 local="10.10.10.14:8443" remote="100.122.142.76:63100" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63101" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63102" method=GET protocol=tls url="/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=9fbbbdfe8e620f7b6000cb0011369a6aa709faf4b4c14f0088241a52df834ec6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=9fbbbdfe8e620f7b6000cb0011369a6aa709faf4b4c14f0088241a52df834ec6" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63102" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63103" method=GET protocol=tls url="/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=df9623ca66c963c4f6341b1dd0d2c8713a56b6592d192e9c3f4c98f24dc7bf01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63103" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=df9623ca66c963c4f6341b1dd0d2c8713a56b6592d192e9c3f4c98f24dc7bf01" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63104" method=GET protocol=tls url="/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=d6701075f03deb486aefb161e2274622b7cc944d34e091b516e32c61351b399f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63104" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=d6701075f03deb486aefb161e2274622b7cc944d34e091b516e32c61351b399f" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63105" method=GET protocol=tls url="/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=0b766924d0446a50b7c9e3a1121f55f0901507b37edd5b220660a87c0a6ec422" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63105" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4/websocket?secret=0b766924d0446a50b7c9e3a1121f55f0901507b37edd5b220660a87c0a6ec422" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63103" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63106" method=GET protocol=tls url="/1.0/operations/3ddcdc10-0cf6-47d7-977f-3641278c9ed4?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63102" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63105" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63104" +time="2026-09-12T06:06:10Z" level=debug msg="[nas01] Event listener server handler stopped" listener=19757ae4-17e0-47b7-ae3b-eb51096a3f55 local="10.10.10.14:8443" remote="100.122.142.76:63100" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63107" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63108" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:06:11Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/probe.stderr.txt new file mode 100644 index 0000000..2041e75 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/probe.stderr.txt @@ -0,0 +1,8 @@ +probe: gateway ping one -> 10.10.40.1 failed +probe: gateway ping two -> 10.10.40.1 failed +probe: dns lookup example.com from one via 10.10.40.1 failed +probe: dns lookup example.com from two via 10.10.40.1 failed +probe: internet egress curl from one failed +probe: internet egress curl from two failed +probe: workstation curl of forward-url failed +probe: 7 datapath checks failed diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/probe.stdout.txt new file mode 100644 index 0000000..cb14fbb --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/probe.stdout.txt @@ -0,0 +1,107 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.115 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab02 + - lab03 + - nas01 + - lab01 +project: ac-ovn-spike +elapsed_seconds=0.113 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"197a3a47-320d-47fc-8aa3-39f31be62f39","volatile.eth0.host_name":"veth5a72f555","volatile.eth0.hwaddr":"10:66:6a:35:41:50","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"dd40a9ad-0757-402f-b311-18b76ff92c7b","volatile.uuid.generation":"dd40a9ad-0757-402f-b311-18b76ff92c7b"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:06:05.11191994Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"197a3a47-320d-47fc-8aa3-39f31be62f39","volatile.eth0.host_name":"veth5a72f555","volatile.eth0.hwaddr":"10:66:6a:35:41:50","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"dd40a9ad-0757-402f-b311-18b76ff92c7b","volatile.uuid.generation":"dd40a9ad-0757-402f-b311-18b76ff92c7b"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:06:05.773285641Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9244672,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe35:4150","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:35:41:50","host_name":"veth5a72f555","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4074219,"processes":4,"cpu":{"usage":504441000,"allocated_time":24000000000},"started_at":"2026-09-12T06:06:04.789999961Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"f22e8df0-d751-4187-8d7d-12416228f825","volatile.eth0.host_name":"veth2a53dc0a","volatile.eth0.hwaddr":"10:66:6a:22:21:09","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"860ef436-0db1-442e-95d5-890d4960dca1","volatile.uuid.generation":"860ef436-0db1-442e-95d5-890d4960dca1"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:06:06.030413125Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"f22e8df0-d751-4187-8d7d-12416228f825","volatile.eth0.host_name":"veth2a53dc0a","volatile.eth0.hwaddr":"10:66:6a:22:21:09","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"860ef436-0db1-442e-95d5-890d4960dca1","volatile.uuid.generation":"860ef436-0db1-442e-95d5-890d4960dca1"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:06:06.647108527Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":12267520,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe22:2109","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:22:21:09","host_name":"veth2a53dc0a","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":15215,"processes":4,"cpu":{"usage":473595000,"allocated_time":24000000000},"started_at":"2026-09-12T06:06:06.660000085Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.184 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.229 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.238 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.148 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.875 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.332 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.332/0.785/1.148 ms +elapsed_seconds=2.325 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.181 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=0.668 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.379 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.379/0.742/1.181 ms +elapsed_seconds=2.298 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.344 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 0 packets received, 100% packet loss +elapsed_seconds=4.374 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.283 exit=1 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +;; connection timed out; no servers could be reached + +elapsed_seconds=5.246 exit=1 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5002 milliseconds +elapsed_seconds=5.278 exit=28 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +curl: (28) Resolving timed out after 5002 milliseconds +elapsed_seconds=5.275 exit=28 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +curl: (28) Failed to connect to 10.10.40.79 port 8080 after 5003 ms: Timeout was reached +elapsed_seconds=5.037 exit=28 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.112371 bytes_per_second=889909318 +elapsed_seconds=0.366 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.527 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.139408 bytes_per_second=717318948 +elapsed_seconds=0.901 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.527 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/tcpdump-arp.log new file mode 100644 index 0000000..4048e6e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +06:06:13.367682 12:b7:ee:17:05:f4 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.65 tell 10.10.40.1, length 46 +06:06:14.391595 12:b7:ee:17:05:f4 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.65 tell 10.10.40.1, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/outage-fixture/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/topology.jsonl new file mode 100644 index 0000000..6d6fa38 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage-fixture/topology.jsonl @@ -0,0 +1,27 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.112, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.127, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/keeper\"\n\t]\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.102, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.138, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.245, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.114, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.104, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.287, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.48, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:06:05.036788815Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"7a55aa64-b25a-400d-8a51-bbbccc3f5078\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:06:05.036788815Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.459, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.455, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:06:05.982921405Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"802a591c-6416-4134-a010-f67480baf8e5\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:06:05.982921405Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.402, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.216, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 158931000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 6782976,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe35:4150\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"veth5a72f555\",\n\t\t\t\"hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4074219,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:06:04.789999961Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.233, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 124069000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6569984,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe22:2109\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 860,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 4\n\t\t\t},\n\t\t\t\"host_name\": \"veth2a53dc0a\",\n\t\t\t\"hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 15215,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:06:06.660000085Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.116, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t},\n\t\"created_at\": \"2026-09-12T06:06:05.11191994Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:06:05.773285641Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.119, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t},\n\t\"created_at\": \"2026-09-12T06:06:06.030413125Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:06:06.647108527Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.432, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.511 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.511/1.511/1.511 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.345, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.189, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.332, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.363, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-mxxaa9u0/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.215, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.355, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.633, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.028188 seconds, 3.3GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.662, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.025547 seconds, 3.6GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.179, "stdout": "", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/outage/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/outage/commands.jsonl new file mode 100644 index 0000000..d42d321 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage/commands.jsonl @@ -0,0 +1,24 @@ +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-outage", "pid": 79943, "ready": true, "ready_signal": "time=\"2026-09-11T23:09:47-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:09:47.294556+00:00"} +{"command": ["incus", "query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1"], "seconds": 0.109, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\",\n\t\t\t\"lab01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\",\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:09:47.404067+00:00"} +{"central_state": "stopped", "via": "fleet ovn_central.py", "at": "2026-09-12T06:09:47.404406+00:00"} +{"command": ["uv", "run", "--locked", "pyinfra", "sandbox01", "--user", "josh", "--sudo", "src/fleet_cluster/deploys/ovn_central.py", "-v", "--yes"], "seconds": 1.898, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [sandbox01] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_central.py\n [sandbox01] Loaded fact server.Hostname\n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] Ready: src/fleet_cluster/deploys/ovn_central.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Record central spike ownership \n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact files.Directory (path=/var/lib)\n [sandbox01] Loaded fact files.Sha1File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] noop: file /var/lib/fleet-ovn-spike is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Install temporary OVN central without recommends \n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] noop: package ovn-central is installed (26.03.0-2)\n [sandbox01] No changes\n\n--> Starting operation: Bind temporary NB and SB databases to VLAN 40 only \n [sandbox01] Loaded fact files.File (path=/etc/default/ovn-central)\n [sandbox01] Loaded fact files.Directory (path=/etc/default)\n [sandbox01] Loaded fact files.Sha1File (path=/etc/default/ovn-central)\n [sandbox01] noop: file /etc/default/ovn-central is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Ensure temporary central is stopped \n [sandbox01] Loaded fact systemd.SystemdStatus (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Loaded fact systemd.SystemdEnabled (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Success\n\n--> Results:\n Operation Hosts Success Error No Change \n Record central spike ownership 1 - - 1 \n Install temporary OVN central without recommends 1 - - 1 \n Bind temporary NB and SB databases to VLAN 40 only 1 - - 1 \n Ensure temporary central is stopped 1 1 - - \n Grand total 4 1 - 3 \n\n--> Disconnecting from hosts...\n", "error": null, "at": "2026-09-12T06:09:49.302337+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n systemctl is-active ovn-central ovn-northd ovn-ovsdb-server-nb ovn-ovsdb-server-sb"], "seconds": 0.106, "exit_code": 3, "stdout": "inactive\ndeactivating\ninactive\ndeactivating\n", "stderr": "", "error": "inactive\ndeactivating\ninactive\ndeactivating", "at": "2026-09-12T06:09:49.408866+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage/topology.jsonl", "create-network"], "seconds": 60.428, "exit_code": 1, "stdout": "{\n \"network\": \"recovery\",\n \"subnet\": \"10.253.74.1/24\",\n \"created\": false,\n \"code\": 124,\n \"timeout_seconds\": 60,\n \"seconds\": 60.019,\n \"stdout\": \"\",\n \"stderr\": \"\",\n \"error\": \"exit 124\"\n}\n", "stderr": "", "error": "{\n \"network\": \"recovery\",\n \"subnet\": \"10.253.74.1/24\",\n \"created\": false,\n \"code\": 124,\n \"timeout_seconds\": 60,\n \"seconds\": 60.019,\n \"stdout\": \"\",\n \"stderr\": \"\",\n \"error\": \"exit 124\"\n}", "at": "2026-09-12T06:10:49.837703+00:00"} +{"command": ["incus", "query", "nas01:/1.0/networks/recovery?project=ac-ovn-spike"], "seconds": 0.106, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.74.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.66\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"recovery\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Errored\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:49.944540+00:00"} +{"central_state": "running", "via": "fleet ovn_central.py", "at": "2026-09-12T06:10:49.946608+00:00"} +{"command": ["uv", "run", "--locked", "pyinfra", "sandbox01", "--user", "josh", "--sudo", "src/fleet_cluster/deploys/ovn_central.py", "-v", "--yes"], "seconds": 1.451, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [sandbox01] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_central.py\n [sandbox01] Loaded fact server.Hostname\n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] Ready: src/fleet_cluster/deploys/ovn_central.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Record central spike ownership \n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact files.Directory (path=/var/lib)\n [sandbox01] Loaded fact files.Sha1File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] noop: file /var/lib/fleet-ovn-spike is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Install temporary OVN central without recommends \n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] noop: package ovn-central is installed (26.03.0-2)\n [sandbox01] No changes\n\n--> Starting operation: Bind temporary NB and SB databases to VLAN 40 only \n [sandbox01] Loaded fact files.File (path=/etc/default/ovn-central)\n [sandbox01] Loaded fact files.Directory (path=/etc/default)\n [sandbox01] Loaded fact files.Sha1File (path=/etc/default/ovn-central)\n [sandbox01] noop: file /etc/default/ovn-central is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Ensure temporary central is running \n [sandbox01] Loaded fact systemd.SystemdStatus (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Loaded fact systemd.SystemdEnabled (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Success\n\n--> Starting operation: Reload changed central options \n [sandbox01] No changes\n\n--> Results:\n Operation Hosts Success Error No Change \n Record central spike ownership 1 - - 1 \n Install temporary OVN central without recommends 1 - - 1 \n Bind temporary NB and SB databases to VLAN 40 only 1 - - 1 \n Ensure temporary central is running 1 1 - - \n Reload changed central options 1 - - 1 \n Grand total 5 1 - 4 \n\n--> Disconnecting from hosts...\n", "error": null, "at": "2026-09-12T06:10:51.397769+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n systemctl is-active ovn-central ovn-northd ovn-ovsdb-server-nb ovn-ovsdb-server-sb"], "seconds": 0.121, "exit_code": 0, "stdout": "active\nactive\nactive\nactive\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:51.519653+00:00"} +{"command": ["incus", "query", "nas01:/1.0/networks/recovery?project=ac-ovn-spike"], "seconds": 0.101, "exit_code": 0, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.74.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.66\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"recovery\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Errored\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:51.621477+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage/topology.jsonl", "delete-network"], "seconds": 0.598, "exit_code": 0, "stdout": "{\n \"network\": \"recovery\",\n \"deleted\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:52.220538+00:00"} +{"command": ["incus", "query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1"], "seconds": 0.104, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\",\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:52.325712+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage/topology.jsonl", "destroy"], "seconds": 3.729, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:56.055311+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.091, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:10:56.146511+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.093, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:10:56.239684+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.14, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:56.380293+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.321, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:10:56.701756+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00"], "seconds": 0.154, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193387200529\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04227|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193387200646\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04228|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193388200707\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04229|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193388200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193389200714\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04231|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193389200985\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04232|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193389258611\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04233|poll_loop|INFO|Dropped 12182 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193389258664\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04234|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193390200846\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04235|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193390201096\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193391200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04237|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193391201134\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04238|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193392200794\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04239|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193392200945\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193393200708\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04241|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193393200812\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04242|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193394200722\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04243|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193394200943\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04244|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193395200763\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04245|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193395200996\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04246|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193395258956\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04247|poll_loop|INFO|Dropped 12106 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193395259015\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193396200554\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04249|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193396200663\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04250|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193397200687\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04251|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193397200943\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04252|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193398200750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04253|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193398200987\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193399200811\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04255|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193399201025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193400200936\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04257|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193400201194\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193401200738\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04259|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193401200874\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193401258931\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04261|poll_loop|INFO|Dropped 12118 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193401259148\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04262|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193402200537\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04263|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193402200676\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04264|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193403200587\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04265|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193403200852\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193404200736\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04267|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193404200982\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193405200659\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04269|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193405200784\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193406200551\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04271|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193406200675\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04272|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193407200988\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04273|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193407201258\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193407258949\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04275|poll_loop|INFO|Dropped 12185 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193407259025\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04276|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193408200528\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04277|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193408200647\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193409200963\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04279|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193409201223\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193410200768\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04281|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193410200928\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193411200579\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04283|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193411200885\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193412200968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04285|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193412201207\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04286|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193413200724\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04287|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193413200850\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193413258800\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04289|poll_loop|INFO|Dropped 12155 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193413259023\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04290|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193414200861\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04291|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193414200989\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193415200627\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04293|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193415200873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04294|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193416200670\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04295|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193416200954\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193417201075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04297|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193417201309\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193418200778\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04299|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193418200919\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04300|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193419200840\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04301|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193419201067\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193419258833\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04303|poll_loop|INFO|Dropped 12134 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193419258924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04304|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193420200737\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04305|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193420200857\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04306|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193421200731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04307|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193421200870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04308|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193422200779\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04309|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193422200927\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04310|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193423200624\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04311|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193423200762\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04312|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193424201000\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04313|dpif|WARN|Dropped 1987 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193424201263\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04314|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193425200774\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04315|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193425200898\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04316|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193425258554\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04317|poll_loop|INFO|Dropped 12027 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193425258754\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04318|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193426200863\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04319|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193426200992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04320|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193427200721\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04321|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193427201057\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04322|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193428201011\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04323|dpif|WARN|Dropped 1992 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193428201267\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04324|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193429200661\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04325|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193429200851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193430200834\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04327|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193430201125\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193431200976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04329|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193431201230\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193431258780\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04331|poll_loop|INFO|Dropped 12091 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193431258841\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04332|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193432200910\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04333|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193432201061\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04334|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193433200648\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04335|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193433200787\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04336|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193434139747\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04337|bridge|WARN|Dropped 121416 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193434140008\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04338|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)\"\n },\n {\n \"at\": \"1789193434200982\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04339|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193434201079\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04340|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193435200848\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04341|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193435201125\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04342|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193436201108\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04343|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193436201371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04344|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193437200677\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04345|dpif|WARN|Dropped 1996 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193437200822\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04346|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193437258731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04347|poll_loop|INFO|Dropped 12074 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193437258984\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193438200924\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04349|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193438235573\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04350|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193439200520\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04351|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193439200763\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04352|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193440200731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04353|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193440200963\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193441200578\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04355|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193441200696\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193442200968\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04357|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193442201300\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193443201031\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04359|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193443201275\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193443258870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04361|poll_loop|INFO|Dropped 12070 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193443258928\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04362|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193444200631\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04363|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193444200762\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193445201022\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04365|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193445201278\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04366|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193446200715\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04367|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193446200851\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193447200776\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04369|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193447201016\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04370|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193448200646\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04371|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193448200765\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04372|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193449200891\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04373|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193449201105\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04374|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193449258639\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04375|poll_loop|INFO|Dropped 12131 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193449258705\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04376|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193450200543\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04377|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193450200652\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04378|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193451200982\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04379|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193451201242\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04380|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193452200749\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04381|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193452200890\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04382|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193452871363\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04383|bridge|INFO|bridge br-int: deleted interface veth5a72f555 on port 24\"\n },\n {\n \"at\": \"1789193453200711\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04384|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193453200823\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193454200862\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04386|dpif|WARN|Dropped 2051 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193454201080\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193455194391\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04388|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 5\"\n },\n {\n \"at\": \"1789193455194458\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04389|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789193455201064\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04390|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193455201210\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193455258989\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04392|poll_loop|INFO|Dropped 12256 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193455259100\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04393|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193456200869\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04394|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193456200998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04395|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:56.856689+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00"], "seconds": 0.11, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193455374703\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00153|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193455374987\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00154|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 15\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:56.967863+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00"], "seconds": 0.111, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193453856027\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00166|bridge|INFO|bridge br-int: deleted interface veth2a53dc0a on port 22\"\n },\n {\n \"at\": \"1789193455194035\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00167|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193455194235\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00168|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 21\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:57.079935+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00"], "seconds": 0.1, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193455380965\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00157|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193455381208\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00158|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 17\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:10:57.180199+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T06:10:57.181198+00:00"} +{"capture": "monitor-outage", "pid": 79943, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.log", "ready_signal": "time=\"2026-09-11T23:09:47-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:10:57.185404+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/outage/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/outage/diagnostics-after-teardown.txt new file mode 100644 index 0000000..5dba965 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage/diagnostics-after-teardown.txt @@ -0,0 +1,1181 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193387200529", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04227|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193387200646", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04228|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193388200707", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04229|dpif|WARN|Dropped 2046 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193388200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04230|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193389200714", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04231|dpif|WARN|Dropped 2049 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193389200985", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04232|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193389258611", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04233|poll_loop|INFO|Dropped 12182 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193389258664", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04234|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193390200846", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04235|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193390201096", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04236|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193391200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04237|dpif|WARN|Dropped 2014 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193391201134", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04238|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193392200794", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04239|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193392200945", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04240|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193393200708", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04241|dpif|WARN|Dropped 2026 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193393200812", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04242|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193394200722", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04243|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193394200943", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04244|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193395200763", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04245|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193395200996", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04246|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193395258956", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04247|poll_loop|INFO|Dropped 12106 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193395259015", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04248|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193396200554", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04249|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193396200663", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04250|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193397200687", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04251|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193397200943", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04252|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193398200750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04253|dpif|WARN|Dropped 2030 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193398200987", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04254|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193399200811", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04255|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193399201025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04256|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193400200936", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04257|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193400201194", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04258|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193401200738", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04259|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193401200874", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04260|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193401258931", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04261|poll_loop|INFO|Dropped 12118 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193401259148", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04262|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193402200537", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04263|dpif|WARN|Dropped 2013 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193402200676", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04264|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193403200587", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04265|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193403200852", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04266|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193404200736", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04267|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193404200982", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04268|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193405200659", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04269|dpif|WARN|Dropped 2042 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193405200784", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04270|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193406200551", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04271|dpif|WARN|Dropped 2027 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193406200675", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04272|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193407200988", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04273|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193407201258", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04274|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193407258949", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04275|poll_loop|INFO|Dropped 12185 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193407259025", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04276|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193408200528", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04277|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193408200647", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04278|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193409200963", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04279|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193409201223", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04280|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193410200768", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04281|dpif|WARN|Dropped 2034 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193410200928", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04282|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193411200579", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04283|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193411200885", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04284|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193412200968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04285|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193412201207", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04286|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193413200724", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04287|dpif|WARN|Dropped 2019 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193413200850", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04288|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193413258800", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04289|poll_loop|INFO|Dropped 12155 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193413259023", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04290|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193414200861", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04291|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193414200989", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04292|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193415200627", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04293|dpif|WARN|Dropped 2025 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193415200873", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04294|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193416200670", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04295|dpif|WARN|Dropped 2044 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193416200954", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04296|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193417201075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04297|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193417201309", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04298|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193418200778", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04299|dpif|WARN|Dropped 2003 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193418200919", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04300|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193419200840", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04301|dpif|WARN|Dropped 2021 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193419201067", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04302|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193419258833", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04303|poll_loop|INFO|Dropped 12134 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193419258924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04304|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193420200737", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04305|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193420200857", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04306|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193421200731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04307|dpif|WARN|Dropped 2005 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193421200870", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04308|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193422200779", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04309|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193422200927", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04310|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193423200624", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04311|dpif|WARN|Dropped 2016 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193423200762", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04312|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193424201000", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04313|dpif|WARN|Dropped 1987 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193424201263", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04314|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193425200774", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04315|dpif|WARN|Dropped 2009 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193425200898", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04316|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193425258554", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04317|poll_loop|INFO|Dropped 12027 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193425258754", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04318|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193426200863", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04319|dpif|WARN|Dropped 2017 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193426200992", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04320|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193427200721", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04321|dpif|WARN|Dropped 2004 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193427201057", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04322|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193428201011", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04323|dpif|WARN|Dropped 1992 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193428201267", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04324|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193429200661", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04325|dpif|WARN|Dropped 1995 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193429200851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04326|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193430200834", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04327|dpif|WARN|Dropped 2031 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193430201125", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04328|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193431200976", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04329|dpif|WARN|Dropped 2043 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193431201230", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04330|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193431258780", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04331|poll_loop|INFO|Dropped 12091 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193431258841", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04332|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193432200910", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04333|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193432201061", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04334|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193433200648", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04335|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193433200787", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04336|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193434139747", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04337|bridge|WARN|Dropped 121416 log messages in last 60 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193434140008", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04338|bridge|WARN|could not add network device fast40 to ofproto (Device or resource busy)" + }, + { + "at": "1789193434200982", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04339|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193434201079", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04340|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193435200848", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04341|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193435201125", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04342|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193436201108", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04343|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193436201371", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04344|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193437200677", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04345|dpif|WARN|Dropped 1996 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193437200822", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04346|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193437258731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04347|poll_loop|INFO|Dropped 12074 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193437258984", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04348|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193438200924", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04349|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193438235573", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04350|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193439200520", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04351|dpif|WARN|Dropped 1984 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193439200763", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04352|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193440200731", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04353|dpif|WARN|Dropped 1991 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193440200963", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04354|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193441200578", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04355|dpif|WARN|Dropped 2024 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193441200696", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04356|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193442200968", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04357|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193442201300", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04358|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193443201031", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04359|dpif|WARN|Dropped 2028 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193443201275", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04360|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193443258870", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04361|poll_loop|INFO|Dropped 12070 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193443258928", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04362|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193444200631", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04363|dpif|WARN|Dropped 2052 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193444200762", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04364|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193445201022", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04365|dpif|WARN|Dropped 2010 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193445201278", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04366|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193446200715", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04367|dpif|WARN|Dropped 2033 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193446200851", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04368|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193447200776", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04369|dpif|WARN|Dropped 2008 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193447201016", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04370|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193448200646", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04371|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193448200765", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04372|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193449200891", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04373|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193449201105", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04374|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193449258639", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04375|poll_loop|INFO|Dropped 12131 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193449258705", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04376|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193450200543", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04377|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193450200652", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04378|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193451200982", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04379|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193451201242", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04380|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193452200749", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04381|dpif|WARN|Dropped 2064 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193452200890", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04382|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193452871363", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04383|bridge|INFO|bridge br-int: deleted interface veth5a72f555 on port 24" + }, + { + "at": "1789193453200711", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04384|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193453200823", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04385|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193454200862", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04386|dpif|WARN|Dropped 2051 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193454201080", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04387|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193455194391", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04388|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 5" + }, + { + "at": "1789193455194458", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04389|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789193455201064", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04390|dpif|WARN|Dropped 2082 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193455201210", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04391|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193455258989", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04392|poll_loop|INFO|Dropped 12256 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193455259100", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04393|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193456200869", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04394|dpif|WARN|Dropped 2077 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193456200998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04395|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193455374703", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00153|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193455374987", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00154|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 15" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193453856027", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00166|bridge|INFO|bridge br-int: deleted interface veth2a53dc0a on port 22" + }, + { + "at": "1789193455194035", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00167|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193455194235", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00168|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 21" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193455380965", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00157|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net29-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193455381208", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00158|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net29-ls-ext-lsp-provider on port 17" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.debug.log b/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.debug.log new file mode 100644 index 0000000..829c4a3 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:09:47-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.log b/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.log new file mode 100644 index 0000000..63b9246 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.log @@ -0,0 +1,344 @@ +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Event listener server handler started" id=e9dfa48c-59de-46b9-a188-cf1b0479c2e9 local="10.10.10.14:8443" remote="100.122.142.76:63430" +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63435" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:47Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63436" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:48Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:09:48Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Completed heartbeat round" duration=2.578564361s +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63443" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63444" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63445" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63446" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63447" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63448" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63449" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63450" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Setting up network" driver=ovn network=recovery project=ac-ovn-spike +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.74.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=recovery project=ac-ovn-spike +time="2026-09-12T06:09:49Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:12:49:b4" network=recovery project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.30 +time="2026-09-12T06:09:56Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:09:56Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:09:57Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:09:57Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:09:59Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:09:59Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:10:00Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:10:00Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:10:00Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:10:01Z" level=debug msg="[nas01] Completed heartbeat round" duration=4.385026863s +time="2026-09-12T06:10:06Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:10:06Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:10:09Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:10:09Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:10:10Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:10:10Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:10:12Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:10:12Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:10:13Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:10:13Z" level=debug msg="[nas01] Completed heartbeat round" duration=6.626253711s +time="2026-09-12T06:10:16Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:10:16Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:10:17Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:10:17Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:10:18Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:10:18Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:10:20Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:10:20Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:10:20Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:10:20Z" level=debug msg="[nas01] Completed heartbeat round" duration=3.664990878s +time="2026-09-12T06:10:26Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:10:26Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:10:30Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:10:30Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:10:32Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:10:32Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:10:32Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:10:32Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:10:32Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:10:32Z" level=debug msg="[nas01] Completed heartbeat round" duration=6.148977104s +time="2026-09-12T06:10:36Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:10:36Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:10:39Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:10:39Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:10:39Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:10:39Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:10:41Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:10:41Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:10:41Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:10:41Z" level=debug msg="[nas01] Completed heartbeat round" duration=4.778337015s +time="2026-09-12T06:10:46Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:10:46Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:10:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63468" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63469" method=GET protocol=tls url="/1.0/networks/recovery?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63472" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63473" method=GET protocol=tls url="/1.0/networks/recovery?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63474" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63475" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63476" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63477" method=GET protocol=tls url="/1.0/networks/recovery/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63478" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63479" method=DELETE protocol=tls url="/1.0/networks/recovery?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/recovery?project=ac-ovn-spike" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/recovery?project=ac-ovn-spike" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/recovery?project=ac-ovn-spike" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=recovery project=ac-ovn-spike +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Stop" driver=ovn network=recovery project=ac-ovn-spike +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63480" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63481" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63486" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63487" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63488" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63489" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:06:05.11191994Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:06:05.773285641Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:06:06.030413125Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:06:06.647108527Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63490" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63491" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63492" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Event listener server handler started" id=d775fc2b-97d5-4946-938b-b75cc174d644 local="10.10.10.14:8443" remote="100.122.142.76:63492" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63493" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:52Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 06:06:05.11191994 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:06:05.773285641 +0000 UTC" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63494" method=GET protocol=tls url="/1.0/operations/dc6730f5-dde7-44af-ac92-1930e164c1e0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63495" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 06:06:05.11191994 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:06:05.773285641 +0000 UTC" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63496" method=GET protocol=tls url="/1.0/operations/1f34605c-9141-48a6-a88a-25aa309fecf3?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to update warning status for warning \"519f6fb0-a631-4d61-8805-d814f3ffb22f\": database is locked" +time="2026-09-12T06:10:53Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 06:06:05.11191994 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:06:05.773285641 +0000 UTC" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Event listener server handler stopped" listener=d775fc2b-97d5-4946-938b-b75cc174d644 local="10.10.10.14:8443" remote="100.122.142.76:63492" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63497" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63498" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63499" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Event listener server handler started" id=454a4699-3265-4eaa-9b61-0f1b4b7aa1ea local="10.10.10.14:8443" remote="100.122.142.76:63499" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63500" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Database error, retrying" attempt=1 err="Failed to update warning status for warning \"519f6fb0-a631-4d61-8805-d814f3ffb22f\": database is locked" +time="2026-09-12T06:10:53Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 06:06:06.030413125 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:06:06.647108527 +0000 UTC" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63501" method=GET protocol=tls url="/1.0/operations/cef3077b-1026-4522-919e-31c4d039dd7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:10:53Z" level=debug msg="[nas01] Completed heartbeat round" duration=7.321947854s +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63502" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:54Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 06:06:06.030413125 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:06:06.647108527 +0000 UTC" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63503" method=GET protocol=tls url="/1.0/operations/5ec8152e-9717-4eea-b02b-b8155d404142?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 06:06:06.030413125 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:06:06.647108527 +0000 UTC" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Event listener server handler stopped" listener=454a4699-3265-4eaa-9b61-0f1b4b7aa1ea local="10.10.10.14:8443" remote="100.122.142.76:63499" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63504" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63505" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63506" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63507" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63508" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63509" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63510" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63511" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63512" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63513" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63514" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63515" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63516" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63517" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63518" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63519" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63520" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Event listener server handler started" id=7488823b-4d81-480b-8412-a74c5aefa933 local="10.10.10.14:8443" remote="100.122.142.76:63520" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63521" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=55a11b18-08f1-4186-894e-561280524ae5 project=ac-ovn-spike +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=55a11b18-08f1-4186-894e-561280524ae5 project=ac-ovn-spike +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=55a11b18-08f1-4186-894e-561280524ae5 project=ac-ovn-spike +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63522" method=GET protocol=tls url="/1.0/operations/55a11b18-08f1-4186-894e-561280524ae5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Event listener server handler stopped" listener=7488823b-4d81-480b-8412-a74c5aefa933 local="10.10.10.14:8443" remote="100.122.142.76:63520" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63523" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63524" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63526" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63527" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63528" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63529" method=GET protocol=tls url="/1.0/network-allocations?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63532" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63533" method=GET protocol=tls url="/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63534" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63535" method=GET protocol=tls url="/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63536" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63537" method=GET protocol=tls url="/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63538" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:10:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63539" method=GET protocol=tls url="/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A09%3A47.190329%2B00%3A00" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc diff --git a/spikes/ovn/diagnosis-2026-09-12/outage/outage.json b/spikes/ovn/diagnosis-2026-09-12/outage/outage.json new file mode 100644 index 0000000..32b9688 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage/outage.json @@ -0,0 +1,196 @@ +{ + "networks-before": { + "exit_code": 0, + "stdout": [ + { + "config": { + "bridge.mtu": "1442", + "dns.nameservers": "10.10.40.1", + "ipv4.address": "10.253.73.1/24", + "ipv4.dhcp": "true", + "ipv4.nat": "true", + "ipv6.address": "none", + "network": "fast40-uplink", + "volatile.network.ipv4.address": "10.10.40.65" + }, + "description": "", + "locations": [ + "lab02", + "lab03", + "nas01", + "lab01" + ], + "managed": true, + "name": "default", + "project": "ac-ovn-spike", + "status": "Created", + "type": "ovn", + "used_by": [ + "/1.0/instances/one?project=ac-ovn-spike", + "/1.0/instances/two?project=ac-ovn-spike" + ] + } + ], + "stderr": "" + }, + "central-stopped": { + "exit_code": 0, + "stdout": "", + "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [sandbox01] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_central.py\n [sandbox01] Loaded fact server.Hostname\n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] Ready: src/fleet_cluster/deploys/ovn_central.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Record central spike ownership \n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact files.Directory (path=/var/lib)\n [sandbox01] Loaded fact files.Sha1File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] noop: file /var/lib/fleet-ovn-spike is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Install temporary OVN central without recommends \n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] noop: package ovn-central is installed (26.03.0-2)\n [sandbox01] No changes\n\n--> Starting operation: Bind temporary NB and SB databases to VLAN 40 only \n [sandbox01] Loaded fact files.File (path=/etc/default/ovn-central)\n [sandbox01] Loaded fact files.Directory (path=/etc/default)\n [sandbox01] Loaded fact files.Sha1File (path=/etc/default/ovn-central)\n [sandbox01] noop: file /etc/default/ovn-central is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Ensure temporary central is stopped \n [sandbox01] Loaded fact systemd.SystemdStatus (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Loaded fact systemd.SystemdEnabled (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Success\n\n--> Results:\n Operation Hosts Success Error No Change \n Record central spike ownership 1 - - 1 \n Install temporary OVN central without recommends 1 - - 1 \n Bind temporary NB and SB databases to VLAN 40 only 1 - - 1 \n Ensure temporary central is stopped 1 1 - - \n Grand total 4 1 - 3 \n\n--> Disconnecting from hosts...\n" + }, + "central-inactive": { + "exit_code": 3, + "stdout": "inactive\ndeactivating\ninactive\ndeactivating\n", + "stderr": "" + }, + "create-network": { + "exit_code": 1, + "stdout": { + "network": "recovery", + "subnet": "10.253.74.1/24", + "created": false, + "code": 124, + "timeout_seconds": 60, + "seconds": 60.019, + "stdout": "", + "stderr": "", + "error": "exit 124" + }, + "stderr": "" + }, + "errored-before-recovery": { + "exit_code": 0, + "stdout": { + "config": { + "bridge.mtu": "1442", + "dns.nameservers": "10.10.40.1", + "ipv4.address": "10.253.74.1/24", + "ipv4.dhcp": "true", + "ipv4.nat": "true", + "ipv6.address": "none", + "network": "fast40-uplink", + "volatile.network.ipv4.address": "10.10.40.66" + }, + "description": "", + "locations": [ + "nas01", + "lab01", + "lab02", + "lab03" + ], + "managed": true, + "name": "recovery", + "project": "ac-ovn-spike", + "status": "Errored", + "type": "ovn", + "used_by": [] + }, + "stderr": "" + }, + "central-running": { + "exit_code": 0, + "stdout": "", + "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [sandbox01] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_central.py\n [sandbox01] Loaded fact server.Hostname\n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] Ready: src/fleet_cluster/deploys/ovn_central.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Record central spike ownership \n [sandbox01] Loaded fact files.File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] Loaded fact files.Directory (path=/var/lib)\n [sandbox01] Loaded fact files.Sha1File (path=/var/lib/fleet-ovn-spike)\n [sandbox01] noop: file /var/lib/fleet-ovn-spike is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Install temporary OVN central without recommends \n [sandbox01] Loaded fact deb.DebPackages\n [sandbox01] noop: package ovn-central is installed (26.03.0-2)\n [sandbox01] No changes\n\n--> Starting operation: Bind temporary NB and SB databases to VLAN 40 only \n [sandbox01] Loaded fact files.File (path=/etc/default/ovn-central)\n [sandbox01] Loaded fact files.Directory (path=/etc/default)\n [sandbox01] Loaded fact files.Sha1File (path=/etc/default/ovn-central)\n [sandbox01] noop: file /etc/default/ovn-central is already uploaded\n [sandbox01] No changes\n\n--> Starting operation: Ensure temporary central is running \n [sandbox01] Loaded fact systemd.SystemdStatus (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Loaded fact systemd.SystemdEnabled (machine=None, services=['ovn-central.service'], user_mode=False, user_name=None)\n [sandbox01] Success\n\n--> Starting operation: Reload changed central options \n [sandbox01] No changes\n\n--> Results:\n Operation Hosts Success Error No Change \n Record central spike ownership 1 - - 1 \n Install temporary OVN central without recommends 1 - - 1 \n Bind temporary NB and SB databases to VLAN 40 only 1 - - 1 \n Ensure temporary central is running 1 1 - - \n Reload changed central options 1 - - 1 \n Grand total 5 1 - 4 \n\n--> Disconnecting from hosts...\n" + }, + "central-active": { + "exit_code": 0, + "stdout": "active\nactive\nactive\nactive\n", + "stderr": "" + }, + "errored-after-recovery": { + "exit_code": 0, + "stdout": { + "config": { + "bridge.mtu": "1442", + "dns.nameservers": "10.10.40.1", + "ipv4.address": "10.253.74.1/24", + "ipv4.dhcp": "true", + "ipv4.nat": "true", + "ipv6.address": "none", + "network": "fast40-uplink", + "volatile.network.ipv4.address": "10.10.40.66" + }, + "description": "", + "locations": [ + "nas01", + "lab01", + "lab02", + "lab03" + ], + "managed": true, + "name": "recovery", + "project": "ac-ovn-spike", + "status": "Errored", + "type": "ovn", + "used_by": [] + }, + "stderr": "" + }, + "delete-network": { + "exit_code": 0, + "stdout": { + "network": "recovery", + "deleted": true, + "failures": [] + }, + "stderr": "" + }, + "networks-after-delete": { + "exit_code": 0, + "stdout": [ + { + "config": { + "bridge.mtu": "1442", + "dns.nameservers": "10.10.40.1", + "ipv4.address": "10.253.73.1/24", + "ipv4.dhcp": "true", + "ipv4.nat": "true", + "ipv6.address": "none", + "network": "fast40-uplink", + "volatile.network.ipv4.address": "10.10.40.65" + }, + "description": "", + "locations": [ + "nas01", + "lab01", + "lab02", + "lab03" + ], + "managed": true, + "name": "default", + "project": "ac-ovn-spike", + "status": "Created", + "type": "ovn", + "used_by": [ + "/1.0/instances/one?project=ac-ovn-spike", + "/1.0/instances/two?project=ac-ovn-spike" + ] + } + ], + "stderr": "" + }, + "destroy": { + "exit_code": 0, + "stdout": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-outage", + "ready": true, + "pid": 79943, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/outage/monitor-outage.log", + "bytes": 70721, + "ready_signal": "time=\"2026-09-11T23:09:47-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:09:47.190814+00:00", + "stopped_at": "2026-09-12T06:10:57.185227+00:00" + } + ], + "capture_failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/outage/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/outage/topology.jsonl new file mode 100644 index 0000000..4aa41e9 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/outage/topology.jsonl @@ -0,0 +1,20 @@ +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.11, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.111, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\",\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/default?project=ac-ovn-spike\",\n\t\t\"/1.0/networks/keeper\"\n\t]\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"recovery\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.74.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": null, "seconds": 60.019, "stdout": "", "stderr": "", "error": "timeout"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.1, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 6\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/recovery/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/recovery?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.308, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.098, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.104, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:06:05.11191994Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"197a3a47-320d-47fc-8aa3-39f31be62f39\",\n\t\t\t\"volatile.eth0.host_name\": \"veth5a72f555\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:41:50\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\",\n\t\t\t\"volatile.uuid.generation\": \"dd40a9ad-0757-402f-b311-18b76ff92c7b\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:06:05.773285641Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:06:06.030413125Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"f22e8df0-d751-4187-8d7d-12416228f825\",\n\t\t\t\"volatile.eth0.host_name\": \"veth2a53dc0a\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:22:21:09\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"860ef436-0db1-442e-95d5-890d4960dca1\",\n\t\t\t\"volatile.uuid.generation\": \"860ef436-0db1-442e-95d5-890d4960dca1\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:06:06.647108527Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.988, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.102, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.1, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\",\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.101, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.15, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.342, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T06:06:06.067835145Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T06:06:04.883182379Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.203, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.165, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/post-outage/commands.jsonl new file mode 100644 index 0000000..2466424 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.119, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:11:53.554226+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.285, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T06:11:53.840279+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.094, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T06:11:53.935007+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 85795, "ready": true, "ready_signal": "time=\"2026-09-11T23:11:54-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:11:54.064091+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/topology.jsonl", "create"], "seconds": 9.08, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.65\",\n \"network_create_seconds\": 0.306,\n \"first_cross_member_ping_seconds\": 3.805,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:03.143935+00:00"} +{"capture": "monitor-create", "pid": 85795, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.log", "ready_signal": "time=\"2026-09-11T23:11:54-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:12:03.149070+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.105, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:03.254411+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.09, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:13:8a:9c |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:93:47:ba |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:03.344917+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.143, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch e25db59d-0868-4890-8296-1cc3888b52d5 (incus-net31-ls-int)\n port incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0\n addresses: [\"10:66:6a:13:8a:9c dynamic\"]\n port incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0\n addresses: [\"10:66:6a:93:47:ba dynamic\"]\n port incus-net31-ls-int-lsp-router\n type: router\n router-port: incus-net31-lr-lrp-int\nswitch c305d96f-5c86-4b13-be6a-ebaa38c350a1 (incus-net31-ls-ext)\n port incus-net31-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net31-ls-ext-lsp-router\n type: router\n router-port: incus-net31-lr-lrp-ext\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 4368ec4c-faeb-4e66-bb9b-9bb0d8b94c0f (incus-net31-lr)\n port incus-net31-lr-lrp-ext\n mac: \"10:66:6a:ea:40:3b\"\n ipv6-lla: \"fe80::1266:6aff:feea:403b\"\n networks: [\"10.10.40.65/24\"]\n port incus-net31-lr-lrp-int\n mac: \"10:66:6a:ea:40:3b\"\n ipv6-lla: \"fe80::1266:6aff:feea:403b\"\n networks: [\"10.253.73.1/24\"]\n nat e4165050-5b54-49ea-9153-145022af6a9b\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net31-lr-lrp-ext\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : a72199a8-b145-4f7c-9de4-dffb0f793fcf\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ea:40:3b\"\nname : incus-net31-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 99cbd920-1939-411e-acef-5f10df78cdaf\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 483173e7-91d1-429a-ad49-7145460cb657\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ea:40:3b\"\nname : incus-net31-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 6a9d4f10-3918-46fd-bef3-0c61f9246ccb\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : c4b0193e-8048-452e-bfdf-4d20fdbbf784\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 156bffda-11c4-4b23-905b-35b5f1554590\nlogical_port : cr-incus-net31-lr-lrp-ext\nmac : [\"10:66:6a:ea:40:3b 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net31-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:03.488242+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.317, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:ea:40:3b REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T06:12:03.805434+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.116, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193514200754\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04531|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193514200979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193515200621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04533|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193515200733\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193515258750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04535|poll_loop|INFO|Dropped 12430 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193515258896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04536|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193516073785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04537|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193516073900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04538|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789193516200588\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04539|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193516200682\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193517200923\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04541|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193517201117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193517532345\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04543|bridge|INFO|bridge br-int: added interface vethdb5f20af on port 26\"\n },\n {\n \"at\": \"1789193518200580\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04544|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193518200661\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04545|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193519200701\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04546|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193519200939\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04547|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193520200695\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04548|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193520200839\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04549|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193521200947\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04550|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193521201188\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04551|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193521258696\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04552|poll_loop|INFO|Dropped 12218 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193521258774\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193522200600\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04554|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193522200724\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193523200524\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04556|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193523200728\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:03.922912+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.126, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516065503\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00156|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516065829\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00157|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:04.049499+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.092, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516069547\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00170|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516069809\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00171|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789193518601888\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00172|bridge|INFO|bridge br-int: added interface veth29bf67a9 on port 24\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:04.141606+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.096, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516063726\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00160|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516064054\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00161|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:04.238076+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-before-probe.txt", "router_mac": "10:66:6a:ea:40:3b", "at": "2026-09-12T06:12:04.238664+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:11:56.84514287Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:11:57.82617521Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:11:58.070081651Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:11:58.679760489Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:04.345632+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.65"], "capture": "tcpdump-arp", "pid": 86314, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T06:12:04.468154+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.301, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.094 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\nelapsed_seconds=0.109 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f925685-4e2f-4e43-877e-aa36540e607f\",\"volatile.eth0.host_name\":\"vethdb5f20af\",\"volatile.eth0.hwaddr\":\"10:66:6a:13:8a:9c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\",\"volatile.uuid.generation\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:11:56.84514287Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f925685-4e2f-4e43-877e-aa36540e607f\",\"volatile.eth0.host_name\":\"vethdb5f20af\",\"volatile.eth0.hwaddr\":\"10:66:6a:13:8a:9c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\",\"volatile.uuid.generation\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:11:57.82617521Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9498624,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe13:8a9c\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":898,\"bytes_sent\":1410,\"packets_received\":5,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:13:8a:9c\",\"host_name\":\"vethdb5f20af\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4075783,\"processes\":4,\"cpu\":{\"usage\":479353000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:11:56.839999914Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\"volatile.eth0.host_name\":\"veth29bf67a9\",\"volatile.eth0.hwaddr\":\"10:66:6a:93:47:ba\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\"volatile.uuid.generation\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:11:58.070081651Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\"volatile.eth0.host_name\":\"veth29bf67a9\",\"volatile.eth0.hwaddr\":\"10:66:6a:93:47:ba\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\"volatile.uuid.generation\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:11:58.679760489Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":12304384,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe93:47ba\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1340,\"packets_received\":6,\"packets_sent\":10,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:93:47:ba\",\"host_name\":\"veth29bf67a9\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":16037,\"processes\":4,\"cpu\":{\"usage\":493455000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:11:58.690000057Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.122 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.452 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.256 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.372 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.641 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.417 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.417/0.810/1.372 ms\nelapsed_seconds=2.242 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.322 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=1.078 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.375 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.375/0.925/1.322 ms\nelapsed_seconds=2.282 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.725 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.828 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.125 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.125/1.559/1.828 ms\nelapsed_seconds=2.205 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.515 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.736 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.051 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.051/1.434/1.736 ms\nelapsed_seconds=2.380 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nelapsed_seconds=0.489 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.268 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.346 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.397 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.031 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.117221 bytes_per_second=853089463\nelapsed_seconds=0.382 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.549 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.125130 bytes_per_second=799168864\nelapsed_seconds=0.390 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.514 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:18.769921+00:00"} +{"capture": "tcpdump-arp", "pid": 86314, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T06:12:18.772469+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.1, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:18.872476+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.098, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:13:8a:9c |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:93:47:ba |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:18.970765+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.129, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch e25db59d-0868-4890-8296-1cc3888b52d5 (incus-net31-ls-int)\n port incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0\n addresses: [\"10:66:6a:13:8a:9c dynamic\"]\n port incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0\n addresses: [\"10:66:6a:93:47:ba dynamic\"]\n port incus-net31-ls-int-lsp-router\n type: router\n router-port: incus-net31-lr-lrp-int\nswitch c305d96f-5c86-4b13-be6a-ebaa38c350a1 (incus-net31-ls-ext)\n port incus-net31-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\n port incus-net31-ls-ext-lsp-router\n type: router\n router-port: incus-net31-lr-lrp-ext\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 4368ec4c-faeb-4e66-bb9b-9bb0d8b94c0f (incus-net31-lr)\n port incus-net31-lr-lrp-ext\n mac: \"10:66:6a:ea:40:3b\"\n ipv6-lla: \"fe80::1266:6aff:feea:403b\"\n networks: [\"10.10.40.65/24\"]\n port incus-net31-lr-lrp-int\n mac: \"10:66:6a:ea:40:3b\"\n ipv6-lla: \"fe80::1266:6aff:feea:403b\"\n networks: [\"10.253.73.1/24\"]\n nat e4165050-5b54-49ea-9153-145022af6a9b\n external ip: \"10.10.40.65\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net31-lr-lrp-ext\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : a72199a8-b145-4f7c-9de4-dffb0f793fcf\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:ea:40:3b\"\nname : incus-net31-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 99cbd920-1939-411e-acef-5f10df78cdaf\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 483173e7-91d1-429a-ad49-7145460cb657\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:ea:40:3b\"\nname : incus-net31-lr-lrp-ext\nnetworks : [\"10.10.40.65/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 6a9d4f10-3918-46fd-bef3-0c61f9246ccb\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : c4b0193e-8048-452e-bfdf-4d20fdbbf784\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 156bffda-11c4-4b23-905b-35b5f1554590\nlogical_port : cr-incus-net31-lr-lrp-ext\nmac : [\"10:66:6a:ea:40:3b 10.10.40.65/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net31-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:19.099666+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.307, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:ea:40:3b REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T06:12:19.407613+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.138, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193514200754\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04531|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193514200979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193515200621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04533|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193515200733\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193515258750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04535|poll_loop|INFO|Dropped 12430 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193515258896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04536|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193516073785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04537|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193516073900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04538|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789193516200588\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04539|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193516200682\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193517200923\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04541|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193517201117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193517532345\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04543|bridge|INFO|bridge br-int: added interface vethdb5f20af on port 26\"\n },\n {\n \"at\": \"1789193518200580\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04544|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193518200661\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04545|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193519200701\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04546|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193519200939\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04547|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193520200695\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04548|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193520200839\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04549|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193521200947\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04550|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193521201188\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04551|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193521258696\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04552|poll_loop|INFO|Dropped 12218 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193521258774\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193522200600\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04554|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193522200724\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193523200524\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04556|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193523200728\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193524200945\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04558|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193524201179\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193525201001\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04560|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193525201201\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193526072628\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04562|connmgr|INFO|br-int<->unix#7: 932 flow_mods in the 7 s starting 10 s ago (839 adds, 63 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789193526200818\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04563|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193526200904\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04564|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193527200651\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04565|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193527200864\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04566|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193527258766\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04567|poll_loop|INFO|Dropped 12057 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193527258811\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04568|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193528200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04569|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193528200998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193529200974\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04571|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193529201173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193530200813\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04573|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193530200936\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193531201098\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04575|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193531201375\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193532200610\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04577|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193532200723\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193533200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04579|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193533201200\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193533258732\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04581|poll_loop|INFO|Dropped 12033 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193533258832\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193534200643\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04583|dpif|WARN|Dropped 1985 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193534200805\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193535200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04585|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193535201297\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193536200749\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04587|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193536200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193537200922\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04589|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193537201155\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193538200922\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04591|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193538201145\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193539200776\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04593|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193539200920\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193539258801\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04595|poll_loop|INFO|Dropped 11982 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193539258964\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:19.546263+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.115, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516065503\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00156|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516065829\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00157|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16\"\n },\n {\n \"at\": \"1789193526063008\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00158|connmgr|INFO|br-int<->unix#7: 958 flow_mods in the 7 s starting 10 s ago (861 adds, 97 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:19.662456+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.126, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516069547\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00170|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516069809\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00171|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789193518601888\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00172|bridge|INFO|bridge br-int: added interface veth29bf67a9 on port 24\"\n },\n {\n \"at\": \"1789193526067192\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00173|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 10 s ago (870 adds, 94 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:19.789519+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.117, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516063726\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00160|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516064054\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00161|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18\"\n },\n {\n \"at\": \"1789193526056784\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00162|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 7 s starting 10 s ago (877 adds, 96 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:19.906434+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-probe.txt", "router_mac": "10:66:6a:ea:40:3b", "at": "2026-09-12T06:12:19.907252+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 87091, "ready": true, "ready_signal": "time=\"2026-09-11T23:12:19-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:12:19.996061+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/topology.jsonl", "destroy"], "seconds": 3.414, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:23.410337+00:00"} +{"capture": "monitor-delete", "pid": 87091, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.log", "ready_signal": "time=\"2026-09-11T23:12:19-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T06:12:23.412584+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.092, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:12:23.505661+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.106, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T06:12:23.612094+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ip neigh ==='\nif [ -n '10.10.40.65' ]; then ip neigh show 10.10.40.65; else ip neigh; fi"], "seconds": 0.125, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext)\n port incus-net25-ls-ext-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-ext\n port incus-net25-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nswitch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int)\n port incus-net25-ls-int-lsp-router\n type: router\n router-port: incus-net25-lr-lrp-int\nrouter 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr)\n port incus-net25-lr-lrp-int\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.253.72.1/24\"]\n port incus-net25-lr-lrp-ext\n mac: \"10:66:6a:70:1e:0b\"\n ipv6-lla: \"fe80::1266:6aff:fe70:1e0b\"\n networks: [\"10.10.40.64/24\"]\n nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.72.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net25-lr-lrp-ext\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"c2919898-1135-4799-80cf-860ae7e7ef9e\"}\n\n_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:70:1e:0b\"\nname : incus-net25-lr-lrp-int\nnetworks : [\"10.253.72.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca\nadditional_chassis : []\nadditional_encap : []\nchassis : 1e4eb895-1d17-4859-9e5b-0454f8482291\ndatapath : db7925f7-c524-4a0a-b84c-5ee7aec48844\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925\nlogical_port : cr-incus-net25-lr-lrp-ext\nmac : [\"10:66:6a:70:1e:0b 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net25-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ip neigh ===\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:23.736869+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.65"], "seconds": 0.302, "exit_code": 0, "stdout": "10.10.40.65 dev br40 lladdr 10:66:6a:ea:40:3b REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T06:12:24.039199+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.153, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193514200754\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04531|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193514200979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193515200621\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04533|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193515200733\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193515258750\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04535|poll_loop|INFO|Dropped 12430 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193515258896\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04536|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193516073785\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04537|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193516073900\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04538|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789193516200588\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04539|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193516200682\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193517200923\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04541|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193517201117\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193517532345\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04543|bridge|INFO|bridge br-int: added interface vethdb5f20af on port 26\"\n },\n {\n \"at\": \"1789193518200580\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04544|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193518200661\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04545|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193519200701\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04546|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193519200939\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04547|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193520200695\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04548|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193520200839\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04549|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193521200947\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04550|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193521201188\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04551|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193521258696\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04552|poll_loop|INFO|Dropped 12218 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193521258774\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193522200600\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04554|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193522200724\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193523200524\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04556|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193523200728\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193524200945\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04558|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193524201179\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193525201001\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04560|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193525201201\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193526072628\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04562|connmgr|INFO|br-int<->unix#7: 932 flow_mods in the 7 s starting 10 s ago (839 adds, 63 deletes, 30 modifications)\"\n },\n {\n \"at\": \"1789193526200818\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04563|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193526200904\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04564|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193527200651\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04565|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193527200864\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04566|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193527258766\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04567|poll_loop|INFO|Dropped 12057 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193527258811\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04568|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)\"\n },\n {\n \"at\": \"1789193528200679\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04569|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193528200998\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193529200974\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04571|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193529201173\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193530200813\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04573|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193530200936\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193531201098\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04575|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193531201375\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193532200610\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04577|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193532200723\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193533200929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04579|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193533201200\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193533258732\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04581|poll_loop|INFO|Dropped 12033 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193533258832\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193534200643\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04583|dpif|WARN|Dropped 1985 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193534200805\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193535200980\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04585|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193535201297\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193536200749\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04587|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193536200899\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193537200922\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04589|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193537201155\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193538200922\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04591|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193538201145\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193539200776\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04593|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193539200920\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193539258801\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04595|poll_loop|INFO|Dropped 11982 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193539258964\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)\"\n },\n {\n \"at\": \"1789193540200993\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04597|dpif|WARN|Dropped 1987 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193540201105\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193540536128\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04599|bridge|INFO|bridge br-int: deleted interface vethdb5f20af on port 26\"\n },\n {\n \"at\": \"1789193541200959\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04600|dpif|WARN|Dropped 1961 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193541201075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04601|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193542201070\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04602|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193542201349\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04603|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n },\n {\n \"at\": \"1789193542803543\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04604|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6\"\n },\n {\n \"at\": \"1789193542803678\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04605|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25\"\n },\n {\n \"at\": \"1789193543200820\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04606|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate\"\n },\n {\n \"at\": \"1789193543200943\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"f9f71dd5a051466283d7da6fb860c528\",\n \"message\": \"ovs|04607|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:24.192348+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.101, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516065503\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00156|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516065829\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00157|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16\"\n },\n {\n \"at\": \"1789193526063008\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00158|connmgr|INFO|br-int<->unix#7: 958 flow_mods in the 7 s starting 10 s ago (861 adds, 97 deletes)\"\n },\n {\n \"at\": \"1789193542794831\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00159|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193542795097\",\n \"member\": \"lab02.glab.lol\",\n \"boot_id\": \"81e2acca155f4ac99c2a077d9ac72583\",\n \"message\": \"ovs|00160|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:24.294596+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.111, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516069547\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00170|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516069809\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00171|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23\"\n },\n {\n \"at\": \"1789193518601888\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00172|bridge|INFO|bridge br-int: added interface veth29bf67a9 on port 24\"\n },\n {\n \"at\": \"1789193526067192\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00173|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 10 s ago (870 adds, 94 deletes)\"\n },\n {\n \"at\": \"1789193541547630\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00174|bridge|INFO|bridge br-int: deleted interface veth29bf67a9 on port 24\"\n },\n {\n \"at\": \"1789193542801310\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00175|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193542801545\",\n \"member\": \"lab03.glab.lol\",\n \"boot_id\": \"3c8c53f2fe38435e99abb369646320e0\",\n \"message\": \"ovs|00176|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:24.405516+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T06%3A11%3A53.435101%2B00%3A00"], "seconds": 0.107, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789193516063726\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00160|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193516064054\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00161|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18\"\n },\n {\n \"at\": \"1789193526056784\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00162|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 7 s starting 10 s ago (877 adds, 96 deletes)\"\n },\n {\n \"at\": \"1789193542803328\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00163|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7\"\n },\n {\n \"at\": \"1789193542803552\",\n \"member\": \"nas01.glab.lol\",\n \"boot_id\": \"1829964eb02542619d82dc594bc2b5d3\",\n \"message\": \"ovs|00164|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T06:12:24.512898+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T06:12:24.513686+00:00"} diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/create.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/create.stdout.json b/spikes/ovn/diagnosis-2026-09-12/post-outage/create.stdout.json new file mode 100644 index 0000000..8cce98e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.306, + "first_cross_member_ping_seconds": 3.805, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/cycle.json b/spikes/ovn/diagnosis-2026-09-12/post-outage/cycle.json new file mode 100644 index 0000000..8be920b --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T06:11:53.435101+00:00", + "ended_at": "2026-09-12T06:12:24.513777+00:00", + "seconds": 31.078, + "external_ip": "10.10.40.65", + "router_mac": "10:66:6a:ea:40:3b", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.65", + "network_create_seconds": 0.306, + "first_cross_member_ping_seconds": 3.805, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.094 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.65\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\nelapsed_seconds=0.109 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f925685-4e2f-4e43-877e-aa36540e607f\",\"volatile.eth0.host_name\":\"vethdb5f20af\",\"volatile.eth0.hwaddr\":\"10:66:6a:13:8a:9c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\",\"volatile.uuid.generation\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:11:56.84514287Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"9f925685-4e2f-4e43-877e-aa36540e607f\",\"volatile.eth0.host_name\":\"vethdb5f20af\",\"volatile.eth0.hwaddr\":\"10:66:6a:13:8a:9c\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\",\"volatile.uuid.generation\":\"a2ef682b-00fd-496e-a934-1d1cf3913919\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:11:57.82617521Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":9498624,\"usage_peak\":0,\"total\":65256732000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe13:8a9c\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":898,\"bytes_sent\":1410,\"packets_received\":5,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:13:8a:9c\",\"host_name\":\"vethdb5f20af\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":4075783,\"processes\":4,\"cpu\":{\"usage\":479353000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:11:56.839999914Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\"volatile.eth0.host_name\":\"veth29bf67a9\",\"volatile.eth0.hwaddr\":\"10:66:6a:93:47:ba\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\"volatile.uuid.generation\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T06:11:58.070081651Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\"volatile.eth0.host_name\":\"veth29bf67a9\",\"volatile.eth0.hwaddr\":\"10:66:6a:93:47:ba\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\"volatile.uuid.generation\":\"b3dc9179-37ac-4dd9-b893-9081761aa55d\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T06:11:58.679760489Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":12304384,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe93:47ba\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1340,\"packets_received\":6,\"packets_sent\":10,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:93:47:ba\",\"host_name\":\"veth29bf67a9\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":16037,\"processes\":4,\"cpu\":{\"usage\":493455000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T06:11:58.690000057Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.122 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.452 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.256 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.372 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.641 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.417 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.417/0.810/1.372 ms\nelapsed_seconds=2.242 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.322 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=1.078 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.375 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.375/0.925/1.322 ms\nelapsed_seconds=2.282 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.725 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.828 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.125 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.125/1.559/1.828 ms\nelapsed_seconds=2.205 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.515 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.736 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.051 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.051/1.434/1.736 ms\nelapsed_seconds=2.380 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nelapsed_seconds=0.489 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\n\nName:\texample.com\nAddress: 172.66.147.243\nName:\texample.com\nAddress: 104.20.23.154\n\nelapsed_seconds=0.268 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.346 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.397 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.031 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.117221 bytes_per_second=853089463\nelapsed_seconds=0.382 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.549 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.125130 bytes_per_second=799168864\nelapsed_seconds=0.390 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.514 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 85795, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.log", + "bytes": 175405, + "ready_signal": "time=\"2026-09-11T23:11:54-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:11:53.935719+00:00", + "stopped_at": "2026-09-12T06:12:03.148882+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 86314, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/tcpdump-arp.log", + "bytes": 335, + "ready_signal": "listening on", + "started_at": "2026-09-12T06:12:04.346431+00:00", + "stopped_at": "2026-09-12T06:12:18.772397+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 87091, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.log", + "bytes": 40519, + "ready_signal": "time=\"2026-09-11T23:12:19-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T06:12:19.907529+00:00", + "stopped_at": "2026-09-12T06:12:23.412315+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/diagnosis-2026-09-12/post-outage" +} diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/destroy.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/destroy.stdout.json b/spikes/ovn/diagnosis-2026-09-12/post-outage/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-probe.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-probe.txt new file mode 100644 index 0000000..b6618f0 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-probe.txt @@ -0,0 +1,700 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:13:8a:9c | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:93:47:ba | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch e25db59d-0868-4890-8296-1cc3888b52d5 (incus-net31-ls-int) + port incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0 + addresses: ["10:66:6a:13:8a:9c dynamic"] + port incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0 + addresses: ["10:66:6a:93:47:ba dynamic"] + port incus-net31-ls-int-lsp-router + type: router + router-port: incus-net31-lr-lrp-int +switch c305d96f-5c86-4b13-be6a-ebaa38c350a1 (incus-net31-ls-ext) + port incus-net31-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net31-ls-ext-lsp-router + type: router + router-port: incus-net31-lr-lrp-ext +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 4368ec4c-faeb-4e66-bb9b-9bb0d8b94c0f (incus-net31-lr) + port incus-net31-lr-lrp-ext + mac: "10:66:6a:ea:40:3b" + ipv6-lla: "fe80::1266:6aff:feea:403b" + networks: ["10.10.40.65/24"] + port incus-net31-lr-lrp-int + mac: "10:66:6a:ea:40:3b" + ipv6-lla: "fe80::1266:6aff:feea:403b" + networks: ["10.253.73.1/24"] + nat e4165050-5b54-49ea-9153-145022af6a9b + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net31-lr-lrp-ext + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : a72199a8-b145-4f7c-9de4-dffb0f793fcf +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ea:40:3b" +name : incus-net31-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 99cbd920-1939-411e-acef-5f10df78cdaf +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 483173e7-91d1-429a-ad49-7145460cb657 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ea:40:3b" +name : incus-net31-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 6a9d4f10-3918-46fd-bef3-0c61f9246ccb +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : c4b0193e-8048-452e-bfdf-4d20fdbbf784 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 156bffda-11c4-4b23-905b-35b5f1554590 +logical_port : cr-incus-net31-lr-lrp-ext +mac : ["10:66:6a:ea:40:3b 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net31-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:ea:40:3b REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193514200754", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04531|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193514200979", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193515200621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04533|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193515200733", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193515258750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04535|poll_loop|INFO|Dropped 12430 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193515258896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04536|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193516073785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04537|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193516073900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04538|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789193516200588", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04539|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193516200682", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193517200923", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04541|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193517201117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193517532345", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04543|bridge|INFO|bridge br-int: added interface vethdb5f20af on port 26" + }, + { + "at": "1789193518200580", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04544|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193518200661", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04545|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193519200701", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04546|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193519200939", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04547|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193520200695", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04548|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193520200839", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04549|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193521200947", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04550|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193521201188", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04551|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193521258696", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04552|poll_loop|INFO|Dropped 12218 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193521258774", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193522200600", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04554|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193522200724", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193523200524", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04556|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193523200728", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193524200945", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04558|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193524201179", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193525201001", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04560|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193525201201", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193526072628", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04562|connmgr|INFO|br-int<->unix#7: 932 flow_mods in the 7 s starting 10 s ago (839 adds, 63 deletes, 30 modifications)" + }, + { + "at": "1789193526200818", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04563|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193526200904", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04564|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193527200651", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04565|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193527200864", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04566|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193527258766", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04567|poll_loop|INFO|Dropped 12057 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193527258811", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04568|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193528200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04569|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193528200998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193529200974", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04571|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193529201173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193530200813", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04573|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193530200936", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193531201098", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04575|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193531201375", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193532200610", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04577|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193532200723", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193533200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04579|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193533201200", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193533258732", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04581|poll_loop|INFO|Dropped 12033 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193533258832", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193534200643", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04583|dpif|WARN|Dropped 1985 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193534200805", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193535200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04585|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193535201297", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193536200749", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04587|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193536200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193537200922", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04589|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193537201155", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193538200922", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04591|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193538201145", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193539200776", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04593|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193539200920", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193539258801", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04595|poll_loop|INFO|Dropped 11982 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193539258964", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516065503", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00156|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516065829", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00157|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16" + }, + { + "at": "1789193526063008", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00158|connmgr|INFO|br-int<->unix#7: 958 flow_mods in the 7 s starting 10 s ago (861 adds, 97 deletes)" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516069547", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00170|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516069809", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00171|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789193518601888", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00172|bridge|INFO|bridge br-int: added interface veth29bf67a9 on port 24" + }, + { + "at": "1789193526067192", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00173|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 10 s ago (870 adds, 94 deletes)" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516063726", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00160|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516064054", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00161|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18" + }, + { + "at": "1789193526056784", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00162|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 7 s starting 10 s ago (877 adds, 96 deletes)" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-teardown.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-teardown.txt new file mode 100644 index 0000000..1db102e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-after-teardown.txt @@ -0,0 +1,690 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:ea:40:3b REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193514200754", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04531|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193514200979", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193515200621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04533|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193515200733", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193515258750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04535|poll_loop|INFO|Dropped 12430 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193515258896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04536|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193516073785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04537|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193516073900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04538|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789193516200588", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04539|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193516200682", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193517200923", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04541|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193517201117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193517532345", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04543|bridge|INFO|bridge br-int: added interface vethdb5f20af on port 26" + }, + { + "at": "1789193518200580", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04544|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193518200661", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04545|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193519200701", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04546|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193519200939", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04547|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193520200695", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04548|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193520200839", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04549|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193521200947", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04550|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193521201188", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04551|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193521258696", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04552|poll_loop|INFO|Dropped 12218 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193521258774", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193522200600", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04554|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193522200724", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193523200524", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04556|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193523200728", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193524200945", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04558|dpif|WARN|Dropped 2006 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193524201179", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04559|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193525201001", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04560|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193525201201", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04561|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193526072628", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04562|connmgr|INFO|br-int<->unix#7: 932 flow_mods in the 7 s starting 10 s ago (839 adds, 63 deletes, 30 modifications)" + }, + { + "at": "1789193526200818", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04563|dpif|WARN|Dropped 2012 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193526200904", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04564|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193527200651", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04565|dpif|WARN|Dropped 2018 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193527200864", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04566|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193527258766", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04567|poll_loop|INFO|Dropped 12057 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193527258811", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04568|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (98% CPU usage)" + }, + { + "at": "1789193528200679", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04569|dpif|WARN|Dropped 1994 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193528200998", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04570|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193529200974", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04571|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193529201173", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04572|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193530200813", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04573|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193530200936", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04574|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193531201098", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04575|dpif|WARN|Dropped 2022 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193531201375", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04576|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193532200610", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04577|dpif|WARN|Dropped 2023 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193532200723", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04578|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193533200929", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04579|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193533201200", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04580|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193533258732", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04581|poll_loop|INFO|Dropped 12033 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193533258832", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04582|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193534200643", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04583|dpif|WARN|Dropped 1985 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193534200805", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04584|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193535200980", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04585|dpif|WARN|Dropped 1997 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193535201297", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04586|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193536200749", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04587|dpif|WARN|Dropped 2007 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193536200899", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04588|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193537200922", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04589|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193537201155", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04590|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193538200922", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04591|dpif|WARN|Dropped 1999 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193538201145", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04592|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193539200776", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04593|dpif|WARN|Dropped 1993 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193539200920", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04594|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193539258801", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04595|poll_loop|INFO|Dropped 11982 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193539258964", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04596|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193540200993", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04597|dpif|WARN|Dropped 1987 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193540201105", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04598|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193540536128", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04599|bridge|INFO|bridge br-int: deleted interface vethdb5f20af on port 26" + }, + { + "at": "1789193541200959", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04600|dpif|WARN|Dropped 1961 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193541201075", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04601|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193542201070", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04602|dpif|WARN|Dropped 2081 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193542201349", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04603|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193542803543", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04604|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193542803678", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04605|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789193543200820", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04606|dpif|WARN|Dropped 2084 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193543200943", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04607|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516065503", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00156|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516065829", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00157|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16" + }, + { + "at": "1789193526063008", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00158|connmgr|INFO|br-int<->unix#7: 958 flow_mods in the 7 s starting 10 s ago (861 adds, 97 deletes)" + }, + { + "at": "1789193542794831", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00159|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193542795097", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00160|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516069547", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00170|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516069809", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00171|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789193518601888", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00172|bridge|INFO|bridge br-int: added interface veth29bf67a9 on port 24" + }, + { + "at": "1789193526067192", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00173|connmgr|INFO|br-int<->unix#7: 964 flow_mods in the 7 s starting 10 s ago (870 adds, 94 deletes)" + }, + { + "at": "1789193541547630", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00174|bridge|INFO|bridge br-int: deleted interface veth29bf67a9 on port 24" + }, + { + "at": "1789193542801310", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00175|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193542801545", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00176|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516063726", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00160|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516064054", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00161|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18" + }, + { + "at": "1789193526056784", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00162|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 7 s starting 10 s ago (877 adds, 96 deletes)" + }, + { + "at": "1789193542803328", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00163|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193542803552", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00164|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-before-probe.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-before-probe.txt new file mode 100644 index 0000000..def7677 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/diagnostics-before-probe.txt @@ -0,0 +1,448 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:13:8a:9c | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:93:47:ba | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch f046d2bd-f4a8-4b32-a828-ca8be5810acd (incus-net25-ls-ext) + port incus-net25-ls-ext-lsp-router + type: router + router-port: incus-net25-lr-lrp-ext + port incus-net25-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +switch e25db59d-0868-4890-8296-1cc3888b52d5 (incus-net31-ls-int) + port incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0 + addresses: ["10:66:6a:13:8a:9c dynamic"] + port incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0 + addresses: ["10:66:6a:93:47:ba dynamic"] + port incus-net31-ls-int-lsp-router + type: router + router-port: incus-net31-lr-lrp-int +switch c305d96f-5c86-4b13-be6a-ebaa38c350a1 (incus-net31-ls-ext) + port incus-net31-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] + port incus-net31-ls-ext-lsp-router + type: router + router-port: incus-net31-lr-lrp-ext +switch 8f57dfa7-81c9-46e3-a2e8-d2a69f506da9 (incus-net25-ls-int) + port incus-net25-ls-int-lsp-router + type: router + router-port: incus-net25-lr-lrp-int +router 4368ec4c-faeb-4e66-bb9b-9bb0d8b94c0f (incus-net31-lr) + port incus-net31-lr-lrp-ext + mac: "10:66:6a:ea:40:3b" + ipv6-lla: "fe80::1266:6aff:feea:403b" + networks: ["10.10.40.65/24"] + port incus-net31-lr-lrp-int + mac: "10:66:6a:ea:40:3b" + ipv6-lla: "fe80::1266:6aff:feea:403b" + networks: ["10.253.73.1/24"] + nat e4165050-5b54-49ea-9153-145022af6a9b + external ip: "10.10.40.65" + logical ip: "10.253.73.0/24" + type: "snat" +router 2eaa7e25-aeb5-4fa9-adac-31c81c57a2fb (incus-net25-lr) + port incus-net25-lr-lrp-int + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.253.72.1/24"] + port incus-net25-lr-lrp-ext + mac: "10:66:6a:70:1e:0b" + ipv6-lla: "fe80::1266:6aff:fe70:1e0b" + networks: ["10.10.40.64/24"] + nat 4ec00a90-5592-43ac-b4ad-64d0ccb37946 + external ip: "10.10.40.64" + logical ip: "10.253.72.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net31-instance-b3dc9179-37ac-4dd9-b893-9081761aa55d-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} + Port_Binding cr-incus-net31-lr-lrp-ext + Port_Binding cr-incus-net25-lr-lrp-ext +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding incus-net31-instance-a2ef682b-00fd-496e-a934-1d1cf3913919-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : a72199a8-b145-4f7c-9de4-dffb0f793fcf +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:ea:40:3b" +name : incus-net31-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 99cbd920-1939-411e-acef-5f10df78cdaf +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 483173e7-91d1-429a-ad49-7145460cb657 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:ea:40:3b" +name : incus-net31-lr-lrp-ext +networks : ["10.10.40.65/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : aaf81b99-01ec-463e-85f2-af131a1a29c8 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : c13b6fd6-e52d-4ac5-bd68-008c146bf1fa +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="c2919898-1135-4799-80cf-860ae7e7ef9e"} + +_uuid : 24771756-817b-4cbd-b664-58fbd3d9a377 +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:70:1e:0b" +name : incus-net25-lr-lrp-int +networks : ["10.253.72.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : 6a9d4f10-3918-46fd-bef3-0c61f9246ccb +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : c4b0193e-8048-452e-bfdf-4d20fdbbf784 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 156bffda-11c4-4b23-905b-35b5f1554590 +logical_port : cr-incus-net31-lr-lrp-ext +mac : ["10:66:6a:ea:40:3b 10.10.40.65/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net31-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] + +_uuid : 023a18f3-acd5-4bb9-a42c-8f493cae24ca +additional_chassis : [] +additional_encap : [] +chassis : 1e4eb895-1d17-4859-9e5b-0454f8482291 +datapath : db7925f7-c524-4a0a-b84c-5ee7aec48844 +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : dc0e73d8-c24e-4f20-8384-5c87ec576925 +logical_port : cr-incus-net25-lr-lrp-ext +mac : ["10:66:6a:70:1e:0b 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net25-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ip neigh === +=== gateway neigh exit=0 === +10.10.40.65 dev br40 lladdr 10:66:6a:ea:40:3b REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193514200754", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04531|dpif|WARN|Dropped 2080 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193514200979", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04532|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193515200621", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04533|dpif|WARN|Dropped 2063 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193515200733", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04534|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193515258750", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04535|poll_loop|INFO|Dropped 12430 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193515258896", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04536|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193516073785", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04537|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 6" + }, + { + "at": "1789193516073900", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04538|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 25" + }, + { + "at": "1789193516200588", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04539|dpif|WARN|Dropped 2100 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193516200682", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04540|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193517200923", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04541|dpif|WARN|Dropped 2074 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193517201117", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04542|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193517532345", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04543|bridge|INFO|bridge br-int: added interface vethdb5f20af on port 26" + }, + { + "at": "1789193518200580", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04544|dpif|WARN|Dropped 1934 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193518200661", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04545|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193519200701", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04546|dpif|WARN|Dropped 2001 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193519200939", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04547|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193520200695", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04548|dpif|WARN|Dropped 2040 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193520200839", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04549|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193521200947", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04550|dpif|WARN|Dropped 2015 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193521201188", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04551|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193521258696", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04552|poll_loop|INFO|Dropped 12218 log messages in last 6 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193521258774", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04553|poll_loop|INFO|wakeup due to [POLLIN] on fd 14 (NETLINK_ROUTE<->NETLINK_ROUTE) at ../lib/netlink-socket.c:1419 (99% CPU usage)" + }, + { + "at": "1789193522200600", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04554|dpif|WARN|Dropped 2011 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193522200724", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04555|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + }, + { + "at": "1789193523200524", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04556|dpif|WARN|Dropped 1990 log messages in last 1 seconds (most recently, 0 seconds ago) due to excessive rate" + }, + { + "at": "1789193523200728", + "member": "lab01.glab.lol", + "boot_id": "f9f71dd5a051466283d7da6fb860c528", + "message": "ovs|04557|dpif|WARN|system@ovs-system: failed to add fast40 as port: Device or resource busy" + } +] + +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516065503", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00156|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516065829", + "member": "lab02.glab.lol", + "boot_id": "81e2acca155f4ac99c2a077d9ac72583", + "message": "ovs|00157|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 16" + } +] + +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516069547", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00170|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516069809", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00171|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 23" + }, + { + "at": "1789193518601888", + "member": "lab03.glab.lol", + "boot_id": "3c8c53f2fe38435e99abb369646320e0", + "message": "ovs|00172|bridge|INFO|bridge br-int: added interface veth29bf67a9 on port 24" + } +] + +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789193516063726", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00160|bridge|INFO|bridge incusovn16: added interface patch-incus-net31-ls-ext-lsp-provider-to-br-int on port 7" + }, + { + "at": "1789193516064054", + "member": "nas01.glab.lol", + "boot_id": "1829964eb02542619d82dc594bc2b5d3", + "message": "ovs|00161|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net31-ls-ext-lsp-provider on port 18" + } +] + diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.debug.log b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.debug.log new file mode 100644 index 0000000..9e8a60e --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:11:54-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.log b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.log new file mode 100644 index 0000000..c3974db --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-create.log @@ -0,0 +1,540 @@ +time="2026-09-12T06:11:54Z" level=debug msg="[nas01] Event listener server handler started" id=95834218-8d6c-4cb4-9b46-9265c35229e2 local="10.10.10.14:8443" remote="100.122.142.76:63630" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63648" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63649" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63650" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63651" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63652" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63653" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63654" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63655" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:55Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63656" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63657" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:ea:40:3b" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.31 +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net31 driver=ovn memberID=1 network=default priority=31093 project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 3598189,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.65]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63658" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63659" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63660" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63661" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63662" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63663" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63664" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63665" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63666" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Event listener server handler started" id=6323aceb-68eb-4689-923b-4286239c22b7 local="10.10.10.14:8443" remote="100.122.142.76:63666" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63667" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=695e5553-af51-4b12-a93d-39756412d0d5 project=image-build +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=695e5553-af51-4b12-a93d-39756412d0d5 project=image-build +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 voter} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 stand-by} lab03}]" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63668" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Event listener server handler started" id=13147ae7-0702-4270-b811-0a36e20b3404 local="10.10.10.14:8443" remote="100.122.142.76:63668" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63669" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=966b47a4-e563-4648-a3b0-c7e9dd49402e project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=966b47a4-e563-4648-a3b0-c7e9dd49402e project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=966b47a4-e563-4648-a3b0-c7e9dd49402e project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T06:11:56Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=966b47a4-e563-4648-a3b0-c7e9dd49402e project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63670" method=GET protocol=tls url="/1.0/operations/966b47a4-e563-4648-a3b0-c7e9dd49402e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Event listener server handler stopped" listener=6323aceb-68eb-4689-923b-4286239c22b7 local="10.10.10.14:8443" remote="100.122.142.76:63666" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Event listener server handler stopped" listener=13147ae7-0702-4270-b811-0a36e20b3404 local="10.10.10.14:8443" remote="100.122.142.76:63668" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63671" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63672" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"e7062a93-5fa0-48f0-9dc4-a956453c4f4c\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:11:56.785640768Z\",\n\t\t\"updated_at\": \"2026-09-12T06:11:56.785640768Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:11:56Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63673" method=GET protocol=tls url="/1.0/operations/e7062a93-5fa0-48f0-9dc4-a956453c4f4c/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:56Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:56Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63674" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63675" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Event listener server handler started" id=8f7cd67e-f385-43d9-a2d0-ff51a33e0037 local="10.10.10.14:8443" remote="100.122.142.76:63676" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63676" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63677" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:57Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 06:11:56.84514287 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63678" method=GET protocol=tls url="/1.0/operations/7c5d827c-0ddc-460e-aad4-0318f9ed8953?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:57Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 06:11:56.84514287 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Event listener server handler stopped" listener=8f7cd67e-f385-43d9-a2d0-ff51a33e0037 local="10.10.10.14:8443" remote="100.122.142.76:63676" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:57Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63679" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63680" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.65 network=default project=ac-ovn-spike +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"41e0a52f-e0be-426e-843a-46df14b99abc\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T06:11:58.022277137Z\",\n\t\t\"updated_at\": \"2026-09-12T06:11:58.022277137Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63681" method=GET protocol=tls url="/1.0/operations/41e0a52f-e0be-426e-843a-46df14b99abc/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:11:58Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63682" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63683" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63684" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Event listener server handler started" id=b4d96c97-cec1-4908-a7e4-73a4d5a2f1ad local="10.10.10.14:8443" remote="100.122.142.76:63684" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63685" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 06:11:58.070081651 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63686" method=GET protocol=tls url="/1.0/operations/cd4ae7aa-8314-4417-b7db-7fbdacd65ee7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T06:11:58Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 06:11:58.070081651 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b4d96c97-cec1-4908-a7e4-73a4d5a2f1ad local="10.10.10.14:8443" remote="100.122.142.76:63684" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63687" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63688" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:58Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63689" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63690" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63691" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63692" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63693" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63694" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63695" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63696" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Event listener server handler started" id=ad794dc0-fe9a-472d-8e35-da5c726af7bb local="10.10.10.14:8443" remote="100.122.142.76:63696" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63697" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63699" method=GET protocol=tls url="/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=059880c78ba226cf8aedb5d6b4c181b253f4496c9ff498cbdd37ae03091dba19" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63699" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=059880c78ba226cf8aedb5d6b4c181b253f4496c9ff498cbdd37ae03091dba19" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63700" method=GET protocol=tls url="/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=6b9e58d3e6fdf712139d5147867e9e57b37e57d09fadf7479ca8b26af4fb6280" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=6b9e58d3e6fdf712139d5147867e9e57b37e57d09fadf7479ca8b26af4fb6280" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63700" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63701" method=GET protocol=tls url="/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=e86dd3f27ffb118802e523af84972945eca134fa6f9a214d3c6f879fe54f41e7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63701" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=e86dd3f27ffb118802e523af84972945eca134fa6f9a214d3c6f879fe54f41e7" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63702" method=GET protocol=tls url="/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=765895cefffe8ab594833a5eb9b35133b7fdf0723f103da09e61abcf67819749" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63702" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd/websocket?secret=765895cefffe8ab594833a5eb9b35133b7fdf0723f103da09e61abcf67819749" +time="2026-09-12T06:11:59Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63700" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63699" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63701" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63702" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63703" method=GET protocol=tls url="/1.0/operations/5936fee1-2489-4cea-88e9-222a8a18b5fd?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ad794dc0-fe9a-472d-8e35-da5c726af7bb local="10.10.10.14:8443" remote="100.122.142.76:63696" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63704" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63705" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63707" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63708" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Event listener server handler started" id=572cf5b3-9a57-4d1a-8d23-8cd48a7de301 local="10.10.10.14:8443" remote="100.122.142.76:63708" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63709" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63710" method=GET protocol=tls url="/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=4ca19ee9a0d3053772da9ff4d174c2db91d00fae963fe36cf38da715084973b3" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=4ca19ee9a0d3053772da9ff4d174c2db91d00fae963fe36cf38da715084973b3" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63710" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63711" method=GET protocol=tls url="/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=a651a9613305a63d8ad4cfba2c04462d05e613a88ff1b05d0d726026aea3d56e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63711" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=a651a9613305a63d8ad4cfba2c04462d05e613a88ff1b05d0d726026aea3d56e" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63716" method=GET protocol=tls url="/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=8dfe7e5fb533435cdd253c8fcc12cd6ae05bdb462db3bc0dbcfd39feba0e8e50" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63716" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=8dfe7e5fb533435cdd253c8fcc12cd6ae05bdb462db3bc0dbcfd39feba0e8e50" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63717" method=GET protocol=tls url="/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=08fe1214ebe1db843200178cee20a9ff915ac333939f3cf929777e8c06c65f5c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778/websocket?secret=08fe1214ebe1db843200178cee20a9ff915ac333939f3cf929777e8c06c65f5c" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63717" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63711" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63718" method=GET protocol=tls url="/1.0/operations/846018f5-63a6-43ab-a80c-5c2979fa3778?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63710" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63716" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63717" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Event listener server handler stopped" listener=572cf5b3-9a57-4d1a-8d23-8cd48a7de301 local="10.10.10.14:8443" remote="100.122.142.76:63708" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63719" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Event listener server handler started" id=916ea8c6-7763-4416-8fbb-3c982b0ce281 local="10.10.10.14:8443" remote="100.122.142.76:63720" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63720" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63721" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63722" method=GET protocol=tls url="/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=7d79378838275b46452360f5948c918527face6cf389a89ea3509295439bcd6a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63722" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=7d79378838275b46452360f5948c918527face6cf389a89ea3509295439bcd6a" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63723" method=GET protocol=tls url="/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=cb2f6db73b43156e0f40ab0bf2900219be9e9dd4f9c49dd055910794fe58fd31" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63723" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=cb2f6db73b43156e0f40ab0bf2900219be9e9dd4f9c49dd055910794fe58fd31" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63724" method=GET protocol=tls url="/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=7199f1bd7577599301209523cbaa4957fad5a785ce376ab69bfb06ab60b14694" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63724" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=7199f1bd7577599301209523cbaa4957fad5a785ce376ab69bfb06ab60b14694" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63725" method=GET protocol=tls url="/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=37a0089eb50b4f5c4c067ecb99953dbba1d026f929ef03dd778f18d575793751" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63725" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb/websocket?secret=37a0089eb50b4f5c4c067ecb99953dbba1d026f929ef03dd778f18d575793751" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63723" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63726" method=GET protocol=tls url="/1.0/operations/ea7bd98b-dfcc-4154-884b-962cb4b79afb?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63722" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63724" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63725" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Event listener server handler stopped" listener=916ea8c6-7763-4416-8fbb-3c982b0ce281 local="10.10.10.14:8443" remote="100.122.142.76:63720" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63729" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63730" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:00Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63731" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63732" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Event listener server handler started" id=425e6e85-d236-49dc-a3c5-33341e721f7c local="10.10.10.14:8443" remote="100.122.142.76:63732" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63733" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63734" method=GET protocol=tls url="/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=36c9b4cf092d6384fa0a96a9cd135f5b90497014ec6e6bae657b413e867736d1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=36c9b4cf092d6384fa0a96a9cd135f5b90497014ec6e6bae657b413e867736d1" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63734" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63735" method=GET protocol=tls url="/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=a12df8b30d43a51f30ab7830fa40dfd133d1460077af4f11c177a1dbf698ab89" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=a12df8b30d43a51f30ab7830fa40dfd133d1460077af4f11c177a1dbf698ab89" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63735" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63736" method=GET protocol=tls url="/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=84581e2006b517cb41d8c3bc318b66fae92ff47d332279bff423d3c41714f9ec" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63736" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=84581e2006b517cb41d8c3bc318b66fae92ff47d332279bff423d3c41714f9ec" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63737" method=GET protocol=tls url="/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=5900c9870ffb6c6013121bf5a309f7185b782f95ee8492b202cc3357a9fddcea" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63737" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298/websocket?secret=5900c9870ffb6c6013121bf5a309f7185b782f95ee8492b202cc3357a9fddcea" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63735" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63738" method=GET protocol=tls url="/1.0/operations/93a7feb7-bfa2-4c95-ab4c-ca2230d0f298?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63734" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63736" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63737" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=425e6e85-d236-49dc-a3c5-33341e721f7c local="10.10.10.14:8443" remote="100.122.142.76:63732" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63739" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63740" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Event listener server handler started" id=7cc1b9b5-2ed8-468b-b1d8-62ec33534a7e local="10.10.10.14:8443" remote="100.122.142.76:63740" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63741" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63742" method=GET protocol=tls url="/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=89c02e618d08315a984b41f3f7c98f131f51bb831cb95f797571e4e1eb21af55" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=89c02e618d08315a984b41f3f7c98f131f51bb831cb95f797571e4e1eb21af55" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63742" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63743" method=GET protocol=tls url="/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=772036a046f4657752479e96d8acba31a85e88d4fa3318fbd778ee8d809599f1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63743" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=772036a046f4657752479e96d8acba31a85e88d4fa3318fbd778ee8d809599f1" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63744" method=GET protocol=tls url="/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=7b87a5fa5edf38badf88f8ae214ffe22374a3554ff9178ba0c3f21a0e86480f6" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63744" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=7b87a5fa5edf38badf88f8ae214ffe22374a3554ff9178ba0c3f21a0e86480f6" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63745" method=GET protocol=tls url="/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=cc7bd2afc789f62ee754a88fcb60917d9828803cadfd7645f7f234847c517cab" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63745" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24/websocket?secret=cc7bd2afc789f62ee754a88fcb60917d9828803cadfd7645f7f234847c517cab" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63743" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63746" method=GET protocol=tls url="/1.0/operations/12a64ae1-5c26-4be1-a75a-fa7672ee4e24?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63742" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63744" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63745" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Event listener server handler stopped" listener=7cc1b9b5-2ed8-468b-b1d8-62ec33534a7e local="10.10.10.14:8443" remote="100.122.142.76:63740" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63747" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Event listener server handler started" id=4dbd3ae3-914b-4ddd-8cc6-a5b369f3a956 local="10.10.10.14:8443" remote="100.122.142.76:63748" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63748" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63749" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63750" method=GET protocol=tls url="/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=ac2045ca5a80f5bb9c27a2d2ab03cb8904f8c2f02a735f2fbcfb2c8ac896f1fb" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=ac2045ca5a80f5bb9c27a2d2ab03cb8904f8c2f02a735f2fbcfb2c8ac896f1fb" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63750" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63751" method=GET protocol=tls url="/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=0d192867561903fe2a48025896521b46cb81c6a99242ef52ddf95663cd12607e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63751" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=0d192867561903fe2a48025896521b46cb81c6a99242ef52ddf95663cd12607e" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63752" method=GET protocol=tls url="/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=3c25a4f9c51ac7bab67854e47882a177ddb87bfe532f859ccfc63e27237da2f0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63752" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=3c25a4f9c51ac7bab67854e47882a177ddb87bfe532f859ccfc63e27237da2f0" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63753" method=GET protocol=tls url="/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=90c03221a3f70c337194393220affbc1266c2bf694ca6d0831514b2341e40470" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b/websocket?secret=90c03221a3f70c337194393220affbc1266c2bf694ca6d0831514b2341e40470" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:63753" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63751" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63754" method=GET protocol=tls url="/1.0/operations/c4906a28-2715-4529-b26f-c9b810416b4b?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:01Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63752" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63750" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:63753" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Event listener server handler stopped" listener=4dbd3ae3-914b-4ddd-8cc6-a5b369f3a956 local="10.10.10.14:8443" remote="100.122.142.76:63748" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63755" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63756" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Event listener server handler started" id=1a1d7e8c-7719-4c61-98e1-346a496f5145 local="10.10.10.14:8443" remote="100.122.142.76:63756" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63757" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63758" method=GET protocol=tls url="/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=a699ce23212c2b10a148b27f6f1ddb04a1b164d61a33d62d4412ff16b6f81012" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=a699ce23212c2b10a148b27f6f1ddb04a1b164d61a33d62d4412ff16b6f81012" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63758" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63759" method=GET protocol=tls url="/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=abcef646ccb38a58e53eecad7882ef18a44cccd41d64a7dcbc710e3a520c07f9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=abcef646ccb38a58e53eecad7882ef18a44cccd41d64a7dcbc710e3a520c07f9" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63759" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63760" method=GET protocol=tls url="/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=60d9d6befec47fcab5c86fdbbf90be0f54fcf5ffcb1600139c87fb08c2beb2b0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=60d9d6befec47fcab5c86fdbbf90be0f54fcf5ffcb1600139c87fb08c2beb2b0" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63760" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63761" method=GET protocol=tls url="/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=d2eb7633571664bfb9b99a36a20fcf326487291ca168cdb4557c728d531d72c8" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:63761" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08/websocket?secret=d2eb7633571664bfb9b99a36a20fcf326487291ca168cdb4557c728d531d72c8" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63759" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63762" method=GET protocol=tls url="/1.0/operations/b6e4be1d-71bc-4ce0-bc5c-4a871e9b5b08?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63758" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63761" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:63760" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Event listener server handler stopped" listener=1a1d7e8c-7719-4c61-98e1-346a496f5145 local="10.10.10.14:8443" remote="100.122.142.76:63756" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63763" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63764" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:02Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to create \"networks_forwards\" entry: database is locked" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T06:12:03Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.debug.log b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.debug.log new file mode 100644 index 0000000..d010693 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-11T23:12:19-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.log b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.log new file mode 100644 index 0000000..9030d44 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/monitor-delete.log @@ -0,0 +1,168 @@ +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Event listener server handler started" id=1e247107-2703-4af2-bc8e-e3b7ff4dc0a2 local="10.10.10.14:8443" remote="100.122.142.76:63925" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63930" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63931" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63932" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63933" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:11:56.84514287Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:11:57.82617521Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T06:11:58.070081651Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T06:11:58.679760489Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63934" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63935" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63936" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Event listener server handler started" id=b57693fd-2df8-409a-92b0-a2d1d91eff69 local="10.10.10.14:8443" remote="100.122.142.76:63936" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63937" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:20Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 06:11:56.84514287 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:11:57.82617521 +0000 UTC" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63938" method=GET protocol=tls url="/1.0/operations/f24c4ed4-754d-47dd-ba15-52643caf0a47?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:20Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63939" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 06:11:56.84514287 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:11:57.82617521 +0000 UTC" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63940" method=GET protocol=tls url="/1.0/operations/498d4af4-72af-4167-a675-0c86995b0e8e?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 06:11:56.84514287 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 06:11:57.82617521 +0000 UTC" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b57693fd-2df8-409a-92b0-a2d1d91eff69 local="10.10.10.14:8443" remote="100.122.142.76:63936" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63941" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63942" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63943" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Event listener server handler started" id=992bf0c8-597d-47eb-9e36-68d13754e177 local="10.10.10.14:8443" remote="100.122.142.76:63943" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63944" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T06:12:21Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 06:11:58.070081651 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 06:11:58.679760489 +0000 UTC" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63945" method=GET protocol=tls url="/1.0/operations/e2a4e72a-15a3-4981-8fbe-f491f48c885d?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:21Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63946" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 06:11:58.070081651 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:11:58.679760489 +0000 UTC" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63947" method=GET protocol=tls url="/1.0/operations/9d9ab23a-7f60-4113-84a2-7b8c64a61a0a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 06:11:58.070081651 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 06:11:58.679760489 +0000 UTC" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Event listener server handler stopped" listener=992bf0c8-597d-47eb-9e36-68d13754e177 local="10.10.10.14:8443" remote="100.122.142.76:63943" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63948" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63949" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63950" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63951" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63952" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63953" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63954" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63955" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Completed heartbeat round" duration=6.241214168s +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63956" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:22Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63957" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63958" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63959" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63960" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63961" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63962" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63963" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63964" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Event listener server handler started" id=6d4fc5d1-6a04-4e13-a210-2d9ac20af279 local="10.10.10.14:8443" remote="100.122.142.76:63964" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63965" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=29ab9069-2ef9-49a2-b887-e239fff20ba6 project=ac-ovn-spike +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=29ab9069-2ef9-49a2-b887-e239fff20ba6 project=ac-ovn-spike +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=29ab9069-2ef9-49a2-b887-e239fff20ba6 project=ac-ovn-spike +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63966" method=GET protocol=tls url="/1.0/operations/29ab9069-2ef9-49a2-b887-e239fff20ba6?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Event listener server handler stopped" listener=6d4fc5d1-6a04-4e13-a210-2d9ac20af279 local="10.10.10.14:8443" remote="100.122.142.76:63964" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63967" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T06:12:23Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:63968" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/probe.stderr.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/probe.stdout.txt b/spikes/ovn/diagnosis-2026-09-12/post-outage/probe.stdout.txt new file mode 100644 index 0000000..ce41986 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/probe.stdout.txt @@ -0,0 +1,137 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.094 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.65 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab02 + - lab03 + - nas01 + - lab01 +project: ac-ovn-spike +elapsed_seconds=0.109 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"9f925685-4e2f-4e43-877e-aa36540e607f","volatile.eth0.host_name":"vethdb5f20af","volatile.eth0.hwaddr":"10:66:6a:13:8a:9c","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"a2ef682b-00fd-496e-a934-1d1cf3913919","volatile.uuid.generation":"a2ef682b-00fd-496e-a934-1d1cf3913919"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:11:56.84514287Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"9f925685-4e2f-4e43-877e-aa36540e607f","volatile.eth0.host_name":"vethdb5f20af","volatile.eth0.hwaddr":"10:66:6a:13:8a:9c","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"a2ef682b-00fd-496e-a934-1d1cf3913919","volatile.uuid.generation":"a2ef682b-00fd-496e-a934-1d1cf3913919"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:11:57.82617521Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":9498624,"usage_peak":0,"total":65256732000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe13:8a9c","netmask":"64","scope":"link"}],"counters":{"bytes_received":898,"bytes_sent":1410,"packets_received":5,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:13:8a:9c","host_name":"vethdb5f20af","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":4075783,"processes":4,"cpu":{"usage":479353000,"allocated_time":24000000000},"started_at":"2026-09-12T06:11:56.839999914Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"46e1a74c-d365-4537-8f0f-366dea51cfe7","volatile.eth0.host_name":"veth29bf67a9","volatile.eth0.hwaddr":"10:66:6a:93:47:ba","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"b3dc9179-37ac-4dd9-b893-9081761aa55d","volatile.uuid.generation":"b3dc9179-37ac-4dd9-b893-9081761aa55d"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T06:11:58.070081651Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"46e1a74c-d365-4537-8f0f-366dea51cfe7","volatile.eth0.host_name":"veth29bf67a9","volatile.eth0.hwaddr":"10:66:6a:93:47:ba","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"b3dc9179-37ac-4dd9-b893-9081761aa55d","volatile.uuid.generation":"b3dc9179-37ac-4dd9-b893-9081761aa55d"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T06:11:58.679760489Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":12304384,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe93:47ba","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1340,"packets_received":6,"packets_sent":10,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:93:47:ba","host_name":"veth29bf67a9","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":16037,"processes":4,"cpu":{"usage":493455000,"allocated_time":24000000000},"started_at":"2026-09-12T06:11:58.690000057Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.122 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.452 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.256 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.372 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=0.641 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.417 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.417/0.810/1.372 ms +elapsed_seconds=2.242 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.322 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=1.078 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.375 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.375/0.925/1.322 ms +elapsed_seconds=2.282 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.725 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.828 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.125 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 1.125/1.559/1.828 ms +elapsed_seconds=2.205 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.515 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.736 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.051 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 1.051/1.434/1.736 ms +elapsed_seconds=2.380 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Non-authoritative answer: +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +Non-authoritative answer: +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +elapsed_seconds=0.489 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 2606:4700:10::6814:179a +Name: example.com +Address: 2606:4700:10::ac42:93f3 + +Name: example.com +Address: 172.66.147.243 +Name: example.com +Address: 104.20.23.154 + +elapsed_seconds=0.268 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.346 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.397 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.031 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.117221 bytes_per_second=853089463 +elapsed_seconds=0.382 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.549 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.125130 bytes_per_second=799168864 +elapsed_seconds=0.390 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.514 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/tcpdump-arp.log b/spikes/ovn/diagnosis-2026-09-12/post-outage/tcpdump-arp.log new file mode 100644 index 0000000..d42f1ea --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/tcpdump-arp.log @@ -0,0 +1,4 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +06:12:12.061566 10:66:6a:ea:40:3b > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.65 tell 10.10.40.65, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/diagnosis-2026-09-12/post-outage/topology.jsonl b/spikes/ovn/diagnosis-2026-09-12/post-outage/topology.jsonl new file mode 100644 index 0000000..b4ccec3 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/post-outage/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.107, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.1, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/keeper\"\n\t]\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.1, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.403, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.306, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.097, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.1, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.261, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.633, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:11:56.785640768Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"e7062a93-5fa0-48f0-9dc4-a956453c4f4c\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:11:56.785640768Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.615, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.445, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T06:11:58.022277137Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"41e0a52f-e0be-426e-843a-46df14b99abc\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T06:11:58.022277137Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.385, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.207, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 144213000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256732000,\n\t\t\"usage\": 5853184,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe13:8a9c\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"vethdb5f20af\",\n\t\t\t\"hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 4075783,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:11:56.839999914Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.216, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 129722000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6819840,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe93:47ba\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"veth29bf67a9\",\n\t\t\t\"hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 16037,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T06:11:58.690000057Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.098, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t},\n\t\"created_at\": \"2026-09-12T06:11:56.84514287Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:11:57.82617521Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.099, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t},\n\t\"created_at\": \"2026-09-12T06:11:58.070081651Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T06:11:58.679760489Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.648, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.633 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.633/1.633/1.633 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.362, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.192, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.288, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.379, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-soqb62vw/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.198, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.318, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.551, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.024961 seconds, 3.7GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.52, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.026553 seconds, 3.5GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.333, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.096, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 20\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.115, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:11:56.84514287Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"9f925685-4e2f-4e43-877e-aa36540e607f\",\n\t\t\t\"volatile.eth0.host_name\": \"vethdb5f20af\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:13:8a:9c\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\",\n\t\t\t\"volatile.uuid.generation\": \"a2ef682b-00fd-496e-a934-1d1cf3913919\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:11:57.82617521Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T06:11:58.070081651Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"46e1a74c-d365-4537-8f0f-366dea51cfe7\",\n\t\t\t\"volatile.eth0.host_name\": \"veth29bf67a9\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:93:47:ba\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\",\n\t\t\t\"volatile.uuid.generation\": \"b3dc9179-37ac-4dd9-b893-9081761aa55d\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T06:11:58.679760489Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.006, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.998, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.105, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.65\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.154, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.18, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.134, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.095, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T06:11:58.110085316Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T06:11:56.642469265Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.14, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.112, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/diagnosis-2026-09-12/reboot-comparison.json b/spikes/ovn/diagnosis-2026-09-12/reboot-comparison.json new file mode 100644 index 0000000..f77cf8c --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/reboot-comparison.json @@ -0,0 +1,84 @@ +{ + "reboot": { + "old_boot_id": "f9f71dd5a051466283d7da6fb860c528", + "new_boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "status": "Online", + "seconds": 146.549, + "observed_non_online": true + }, + "before_environment": { + "server_name": "lab01", + "server_version": "7.4", + "os_version": "202608242359", + "kernel_version": "7.1.10-zabbly+" + }, + "after_environment": { + "server_name": "lab01", + "server_version": "7.4", + "os_version": "202609100026", + "kernel_version": "7.2.4-zabbly+" + }, + "software_version_changed": true, + "soak_before": { + "name": "soak01", + "status": "Running", + "location": "lab01", + "expanded_devices": { + "eth0": { + "name": "eth0", + "network": "incusbr0", + "type": "nic" + }, + "eth1": { + "nictype": "macvlan", + "parent": "fast40", + "type": "nic" + }, + "root": { + "path": "/", + "pool": "data", + "type": "disk" + } + } + }, + "soak_after": { + "name": "soak01", + "status": "Running", + "location": "lab01", + "expanded_devices": { + "eth0": { + "name": "eth0", + "network": "incusbr0", + "type": "nic" + }, + "eth1": { + "nictype": "macvlan", + "parent": "fast40", + "type": "nic" + }, + "root": { + "path": "/", + "pool": "data", + "type": "disk" + } + } + }, + "soak_nic_before": { + "status": "Running", + "eth1": { + "state": "up", + "host_name": "fast40", + "mtu": 1500, + "type": "broadcast" + } + }, + "soak_nic_after": { + "status": "Running", + "eth1": { + "state": "up", + "host_name": "fast40", + "mtu": 1500, + "type": "broadcast" + } + } +} diff --git a/spikes/ovn/diagnosis-2026-09-12/reboot-receipts/65686d41dfd8cce6c1216567a54bb1099e152466563215683b70a371b26991ec b/spikes/ovn/diagnosis-2026-09-12/reboot-receipts/65686d41dfd8cce6c1216567a54bb1099e152466563215683b70a371b26991ec new file mode 100644 index 0000000..b2bac06 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/reboot-receipts/65686d41dfd8cce6c1216567a54bb1099e152466563215683b70a371b26991ec @@ -0,0 +1 @@ +{"remote":"nas01","request_id":"phase3-recreate-lab01-20260912","status":"accepted","target":"lab01"} \ No newline at end of file diff --git a/spikes/ovn/diagnosis-2026-09-12/reboot-watch/commands.jsonl b/spikes/ovn/diagnosis-2026-09-12/reboot-watch/commands.jsonl new file mode 100644 index 0000000..53477c5 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/reboot-watch/commands.jsonl @@ -0,0 +1,58 @@ +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.111, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 20s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:56:49.708858+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.102, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:56:49.811897+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.118, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 25s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:56:54.935737+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.106, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:56:55.041633+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.101, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 31s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:00.144001+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.106, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:00.250112+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.084, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 36s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:05.342567+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.104, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:05.446810+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.11, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 41s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:10.566307+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.127, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:10.694116+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.159, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 46s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:15.858638+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.114, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:15.973374+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.107, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 52s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:21.086379+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.108, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:21.195218+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.133, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 57s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:26.333524+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.094, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:26.428218+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.093, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m2s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:31.525993+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.09, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:31.616480+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.105, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m7s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:36.727163+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.097, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:36.824276+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.102, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m12s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:41.934221+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.099, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:42.033697+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.164, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m18s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:47.203209+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.091, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:47.294714+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.154, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m23s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:52.458848+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.101, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:52.560270+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.105, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m28s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:57:57.671596+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.097, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:57:57.769498+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.119, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m33s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:02.893960+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.103, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:02.996917+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.096, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m39s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:08.098967+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.103, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:08.202274+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.185, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m44s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:13.393382+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.097, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:13.490798+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.115, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m49s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:18.611461+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.106, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:18.717403+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.186, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 1m54s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:23.908899+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.092, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:24.000883+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.108, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m0s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:29.114757+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.113, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:29.228116+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.087, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m5s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:34.317130+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.105, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:34.422655+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.09, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m10s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:39.517729+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.09, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:39.608194+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.109, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m15s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:44.722726+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.094, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:44.816854+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.097, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m20s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:49.919194+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.099, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:50.018721+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.149, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m26s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:58:55.173335+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.095, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:58:55.268310+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.12, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m31s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:59:00.393720+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.093, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:59:00.487345+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.109, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m36s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:59:05.601082+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.09, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:59:05.691312+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.092, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": false,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"No heartbeat for 2m41s (2026-09-12 15:56:29 +0000)\",\n\t\"roles\": [],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Offline\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:59:10.783861+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.106, "exit_code": 1, "stdout": "", "stderr": "Error: Cluster member \"lab01\" is offline\n", "error": "Error: Cluster member \"lab01\" is offline", "at": "2026-09-12T15:59:10.890316+00:00"} +{"command": ["incus", "query", "nas01:/1.0/cluster/members/lab01"], "seconds": 0.093, "exit_code": 0, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {},\n\t\"database\": true,\n\t\"description\": \"\",\n\t\"failure_domain\": \"default\",\n\t\"groups\": [\n\t\t\"default\"\n\t],\n\t\"message\": \"Fully operational\",\n\t\"roles\": [\n\t\t\"database-standby\"\n\t],\n\t\"server_name\": \"lab01\",\n\t\"status\": \"Online\",\n\t\"url\": \"https://10.10.10.11:8443\"\n}\n\n", "stderr": "", "error": null, "at": "2026-09-12T15:59:15.988869+00:00"} +{"command": ["incus", "query", "nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&entries=1"], "seconds": 0.156, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789228750136242\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00042|connmgr|INFO|br-int<->unix#3: 35 flow_mods 10 s ago (34 adds, 1 deletes)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T15:59:16.145297+00:00", "stdout_projection": "OVS journal timestamp, host, boot ID, message; unrelated metadata omitted"} diff --git a/spikes/ovn/diagnosis-2026-09-12/reboot-watch/reboot.json b/spikes/ovn/diagnosis-2026-09-12/reboot-watch/reboot.json new file mode 100644 index 0000000..8fb3e47 --- /dev/null +++ b/spikes/ovn/diagnosis-2026-09-12/reboot-watch/reboot.json @@ -0,0 +1,7 @@ +{ + "old_boot_id": "f9f71dd5a051466283d7da6fb860c528", + "new_boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "status": "Online", + "seconds": 146.549, + "observed_non_online": true +} diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/commands.jsonl b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/commands.jsonl new file mode 100644 index 0000000..7c4680f --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/commands.jsonl @@ -0,0 +1,40 @@ +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "true"], "seconds": 0.09, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T17:12:46.475128+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "true"], "seconds": 0.247, "exit_code": 0, "stdout": "", "stderr": "", "error": null, "at": "2026-09-12T17:12:46.722931+00:00"} +{"command": ["incus", "project", "show", "nas01:ac-ovn-spike"], "seconds": 0.087, "exit_code": 1, "stdout": "", "stderr": "Error: Project not found\n", "error": "Error: Project not found", "at": "2026-09-12T17:12:46.809888+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-create", "pid": 49344, "ready": true, "ready_signal": "time=\"2026-09-12T10:12:46-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T17:12:46.893597+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/topology.jsonl", "create"], "seconds": 7.907, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"network\": \"default\",\n \"subnet\": \"10.253.73.1/24\",\n \"uplink\": \"fast40-uplink\",\n \"central\": \"10.10.40.10\",\n \"external_ip\": \"10.10.40.64\",\n \"network_create_seconds\": 0.669,\n \"first_cross_member_ping_seconds\": 2.842,\n \"instances\": {\n \"one\": {\n \"location\": \"lab01\",\n \"ipv4\": \"10.253.73.2\"\n },\n \"two\": {\n \"location\": \"lab03\",\n \"ipv4\": \"10.253.73.3\"\n }\n },\n \"forward\": {\n \"listen\": \"10.10.40.79\",\n \"port\": 8080,\n \"target\": \"one\",\n \"target_ipv4\": \"10.253.73.2\",\n \"marker\": \"ovn-spike-ok\",\n \"url\": \"http://10.10.40.79:8080/index.html\"\n },\n \"large_file\": {\n \"path\": \"/large.bin\",\n \"bytes\": 100000000,\n \"sha256\": \"a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae\",\n \"listen_port\": 8080,\n \"guest_urls\": {\n \"one\": \"http://10.253.73.2:8080/large.bin\",\n \"two\": \"http://10.253.73.3:8080/large.bin\"\n }\n }\n}\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:54.801393+00:00"} +{"capture": "monitor-create", "pid": 49344, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.log", "ready_signal": "time=\"2026-09-12T10:12:46-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T17:12:54.806348+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.093, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:54.900497+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.086, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:02:dd:b1 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:35:90:e5 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:54.987105+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.121, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 2fabcc2c-8c19-4664-9b37-fc7eae2922d3 (incus-net39-ls-int)\n port incus-net39-ls-int-lsp-router\n type: router\n router-port: incus-net39-lr-lrp-int\n port incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0\n addresses: [\"10:66:6a:02:dd:b1 dynamic\"]\n port incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0\n addresses: [\"10:66:6a:35:90:e5 dynamic\"]\nswitch a755c7f5-f0d6-4322-a17b-271a274a21da (incus-net39-ls-ext)\n port incus-net39-ls-ext-lsp-router\n type: router\n router-port: incus-net39-lr-lrp-ext\n port incus-net39-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter 498600bd-50df-49c1-ab2c-3843a2479f5c (incus-net39-lr)\n port incus-net39-lr-lrp-int\n mac: \"10:66:6a:66:eb:74\"\n ipv6-lla: \"fe80::1266:6aff:fe66:eb74\"\n networks: [\"10.253.73.1/24\"]\n port incus-net39-lr-lrp-ext\n mac: \"10:66:6a:66:eb:74\"\n ipv6-lla: \"fe80::1266:6aff:fe66:eb74\"\n networks: [\"10.10.40.64/24\"]\n nat 317a50de-d456-4a6c-ae06-7587737357a5\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net39-lr-lrp-ext\n Port_Binding incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 8d438d4a-dc31-4873-8526-52a5346b882f\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:66:eb:74\"\nname : incus-net39-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 973cf967-a8ef-42b9-859d-0c8cecb865fe\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 54c3b455-e298-4244-96f5-74f35ecc3fc0\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:66:eb:74\"\nname : incus-net39-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : f53f332a-127b-4377-91ff-518a407a5dad\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : fe11145c-7ada-4028-a9f7-2ae19989a23b\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 9a5658b7-bc56-4478-9bf9-c84d4cbabe45\nlogical_port : cr-incus-net39-lr-lrp-ext\nmac : [\"10:66:6a:66:eb:74 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net39-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : 54c3b455-e298-4244-96f5-74f35ecc3fc0\nexternal_ids : {}\nha_chassis : [30c8a37b-38ba-4349-87a9-8851248d621e, 4d0f6aae-1a22-4016-9a22-e8d7a02f445a, e9931224-7bd1-4a73-b58b-e183d7ad7600, ff9a7008-51e4-43fc-9b7e-3dc6a969ca36]\nname : incus-net39\n=== ovn-nbctl list HA_Chassis ===\n_uuid : e9931224-7bd1-4a73-b58b-e183d7ad7600\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 30644\n\n_uuid : ff9a7008-51e4-43fc-9b7e-3dc6a969ca36\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 10877\n\n_uuid : 4d0f6aae-1a22-4016-9a22-e8d7a02f445a\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 12329\n\n_uuid : 30c8a37b-38ba-4349-87a9-8851248d621e\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 15145\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:66:eb:74 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T17:12:55.108718+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.29, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:66:eb:74 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T17:12:55.399154+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.16, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168821394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168821548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c\"\n },\n {\n \"at\": \"1789233168821577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00214|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168823984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824085\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824141\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824194\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824207\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168824256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824268\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824291\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824329\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824383\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824455\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824517\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824529\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824583\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168830826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168830870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168830889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168830901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168830915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168830929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168830941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168830992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831002\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168831029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168831040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831053\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168831069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168831103\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168919953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168920177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3\"\n },\n {\n \"at\": \"1789233168922264\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168922326\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168922365\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168922405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168922441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x8cb25190 your_disc:0xc4521b29\"\n },\n {\n \"at\": \"1789233168922474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922508\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922542\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168922585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168922614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168922648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922680\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483925ms\"\n },\n {\n \"at\": \"1789233168922739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789233168922777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789233168922812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168922846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168922882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168922914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168922946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168922978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923044\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168923179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923215\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168923282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168923323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168923388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168923489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +751ms\"\n },\n {\n \"at\": \"1789233168923528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789233168923563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168923594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168923625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168923684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923842\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926377\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926596\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x10864ed9 your_disc:0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168926642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483929ms\"\n },\n {\n \"at\": \"1789233168926894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168926927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168926959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168927273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168927304\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168927407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168927514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168927578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168927668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168927700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168927731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168927758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927848\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168928000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168928031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168928123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168928159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6\"\n },\n {\n \"at\": \"1789233169749719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169749802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169749820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169749836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169749847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xae7cb34c your_disc:0x61d86ef2\"\n },\n {\n \"at\": \"1789233169749861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169749895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169749905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169749927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4484753ms\"\n },\n {\n \"at\": \"1789233169749969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169749988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750030\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750053\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169750139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169750177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169750188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169750211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169750241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169750252\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750337\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750408\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170158976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:55.560134+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.173, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168811784\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168811961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 00005ecb8e6efe4b\"\n },\n {\n \"at\": \"1789233168811983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00280|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168813667\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00281|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168813736\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168813766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168813788\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168813807\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168813827\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168813849\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813872\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813892\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813912\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168813931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168813949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168813981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168814004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00282|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814245\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814281\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814413\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168814456\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168814494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814546\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814564\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814635\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814655\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00283|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814770\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814846\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814867\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814890\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814927\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168814950\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814974\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168815027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168815047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168815069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168815089\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168815110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168815131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168906956\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00284|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168907003\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789233168908983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler387)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168909067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler387)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168909099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168909125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168909150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x7d56a557 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168909170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168909195\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168909214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168909231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168909270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168909388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168909418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909438\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168909464\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168909505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168909515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168909533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168909542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909560\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168909573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168909582\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168909598\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909623\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168909642\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909659\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168909667\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168909677\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909685\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168909693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168909717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168909725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909732\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168909740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909751\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909759\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168910813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler387)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168910900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler387)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168910936\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168910964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168910990\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x85855f99 your_disc:0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911003\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168911015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168911023\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168911032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168911049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911057\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911065\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423910ms\"\n },\n {\n \"at\": \"1789233168911080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +743ms\"\n },\n {\n \"at\": \"1789233168911089\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789233168911097\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168911105\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168911114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911133\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168911162\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168911171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911180\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168911188\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168911196\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911213\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler387)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168911223\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168911231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168911250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911269\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168911277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +743ms\"\n },\n {\n \"at\": \"1789233168911284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789233168911292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168911300\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168911309\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168911349\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168911357\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911364\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168911378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911396\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168912854\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168912911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168912954\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168912978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168913000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xcfbfe66f your_disc:0x0\"\n },\n {\n \"at\": \"1789233168913025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168913046\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168913067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168913090\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913115\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168913141\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913251\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168913276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168913297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913318\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168913340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168913417\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168913441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913460\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168913482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168913503\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913522\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168913568\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168913589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913615\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168913636\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913657\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913676\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168913695\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913777\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168913799\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168913820\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913839\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168913860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913878\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913899\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168913919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168913940\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168913979\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168914000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168914021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168914610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168914686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789233169699852\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169699972\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169699985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169699995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169700005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169700015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169700025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169700033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +774ms\"\n },\n {\n \"at\": \"1789233169700042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -26ms\"\n },\n {\n \"at\": \"1789233169700052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169700070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169700084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169700094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233169700102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169700130\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169700140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169700149\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233169700158\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169700167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700176\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169903740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169904049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169904078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169904101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169904126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169904150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169904179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169904204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789233169904238\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -220ms\"\n },\n {\n \"at\": \"1789233169904263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169904290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169904324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169904352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233169904378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169904467\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169904490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169904510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233169904532\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169904554\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:55.733336+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.176, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168811894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00308|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168812001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00309|bridge|INFO|bridge incusovn16: using datapath ID 0000da6e2727ca42\"\n },\n {\n \"at\": \"1789233168812014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00310|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168813745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00311|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168813808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168813830\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168813843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168813854\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168813865\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168813880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813909\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168813932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168813944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168813961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168813973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168813985\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168813996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814028\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814052\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814066\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00312|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814094\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814110\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814120\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814153\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814168\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814178\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814191\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814201\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814222\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168814239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814278\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168814316\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814337\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168815784\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00313|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168815864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168815880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168815892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168815911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168815926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168815939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815956\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815976\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816002\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168816015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816028\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168816041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816054\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168816086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168816098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816115\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168816129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168816417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168816451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168816469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168816490\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168816508\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xc4521b29 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168816521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168816536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168816549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168816563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816577\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168816596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816608\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816626\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168816703\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816714\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168816725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816737\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168816769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168816787\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168816818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816829\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816858\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168816873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168816889\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168816919\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168816957\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816980\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816991\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168817003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168817014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168817026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817049\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168817064\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168817080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168817093\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168817104\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168817931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler395)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168817977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler395)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168817994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168818009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168818022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xd9afc13d your_disc:0x0\"\n },\n {\n \"at\": \"1789233168818036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168818049\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168818065\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168818081\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168818105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818170\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168818180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168818194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168818218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818230\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168818252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168818265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168818290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168818302\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818330\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168818367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168818383\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168818406\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818418\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818430\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168818443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818455\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818467\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168818479\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168818491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818504\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168818515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818527\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168818552\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168818564\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818576\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168818589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818600\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168910298\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00314|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168910336\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00315|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789233168917621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00316|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168917693\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00317|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39\"\n },\n {\n \"at\": \"1789233169602771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler395)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169602882\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler395)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169602923\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169602954\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169602977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xed7c59ec your_disc:0xa62322ab\"\n },\n {\n \"at\": \"1789233169603005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169603030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169603057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169603097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169603145\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55324600ms\"\n },\n {\n \"at\": \"1789233169603235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +991ms\"\n },\n {\n \"at\": \"1789233169603266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789233169603297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169603322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169603348\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169603373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233169603398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603447\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169603472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169603498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169603523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233169603549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169603577\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler395)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169603660\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169603751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169603800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603828\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169603878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +991ms\"\n },\n {\n \"at\": \"1789233169603901\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789233169603926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169603950\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169604017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169604043\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233169604075\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169604153\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169604182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169604219\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233169604242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169658608\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169658702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169658732\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169658757\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169658780\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169658810\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169658833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169658857\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +85ms\"\n },\n {\n \"at\": \"1789233169658888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -745ms\"\n },\n {\n \"at\": \"1789233169658916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169658994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169659030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169659053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233169659091\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169659168\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169659193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169659225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233169659250\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169659277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659301\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169665970\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169666054\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169666078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169666090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169666103\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169666116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169666128\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169666141\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +28ms\"\n },\n {\n \"at\": \"1789233169666154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -752ms\"\n },\n {\n \"at\": \"1789233169666173\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169666184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169666197\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169666209\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233169666221\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169666257\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169666267\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169666277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233169666290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169666300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666310\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170952370\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00318|bridge|INFO|bridge br-int: added interface veth7279dfcc on port 40\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:55.910408+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.185, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168798597\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00282|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168798695\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00283|bridge|INFO|bridge incusovn16: using datapath ID 00009ee860452c48\"\n },\n {\n \"at\": \"1789233168798710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00284|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168798816\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168798832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789233168798843\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168798858\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00288|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26\"\n },\n {\n \"at\": \"1789233168819005\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00289|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168819040\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168819061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168819075\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168819086\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168819095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168819106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819118\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168819150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819170\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168819180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168819191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819200\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168819212\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168819243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168819285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00290|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168819302\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168819316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168819329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168819347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168819361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168819378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168819432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819442\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168819463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168819479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168819498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168819527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168819557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168821906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler401)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168821934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler401)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168821952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168821979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168821994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xa62322ab your_disc:0x0\"\n },\n {\n \"at\": \"1789233168822010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168822027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168822041\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168822058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822073\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168822082\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822112\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550686ms\"\n },\n {\n \"at\": \"1789233168822132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +787ms\"\n },\n {\n \"at\": \"1789233168822147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789233168822175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168822190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168822204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822214\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168822224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822249\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168822258\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168822270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168822290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168822300\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822313\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822326\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168822337\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168822347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822356\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168822365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822385\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168822399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +787ms\"\n },\n {\n \"at\": \"1789233168822409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789233168822421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168822430\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168822439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168822457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822476\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168822491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168822506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168822527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822549\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168823236\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00291|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168823261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168823275\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168823289\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168823303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168823317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168823330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168823379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168823389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168823398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168823410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168823420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168823443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168823458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168823473\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168823487\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823503\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler401)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168824147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler401)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168824164\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168824179\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168824198\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x61d86ef2 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168824213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168824227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168824237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168824250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824264\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824293\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824308\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550688ms\"\n },\n {\n \"at\": \"1789233168824328\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +925ms\"\n },\n {\n \"at\": \"1789233168824339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789233168824356\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168824377\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168824402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824501\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824528\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824541\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +925ms\"\n },\n {\n \"at\": \"1789233168824570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789233168824585\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168824604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824613\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168824669\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824679\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824688\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824698\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824708\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168925985\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler401)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler401)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xf2fd4c97 your_disc:0x7d56a557\"\n },\n {\n \"at\": \"1789233168926194\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926209\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926240\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926275\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926305\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550790ms\"\n },\n {\n \"at\": \"1789233168926322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +754ms\"\n },\n {\n \"at\": \"1789233168926339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789233168926359\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926381\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168926394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926414\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168926429\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926455\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168926465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168926478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926497\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168926512\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168926524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926538\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler401)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168926568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168926578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168926636\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +754ms\"\n },\n {\n \"at\": \"1789233168926649\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789233168926657\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168926677\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926687\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168926696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926706\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926715\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168926725\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168926735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926745\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168926755\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926774\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170602635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233170603050\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233170603076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170603134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233170603189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170603225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170603251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233170603273\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +688ms\"\n },\n {\n \"at\": \"1789233170603295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -152ms\"\n },\n {\n \"at\": \"1789233170603319\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233170603345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233170603390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170603413\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233170603444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603483\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233170603502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233170603527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170603548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233170603612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233170603643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170645027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233170645219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233170645255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170645280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233170645306\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170645342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170645369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233170645460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789233170645491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -895ms\"\n },\n {\n \"at\": \"1789233170645527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233170645550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233170645576\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170645610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233170645637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645664\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233170645715\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233170645741\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170645771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233170645795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233170645820\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:56.095992+00:00"} +{"diagnostics": "before-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-before-probe.txt", "router_mac": "10:66:6a:66:eb:74", "at": "2026-09-12T17:12:56.097557+00:00"} +{"command": ["incus", "query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1"], "seconds": 0.097, "exit_code": 0, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T17:12:49.642756907Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T17:12:50.246590203Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T17:12:50.444501094Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T17:12:51.033114675Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null, "at": "2026-09-12T17:12:56.194767+00:00"} +{"command": ["ssh", "-tt", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "sudo -n timeout 180 tcpdump -nne -l -i enp2s0 arp and host 10.10.40.64"], "capture": "tcpdump-arp", "pid": 49719, "ready": true, "ready_signal": "listening on", "at": "2026-09-12T17:12:56.315226+00:00"} +{"command": ["bash", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/probe.sh", "nas01", "ac-ovn-spike", "default", "one", "two", "http://10.10.40.79:8080/index.html", "ovn-spike-ok"], "seconds": 14.523, "exit_code": 0, "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.098 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.094 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\"volatile.eth0.host_name\":\"vethd42ad9e0\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:dd:b1\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\"volatile.uuid.generation\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T17:12:49.642756907Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\"volatile.eth0.host_name\":\"vethd42ad9e0\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:dd:b1\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\"volatile.uuid.generation\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T17:12:50.246590203Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11902976,\"usage_peak\":0,\"total\":65256516000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe02:ddb1\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:02:dd:b1\",\"host_name\":\"vethd42ad9e0\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":16461,\"processes\":4,\"cpu\":{\"usage\":493267000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T17:12:49.25999999Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\"volatile.eth0.host_name\":\"veth7279dfcc\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:90:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\",\"volatile.uuid.generation\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T17:12:50.444501094Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\"volatile.eth0.host_name\":\"veth7279dfcc\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:90:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\",\"volatile.uuid.generation\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T17:12:51.033114675Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11984896,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe35:90e5\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:35:90:e5\",\"host_name\":\"veth7279dfcc\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":40697,\"processes\":4,\"cpu\":{\"usage\":496528000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T17:12:51.039999961Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.112 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.672 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.234 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.531 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=1.150 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.663 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.663/1.114/1.531 ms\nelapsed_seconds=2.255 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.664 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=1.760 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.656 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.656/1.360/1.760 ms\nelapsed_seconds=2.255 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.627 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.234 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.635 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.635/1.165/1.627 ms\nelapsed_seconds=2.663 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.509 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=2.614 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.453 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.453/2.192/2.614 ms\nelapsed_seconds=2.456 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.238 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.239 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.357 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.355 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.032 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.124317 bytes_per_second=804395215\nelapsed_seconds=0.367 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.508 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.113388 bytes_per_second=881927540\nelapsed_seconds=0.352 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.494 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:10.839238+00:00"} +{"capture": "tcpdump-arp", "pid": 49719, "exit_code": 255, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/tcpdump-arp.log", "ready_signal": "listening on", "at": "2026-09-12T17:13:10.841911+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.093, "exit_code": 0, "stdout": "config:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - lab02\n - lab03\n - nas01\n - lab01\nproject: ac-ovn-spike\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:10.934603+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.108, "exit_code": 0, "stdout": "+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:02:dd:b1 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:35:90:e5 |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | |\n+-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:11.042577+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.149, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\nswitch 2fabcc2c-8c19-4664-9b37-fc7eae2922d3 (incus-net39-ls-int)\n port incus-net39-ls-int-lsp-router\n type: router\n router-port: incus-net39-lr-lrp-int\n port incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0\n addresses: [\"10:66:6a:02:dd:b1 dynamic\"]\n port incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0\n addresses: [\"10:66:6a:35:90:e5 dynamic\"]\nswitch a755c7f5-f0d6-4322-a17b-271a274a21da (incus-net39-ls-ext)\n port incus-net39-ls-ext-lsp-router\n type: router\n router-port: incus-net39-lr-lrp-ext\n port incus-net39-ls-ext-lsp-provider\n type: localnet\n addresses: [\"unknown\"]\nrouter 498600bd-50df-49c1-ab2c-3843a2479f5c (incus-net39-lr)\n port incus-net39-lr-lrp-int\n mac: \"10:66:6a:66:eb:74\"\n ipv6-lla: \"fe80::1266:6aff:fe66:eb74\"\n networks: [\"10.253.73.1/24\"]\n port incus-net39-lr-lrp-ext\n mac: \"10:66:6a:66:eb:74\"\n ipv6-lla: \"fe80::1266:6aff:fe66:eb74\"\n networks: [\"10.10.40.64/24\"]\n nat 317a50de-d456-4a6c-ae06-7587737357a5\n external ip: \"10.10.40.64\"\n logical ip: \"10.253.73.0/24\"\n type: \"snat\"\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\n Port_Binding incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n Port_Binding cr-incus-net39-lr-lrp-ext\n Port_Binding incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0\n=== ovn-nbctl list Logical_Router_Port ===\n_uuid : 8d438d4a-dc31-4873-8526-52a5346b882f\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : []\nipv6_prefix : []\nipv6_ra_configs : {send_periodic=\"false\"}\nmac : \"10:66:6a:66:eb:74\"\nname : incus-net39-lr-lrp-int\nnetworks : [\"10.253.73.1/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {}\n\n_uuid : 973cf967-a8ef-42b9-859d-0c8cecb865fe\ndhcp_relay : []\nenabled : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 54c3b455-e298-4244-96f5-74f35ecc3fc0\nipv6_prefix : []\nipv6_ra_configs : {}\nmac : \"10:66:6a:66:eb:74\"\nname : incus-net39-lr-lrp-ext\nnetworks : [\"10.10.40.64/24\"]\noptions : {gateway_mtu=\"1442\"}\npeer : []\nstatus : {hosting-chassis=\"2da6738c-78eb-4738-98be-0898402c0eaa\"}\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n_uuid : f53f332a-127b-4377-91ff-518a407a5dad\nadditional_chassis : []\nadditional_encap : []\nchassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c\ndatapath : fe11145c-7ada-4028-a9f7-2ae19989a23b\nencap : []\nexternal_ids : {}\ngateway_chassis : []\nha_chassis_group : 9a5658b7-bc56-4478-9bf9-c84d4cbabe45\nlogical_port : cr-incus-net39-lr-lrp-ext\nmac : [\"10:66:6a:66:eb:74 10.10.40.64/24\"]\nmirror_port : []\nmirror_rules : []\nnat_addresses : []\noptions : {always-redirect=\"true\", distributed-port=incus-net39-lr-lrp-ext}\nparent_port : []\nport_security : []\nrequested_additional_chassis: []\nrequested_chassis : []\ntag : []\ntunnel_key : 2\ntype : chassisredirect\nup : true\nvirtual_parent : []\n=== ovn-nbctl list HA_Chassis_Group ===\n_uuid : 54c3b455-e298-4244-96f5-74f35ecc3fc0\nexternal_ids : {}\nha_chassis : [30c8a37b-38ba-4349-87a9-8851248d621e, 4d0f6aae-1a22-4016-9a22-e8d7a02f445a, e9931224-7bd1-4a73-b58b-e183d7ad7600, ff9a7008-51e4-43fc-9b7e-3dc6a969ca36]\nname : incus-net39\n=== ovn-nbctl list HA_Chassis ===\n_uuid : e9931224-7bd1-4a73-b58b-e183d7ad7600\nchassis_name : \"2da6738c-78eb-4738-98be-0898402c0eaa\"\nexternal_ids : {}\npriority : 30644\n\n_uuid : ff9a7008-51e4-43fc-9b7e-3dc6a969ca36\nchassis_name : \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\nexternal_ids : {}\npriority : 10877\n\n_uuid : 4d0f6aae-1a22-4016-9a22-e8d7a02f445a\nchassis_name : \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\nexternal_ids : {}\npriority : 12329\n\n_uuid : 30c8a37b-38ba-4349-87a9-8851248d621e\nchassis_name : \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\nexternal_ids : {}\npriority : 15145\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"fast40-uplink:incusovn16\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:66:eb:74 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T17:13:11.193424+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.327, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:66:eb:74 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T17:13:11.520754+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.172, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168821394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168821548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c\"\n },\n {\n \"at\": \"1789233168821577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00214|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168823984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824085\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824141\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824194\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824207\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168824256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824268\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824291\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824329\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824383\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824455\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824517\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824529\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824583\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168830826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168830870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168830889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168830901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168830915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168830929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168830941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168830992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831002\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168831029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168831040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831053\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168831069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168831103\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168919953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168920177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3\"\n },\n {\n \"at\": \"1789233168922264\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168922326\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168922365\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168922405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168922441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x8cb25190 your_disc:0xc4521b29\"\n },\n {\n \"at\": \"1789233168922474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922508\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922542\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168922585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168922614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168922648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922680\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483925ms\"\n },\n {\n \"at\": \"1789233168922739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789233168922777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789233168922812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168922846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168922882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168922914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168922946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168922978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923044\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168923179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923215\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168923282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168923323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168923388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168923489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +751ms\"\n },\n {\n \"at\": \"1789233168923528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789233168923563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168923594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168923625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168923684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923842\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926377\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926596\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x10864ed9 your_disc:0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168926642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483929ms\"\n },\n {\n \"at\": \"1789233168926894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168926927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168926959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168927273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168927304\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168927407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168927514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168927578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168927668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168927700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168927731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168927758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927848\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168928000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168928031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168928123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168928159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6\"\n },\n {\n \"at\": \"1789233169749719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169749802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169749820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169749836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169749847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xae7cb34c your_disc:0x61d86ef2\"\n },\n {\n \"at\": \"1789233169749861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169749895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169749905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169749927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4484753ms\"\n },\n {\n \"at\": \"1789233169749969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169749988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750030\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750053\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169750139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169750177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169750188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169750211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169750241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169750252\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750337\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750408\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170158976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7\"\n },\n {\n \"at\": \"1789233178826726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00223|connmgr|INFO|br-int<->unix#3: 913 flow_mods in the 6 s starting 10 s ago (847 adds, 58 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:11.693592+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.184, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168811784\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168811961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 00005ecb8e6efe4b\"\n },\n {\n \"at\": \"1789233168811983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00280|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168813667\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00281|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168813736\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168813766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168813788\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168813807\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168813827\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168813849\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813872\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813892\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813912\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168813931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168813949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168813981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168814004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00282|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814245\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814281\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814413\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168814456\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168814494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814546\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814564\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814635\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814655\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00283|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814770\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814846\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814867\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814890\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814927\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168814950\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814974\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168815027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168815047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168815069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168815089\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168815110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168815131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168906956\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00284|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168907003\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789233168908983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler387)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168909067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler387)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168909099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168909125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168909150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x7d56a557 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168909170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168909195\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168909214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168909231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168909270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168909388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168909418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909438\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168909464\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168909505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168909515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168909533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168909542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909560\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168909573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168909582\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168909598\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909623\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168909642\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909659\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168909667\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168909677\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909685\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168909693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168909717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168909725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909732\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168909740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909751\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909759\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168910813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler387)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168910900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler387)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168910936\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168910964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168910990\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x85855f99 your_disc:0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911003\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168911015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168911023\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168911032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168911049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911057\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911065\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423910ms\"\n },\n {\n \"at\": \"1789233168911080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +743ms\"\n },\n {\n \"at\": \"1789233168911089\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789233168911097\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168911105\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168911114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911133\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168911162\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168911171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911180\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168911188\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168911196\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911213\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler387)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168911223\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168911231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168911250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911269\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168911277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +743ms\"\n },\n {\n \"at\": \"1789233168911284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789233168911292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168911300\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168911309\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168911349\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168911357\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911364\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168911378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911396\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168912854\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168912911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168912954\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168912978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168913000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xcfbfe66f your_disc:0x0\"\n },\n {\n \"at\": \"1789233168913025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168913046\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168913067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168913090\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913115\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168913141\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913251\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168913276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168913297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913318\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168913340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168913417\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168913441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913460\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168913482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168913503\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913522\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168913568\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168913589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913615\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168913636\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913657\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913676\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168913695\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913777\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168913799\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168913820\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913839\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168913860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913878\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913899\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168913919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168913940\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168913979\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168914000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168914021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168914610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168914686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789233169699852\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169699972\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169699985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169699995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169700005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169700015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169700025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169700033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +774ms\"\n },\n {\n \"at\": \"1789233169700042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -26ms\"\n },\n {\n \"at\": \"1789233169700052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169700070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169700084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169700094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233169700102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169700130\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169700140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169700149\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233169700158\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169700167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700176\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169903740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169904049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169904078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169904101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169904126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169904150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169904179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169904204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789233169904238\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -220ms\"\n },\n {\n \"at\": \"1789233169904263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169904290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169904324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169904352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233169904378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169904467\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169904490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169904510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233169904532\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169904554\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233178815908\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00288|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 7 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:11.878573+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.194, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168811894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00308|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168812001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00309|bridge|INFO|bridge incusovn16: using datapath ID 0000da6e2727ca42\"\n },\n {\n \"at\": \"1789233168812014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00310|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168813745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00311|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168813808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168813830\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168813843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168813854\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168813865\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168813880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813909\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168813932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168813944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168813961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168813973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168813985\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168813996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814028\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814052\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814066\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00312|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814094\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814110\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814120\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814153\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814168\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814178\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814191\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814201\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814222\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168814239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814278\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168814316\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814337\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168815784\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00313|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168815864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168815880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168815892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168815911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168815926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168815939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815956\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815976\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816002\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168816015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816028\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168816041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816054\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168816086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168816098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816115\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168816129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168816417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168816451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168816469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168816490\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168816508\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xc4521b29 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168816521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168816536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168816549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168816563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816577\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168816596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816608\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816626\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168816703\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816714\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168816725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816737\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168816769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168816787\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168816818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816829\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816858\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168816873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168816889\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168816919\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168816957\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816980\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816991\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168817003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168817014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168817026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817049\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168817064\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168817080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168817093\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168817104\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168817931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler395)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168817977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler395)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168817994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168818009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168818022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xd9afc13d your_disc:0x0\"\n },\n {\n \"at\": \"1789233168818036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168818049\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168818065\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168818081\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168818105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818170\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168818180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168818194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168818218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818230\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168818252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168818265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168818290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168818302\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818330\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168818367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168818383\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168818406\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818418\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818430\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168818443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818455\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818467\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168818479\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168818491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818504\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168818515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818527\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168818552\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168818564\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818576\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168818589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818600\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168910298\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00314|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168910336\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00315|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789233168917621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00316|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168917693\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00317|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39\"\n },\n {\n \"at\": \"1789233169602771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler395)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169602882\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler395)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169602923\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169602954\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169602977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xed7c59ec your_disc:0xa62322ab\"\n },\n {\n \"at\": \"1789233169603005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169603030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169603057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169603097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169603145\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55324600ms\"\n },\n {\n \"at\": \"1789233169603235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +991ms\"\n },\n {\n \"at\": \"1789233169603266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789233169603297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169603322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169603348\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169603373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233169603398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603447\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169603472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169603498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169603523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233169603549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169603577\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler395)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169603660\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169603751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169603800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603828\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169603878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +991ms\"\n },\n {\n \"at\": \"1789233169603901\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789233169603926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169603950\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169604017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169604043\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233169604075\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169604153\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169604182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169604219\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233169604242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169658608\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169658702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169658732\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169658757\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169658780\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169658810\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169658833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169658857\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +85ms\"\n },\n {\n \"at\": \"1789233169658888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -745ms\"\n },\n {\n \"at\": \"1789233169658916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169658994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169659030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169659053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233169659091\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169659168\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169659193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169659225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233169659250\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169659277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659301\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169665970\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169666054\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169666078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169666090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169666103\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169666116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169666128\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169666141\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +28ms\"\n },\n {\n \"at\": \"1789233169666154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -752ms\"\n },\n {\n \"at\": \"1789233169666173\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169666184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169666197\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169666209\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233169666221\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169666257\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169666267\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169666277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233169666290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169666300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666310\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170952370\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00318|bridge|INFO|bridge br-int: added interface veth7279dfcc on port 40\"\n },\n {\n \"at\": \"1789233178816901\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00319|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:12.073697+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.169, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168798597\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00282|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168798695\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00283|bridge|INFO|bridge incusovn16: using datapath ID 00009ee860452c48\"\n },\n {\n \"at\": \"1789233168798710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00284|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168798816\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168798832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789233168798843\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168798858\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00288|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26\"\n },\n {\n \"at\": \"1789233168819005\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00289|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168819040\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168819061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168819075\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168819086\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168819095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168819106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819118\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168819150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819170\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168819180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168819191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819200\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168819212\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168819243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168819285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00290|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168819302\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168819316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168819329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168819347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168819361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168819378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168819432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819442\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168819463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168819479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168819498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168819527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168819557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168821906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler401)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168821934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler401)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168821952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168821979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168821994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xa62322ab your_disc:0x0\"\n },\n {\n \"at\": \"1789233168822010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168822027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168822041\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168822058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822073\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168822082\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822112\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550686ms\"\n },\n {\n \"at\": \"1789233168822132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +787ms\"\n },\n {\n \"at\": \"1789233168822147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789233168822175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168822190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168822204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822214\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168822224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822249\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168822258\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168822270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168822290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168822300\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822313\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822326\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168822337\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168822347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822356\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168822365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822385\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168822399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +787ms\"\n },\n {\n \"at\": \"1789233168822409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789233168822421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168822430\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168822439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168822457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822476\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168822491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168822506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168822527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822549\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168823236\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00291|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168823261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168823275\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168823289\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168823303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168823317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168823330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168823379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168823389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168823398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168823410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168823420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168823443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168823458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168823473\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168823487\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823503\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler401)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168824147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler401)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168824164\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168824179\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168824198\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x61d86ef2 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168824213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168824227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168824237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168824250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824264\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824293\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824308\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550688ms\"\n },\n {\n \"at\": \"1789233168824328\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +925ms\"\n },\n {\n \"at\": \"1789233168824339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789233168824356\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168824377\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168824402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824501\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824528\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824541\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +925ms\"\n },\n {\n \"at\": \"1789233168824570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789233168824585\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168824604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824613\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168824669\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824679\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824688\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824698\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824708\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168925985\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler401)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler401)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xf2fd4c97 your_disc:0x7d56a557\"\n },\n {\n \"at\": \"1789233168926194\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926209\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926240\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926275\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926305\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550790ms\"\n },\n {\n \"at\": \"1789233168926322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +754ms\"\n },\n {\n \"at\": \"1789233168926339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789233168926359\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926381\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168926394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926414\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168926429\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926455\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168926465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168926478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926497\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168926512\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168926524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926538\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler401)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168926568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168926578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168926636\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +754ms\"\n },\n {\n \"at\": \"1789233168926649\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789233168926657\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168926677\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926687\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168926696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926706\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926715\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168926725\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168926735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926745\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168926755\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926774\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170602635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233170603050\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233170603076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170603134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233170603189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170603225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170603251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233170603273\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +688ms\"\n },\n {\n \"at\": \"1789233170603295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -152ms\"\n },\n {\n \"at\": \"1789233170603319\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233170603345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233170603390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170603413\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233170603444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603483\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233170603502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233170603527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170603548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233170603612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233170603643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170645027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233170645219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233170645255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170645280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233170645306\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170645342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170645369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233170645460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789233170645491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -895ms\"\n },\n {\n \"at\": \"1789233170645527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233170645550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233170645576\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170645610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233170645637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645664\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233170645715\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233170645741\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170645771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233170645795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233170645820\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233178631369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00292|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (866 adds, 106 deletes, 1 modifications)\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:12.243381+00:00"} +{"diagnostics": "after-probe", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-probe.txt", "router_mac": "10:66:6a:66:eb:74", "at": "2026-09-12T17:13:12.245353+00:00"} +{"command": ["incus", "--debug", "monitor", "nas01:", "--type=logging", "--pretty", "--loglevel=debug", "--all-projects"], "capture": "monitor-delete", "pid": 50714, "ready": true, "ready_signal": "time=\"2026-09-12T10:13:12-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T17:13:12.329463+00:00"} +{"command": ["/Users/josh/.pyenv/versions/3.12.3/bin/python3", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/topology.py", "--log", "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/topology.jsonl", "destroy"], "seconds": 3.751, "exit_code": 0, "stdout": "{\n \"project\": \"ac-ovn-spike\",\n \"destroyed\": true,\n \"failures\": []\n}\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:16.080744+00:00"} +{"capture": "monitor-delete", "pid": 50714, "exit_code": -15, "stopped": true, "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.log", "ready_signal": "time=\"2026-09-12T10:13:12-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", "at": "2026-09-12T17:13:16.082928+00:00"} +{"command": ["incus", "network", "show", "nas01:default", "--project", "ac-ovn-spike"], "seconds": 0.081, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T17:13:16.164457+00:00"} +{"command": ["incus", "network", "list-allocations", "nas01:", "--project", "ac-ovn-spike"], "seconds": 0.08, "exit_code": 1, "stdout": "", "stderr": "Error: Failed to load project \"ac-ovn-spike\": Project not found\n", "error": "Error: Failed to load project \"ac-ovn-spike\": Project not found", "at": "2026-09-12T17:13:16.245213+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "josh@sandbox01", "set -e\necho '=== ovn-nbctl show ==='\nsudo -n ovn-nbctl show\necho '=== ovn-sbctl show ==='\nsudo -n ovn-sbctl show\necho '=== ovn-nbctl list Logical_Router_Port ==='\nsudo -n ovn-nbctl list Logical_Router_Port\necho '=== ovn-sbctl find Port_Binding type=chassisredirect ==='\nsudo -n ovn-sbctl find Port_Binding type=chassisredirect\necho '=== ovn-nbctl list HA_Chassis_Group ==='\nsudo -n ovn-nbctl list HA_Chassis_Group\necho '=== ovn-nbctl list HA_Chassis ==='\nsudo -n ovn-nbctl list HA_Chassis\necho '=== ovn-sbctl list Chassis ==='\nsudo -n ovn-sbctl --format=json --columns=name,hostname,other_config list Chassis\necho '=== ip neigh ==='\nif [ -n '10.10.40.64' ]; then ip neigh show 10.10.40.64; else ip neigh; fi"], "seconds": 0.152, "exit_code": 0, "stdout": "=== ovn-nbctl show ===\n=== ovn-sbctl show ===\nChassis \"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\"\n hostname: lab03.glab.lol\n Encap geneve\n ip: \"10.10.30.13\"\n options: {csum=\"true\"}\nChassis \"c2919898-1135-4799-80cf-860ae7e7ef9e\"\n hostname: nas01.glab.lol\n Encap geneve\n ip: \"10.10.30.14\"\n options: {csum=\"true\"}\nChassis \"67314e94-b0b4-4c97-8146-0c67aff4d585\"\n hostname: lab02.glab.lol\n Encap geneve\n ip: \"10.10.30.12\"\n options: {csum=\"true\"}\nChassis \"2da6738c-78eb-4738-98be-0898402c0eaa\"\n hostname: lab01.glab.lol\n Encap geneve\n ip: \"10.10.30.11\"\n options: {csum=\"true\"}\n=== ovn-nbctl list Logical_Router_Port ===\n=== ovn-sbctl find Port_Binding type=chassisredirect ===\n=== ovn-nbctl list HA_Chassis_Group ===\n=== ovn-nbctl list HA_Chassis ===\n=== ovn-sbctl list Chassis ===\n{\"data\":[[\"5ec8d171-fbe4-49cf-9923-9d21f9c5d29b\",\"lab03.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"c2919898-1135-4799-80cf-860ae7e7ef9e\",\"nas01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"67314e94-b0b4-4c97-8146-0c67aff4d585\",\"lab02.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]],[\"2da6738c-78eb-4738-98be-0898402c0eaa\",\"lab01.glab.lol\",[\"map\",[[\"ct-commit-nat-v2\",\"true\"],[\"ct-commit-to-zone\",\"true\"],[\"ct-label-flush\",\"true\"],[\"ct-next-zone\",\"true\"],[\"ct-no-masked-label\",\"true\"],[\"ct-state-save\",\"true\"],[\"datapath-type\",\"system\"],[\"fdb-timestamp\",\"true\"],[\"iface-types\",\"bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan\"],[\"is-interconn\",\"false\"],[\"ls-dpg-column\",\"true\"],[\"mac-binding-timestamp\",\"true\"],[\"ovn-bridge-mappings\",\"\"],[\"ovn-chassis-mac-mappings\",\"\"],[\"ovn-cms-options\",\"\"],[\"ovn-ct-lb-related\",\"true\"],[\"ovn-enable-lflow-cache\",\"true\"],[\"ovn-evpn-local-ip\",\"\"],[\"ovn-evpn-vxlan-ports\",\"\"],[\"ovn-limit-lflow-cache\",\"\"],[\"ovn-memlimit-lflow-cache-kb\",\"\"],[\"ovn-monitor-all\",\"false\"],[\"ovn-sample-with-registers\",\"true\"],[\"ovn-trim-limit-lflow-cache\",\"\"],[\"ovn-trim-timeout-ms\",\"\"],[\"ovn-trim-wmark-perc-lflow-cache\",\"\"],[\"port-up-notif\",\"true\"]]]]],\"headings\":[\"name\",\"hostname\",\"other_config\"]}\n=== ip neigh ===\n10.10.40.64 dev enp2s0 lladdr 10:66:6a:66:eb:74 STALE \n", "stderr": "", "error": null, "at": "2026-09-12T17:13:16.397292+00:00"} +{"command": ["ssh", "-o", "BatchMode=yes", "-o", "ConnectTimeout=10", "-i", "/Users/josh/.ssh/vyos-gateway", "vyos@10.0.0.2", "ip neigh show 10.10.40.64"], "seconds": 0.29, "exit_code": 0, "stdout": "10.10.40.64 dev br40 lladdr 10:66:6a:66:eb:74 REACHABLE \n", "stderr": "", "error": null, "at": "2026-09-12T17:13:16.687135+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.176, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168821394\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168821548\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c\"\n },\n {\n \"at\": \"1789233168821577\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00214|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168823984\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824041\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824065\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824085\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824105\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824141\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824158\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824178\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824194\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824207\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824225\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168824256\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824268\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824291\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824302\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824317\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824329\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824341\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824354\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824369\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824383\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824399\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824410\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824455\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824466\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824478\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824505\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824517\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824529\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824540\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824550\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824572\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824583\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824592\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824602\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824619\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168830826\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168830870\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168830889\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168830901\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168830915\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168830929\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168830941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830956\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830966\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830979\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168830992\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831002\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831014\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168831029\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168831040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831053\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168831069\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831081\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831092\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168831103\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831115\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831130\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168919953\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168920177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3\"\n },\n {\n \"at\": \"1789233168922264\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168922326\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168922365\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168922405\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168922441\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x8cb25190 your_disc:0xc4521b29\"\n },\n {\n \"at\": \"1789233168922474\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922508\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922542\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168922585\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168922614\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168922648\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922680\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922710\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483925ms\"\n },\n {\n \"at\": \"1789233168922739\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789233168922777\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789233168922812\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168922846\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168922882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168922914\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168922946\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168922978\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923012\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923044\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923075\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923106\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168923179\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923215\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923247\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168923282\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168923323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923356\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168923388\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923420\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923454\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168923489\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +751ms\"\n },\n {\n \"at\": \"1789233168923528\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789233168923563\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168923594\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168923625\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923653\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168923684\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923715\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923749\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923780\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923811\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923842\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923873\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923907\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923938\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926377\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926481\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926527\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926562\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926596\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0x10864ed9 your_disc:0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168926642\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926671\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926702\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926734\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926796\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926827\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926859\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4483929ms\"\n },\n {\n \"at\": \"1789233168926894\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168926927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168926959\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926991\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927023\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927057\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927088\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927120\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927148\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927180\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927239\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168927273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168927304\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927339\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927371\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168927407\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168927514\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927546\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168927578\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927609\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927636\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168927668\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168927700\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168927731\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168927758\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927789\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927817\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927848\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927879\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927910\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927941\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927972\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168928000\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168928031\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928062\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928093\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168928123\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168928159\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6\"\n },\n {\n \"at\": \"1789233169749719\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169749802\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169749820\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169749836\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169749847\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" my_disc:0xae7cb34c your_disc:0x61d86ef2\"\n },\n {\n \"at\": \"1789233169749861\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749872\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749882\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169749895\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169749905\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169749927\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749937\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749949\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now -4484753ms\"\n },\n {\n \"at\": \"1789233169749969\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169749988\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750005\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750019\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750030\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750053\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750064\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750078\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750089\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750100\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750111\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750126\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169750139\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750154\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750165\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169750177\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169750188\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750200\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169750211\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750221\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750230\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169750241\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169750252\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750263\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750273\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750285\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750295\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750305\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750323\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750337\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750350\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750363\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750373\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750385\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750397\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750408\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170158976\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7\"\n },\n {\n \"at\": \"1789233178826726\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00223|connmgr|INFO|br-int<->unix#3: 913 flow_mods in the 6 s starting 10 s ago (847 adds, 58 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789233193165011\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00224|bridge|INFO|bridge br-int: deleted interface vethd42ad9e0 on port 7\"\n },\n {\n \"at\": \"1789233195484004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00225|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233195484249\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00226|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233195484344\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233195501004\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00228|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6\"\n },\n {\n \"at\": \"1789233195501040\",\n \"member\": \"lab01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor65)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:16.862964+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab02&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.2, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168811784\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00278|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168811961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 00005ecb8e6efe4b\"\n },\n {\n \"at\": \"1789233168811983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00280|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168813667\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00281|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168813736\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168813766\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168813788\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168813807\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168813827\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168813849\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813872\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813892\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168813912\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168813931\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168813949\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168813981\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168814004\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814022\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814123\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814164\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814222\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00282|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814245\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814281\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814298\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814316\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814334\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814370\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814390\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814413\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814436\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168814456\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814475\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168814494\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814528\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814546\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814564\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814584\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814602\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814617\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814635\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814655\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00283|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814674\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814691\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814727\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814748\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814770\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814791\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814819\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423813ms\"\n },\n {\n \"at\": \"1789233168814846\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814867\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814890\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814927\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168814950\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814974\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814998\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168815027\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168815047\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168815069\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168815089\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168815110\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168815131\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168906956\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00284|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168907003\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99\"\n },\n {\n \"at\": \"1789233168908983\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler387)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168909067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler387)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168909099\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168909125\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168909150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x7d56a557 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168909170\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168909195\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168909214\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168909231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168909270\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909312\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909369\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168909388\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168909418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909438\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168909464\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909496\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168909505\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168909515\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909525\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168909533\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168909542\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909551\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909560\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168909573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168909582\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168909590\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168909598\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909623\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168909631\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168909642\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909650\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423908ms\"\n },\n {\n \"at\": \"1789233168909659\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168909667\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168909677\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909685\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168909693\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909701\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909709\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168909717\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168909725\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168909732\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168909740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909751\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168909759\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168910813\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler387)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168910900\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler387)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168910936\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168910964\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168910990\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0x85855f99 your_disc:0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911003\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168911015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168911023\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168911032\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911040\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168911049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911057\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911065\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423910ms\"\n },\n {\n \"at\": \"1789233168911080\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +743ms\"\n },\n {\n \"at\": \"1789233168911089\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789233168911097\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168911105\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168911114\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911122\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911133\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911142\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168911162\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168911171\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911180\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168911188\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168911196\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911205\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911213\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler387)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168911223\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168911231\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168911240\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168911250\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911259\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168911269\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168911277\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +743ms\"\n },\n {\n \"at\": \"1789233168911284\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -97ms\"\n },\n {\n \"at\": \"1789233168911292\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168911300\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168911309\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911317\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168911325\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911332\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911342\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168911349\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168911357\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168911364\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168911378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168911396\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168912854\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168912911\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168912954\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168912978\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168913000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" my_disc:0xcfbfe66f your_disc:0x0\"\n },\n {\n \"at\": \"1789233168913025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168913046\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168913067\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168913090\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913115\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168913141\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913161\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913181\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913228\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913251\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168913276\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168913297\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913318\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168913340\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913366\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913386\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168913417\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168913441\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913460\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168913482\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168913503\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913522\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913543\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168913568\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168913589\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168913615\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168913636\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913657\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168913676\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168913695\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913715\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -1596423912ms\"\n },\n {\n \"at\": \"1789233168913777\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168913799\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168913820\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913839\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168913860\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913878\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168913899\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168913919\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168913940\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168913961\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168913979\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168914000\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168914021\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168914610\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168914686\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789233169699852\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169699972\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169699985\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169699995\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169700005\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169700015\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169700025\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169700033\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +774ms\"\n },\n {\n \"at\": \"1789233169700042\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -26ms\"\n },\n {\n \"at\": \"1789233169700052\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169700070\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169700084\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169700094\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233169700102\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700111\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700121\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169700130\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169700140\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169700149\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233169700158\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169700167\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169700176\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169903740\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169904049\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169904078\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169904101\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169904126\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169904150\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169904179\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169904204\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Next TX Time: now +670ms\"\n },\n {\n \"at\": \"1789233169904238\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Last TX Time: now -220ms\"\n },\n {\n \"at\": \"1789233169904263\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169904290\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169904324\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169904352\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233169904378\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904418\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904447\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169904467\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169904490\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169904510\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233169904532\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169904554\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169904573\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233178815908\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00288|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 7 modifications)\"\n },\n {\n \"at\": \"1789233195471158\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00289|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233195471289\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00290|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233195471311\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00291|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233195487898\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00292|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24\"\n },\n {\n \"at\": \"1789233195488184\",\n \"member\": \"lab02.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor417)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:17.063612+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=lab03&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.16, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168811894\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00308|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168812001\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00309|bridge|INFO|bridge incusovn16: using datapath ID 0000da6e2727ca42\"\n },\n {\n \"at\": \"1789233168812014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00310|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168813745\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00311|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168813808\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168813830\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168813843\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168813854\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168813865\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168813880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813909\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168813921\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168813932\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168813944\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168813961\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168813973\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168813985\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168813996\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814006\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814028\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814052\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814066\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168814082\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00312|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168814094\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168814110\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168814120\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168814132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168814144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168814153\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814168\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814178\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323811ms\"\n },\n {\n \"at\": \"1789233168814191\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168814201\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814212\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814222\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168814239\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168814255\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168814278\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168814290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168814300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168814316\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168814326\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814337\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168814349\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168815784\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00313|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168815864\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168815880\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168815892\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168815911\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168815926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168815939\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815956\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815976\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323813ms\"\n },\n {\n \"at\": \"1789233168815990\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816002\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168816015\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816028\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168816041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816054\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816071\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168816086\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168816098\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816115\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168816129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168816417\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168816451\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168816469\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168816490\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168816508\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xc4521b29 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168816521\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168816536\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168816549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168816563\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816577\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168816596\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816608\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816626\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816643\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816656\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816674\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816687\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168816703\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816714\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168816725\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816737\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168816769\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168816787\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168816800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168816818\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168816829\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168816841\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816858\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168816873\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168816889\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168816907\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168816919\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168816943\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168816957\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816969\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323814ms\"\n },\n {\n \"at\": \"1789233168816980\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168816991\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168817003\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168817014\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168817026\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817038\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817049\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168817064\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168817080\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168817093\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168817104\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817119\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168817132\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168817931\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler395)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168817977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler395)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168817994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168818009\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168818022\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xd9afc13d your_disc:0x0\"\n },\n {\n \"at\": \"1789233168818036\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168818049\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168818065\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168818081\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818092\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168818105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818143\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818157\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818170\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168818180\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168818194\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818206\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168818218\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818230\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168818252\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168818265\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168818290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168818302\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818330\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818347\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168818367\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168818383\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168818394\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168818406\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818418\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168818430\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168818443\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818455\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -55323815ms\"\n },\n {\n \"at\": \"1789233168818467\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168818479\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168818491\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818504\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233168818515\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818527\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818541\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168818552\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168818564\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168818576\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233168818589\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818600\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168818614\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168910298\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00314|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168910336\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00315|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b\"\n },\n {\n \"at\": \"1789233168917621\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00316|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168917693\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00317|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39\"\n },\n {\n \"at\": \"1789233169602771\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler395)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169602882\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler395)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169602923\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169602954\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169602977\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" my_disc:0xed7c59ec your_disc:0xa62322ab\"\n },\n {\n \"at\": \"1789233169603005\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169603030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169603057\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169603097\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603122\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169603145\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603172\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603205\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now -55324600ms\"\n },\n {\n \"at\": \"1789233169603235\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +991ms\"\n },\n {\n \"at\": \"1789233169603266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789233169603297\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169603322\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169603348\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169603373\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233169603398\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603420\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603447\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169603472\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169603498\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169603523\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233169603549\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169603577\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169603602\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603628\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler395)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169603660\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169603751\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169603775\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169603800\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603828\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169603853\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169603878\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +991ms\"\n },\n {\n \"at\": \"1789233169603901\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -9ms\"\n },\n {\n \"at\": \"1789233169603926\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169603950\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169604017\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169604043\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233169604075\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604105\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604129\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169604153\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169604182\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169604219\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233169604242\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604266\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169604290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169658608\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169658702\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169658732\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169658757\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169658780\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169658810\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169658833\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169658857\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +85ms\"\n },\n {\n \"at\": \"1789233169658888\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -745ms\"\n },\n {\n \"at\": \"1789233169658916\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169658994\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169659030\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169659053\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x85855f99\"\n },\n {\n \"at\": \"1789233169659091\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659117\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659144\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169659168\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169659193\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169659225\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xd9afc13d\"\n },\n {\n \"at\": \"1789233169659250\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169659277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169659301\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169665970\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169666054\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169666078\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169666090\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169666103\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169666116\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169666128\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169666141\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Next TX Time: now +28ms\"\n },\n {\n \"at\": \"1789233169666154\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Last TX Time: now -752ms\"\n },\n {\n \"at\": \"1789233169666173\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169666184\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233169666197\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169666209\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233169666221\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666231\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666241\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169666257\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233169666267\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169666277\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233169666290\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233169666300\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169666310\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170952370\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00318|bridge|INFO|bridge br-int: added interface veth7279dfcc on port 40\"\n },\n {\n \"at\": \"1789233178816901\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00319|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789233194282292\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00320|bridge|INFO|bridge br-int: deleted interface veth7279dfcc on port 40\"\n },\n {\n \"at\": \"1789233195473171\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00321|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233195473436\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00322|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233195473590\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00323|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233195496481\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor417)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789233195499041\",\n \"member\": \"lab03.glab.lol\",\n \"message\": \"ovs|00324|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:17.224517+00:00"} +{"command": ["bash", "-o", "pipefail", "-c", "incus query 'nas01:/os/1.0/debug/log?target=nas01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A12%3A46.384573%2B00%3A00' | jq '[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, message: .MESSAGE}]'"], "seconds": 0.176, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168798597\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00282|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168798695\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00283|bridge|INFO|bridge incusovn16: using datapath ID 00009ee860452c48\"\n },\n {\n \"at\": \"1789233168798710\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00284|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168798816\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00285|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168798832\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00286|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b\"\n },\n {\n \"at\": \"1789233168798843\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00287|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168798858\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00288|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26\"\n },\n {\n \"at\": \"1789233168819005\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00289|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168819040\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168819061\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168819075\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168819086\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168819095\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168819106\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819118\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168819150\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819160\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819170\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168819180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168819191\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819200\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168819212\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819222\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819234\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168819243\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819271\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168819285\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00290|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168819302\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168819316\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168819329\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168819347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168819361\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168819378\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819393\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819408\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550683ms\"\n },\n {\n \"at\": \"1789233168819421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168819432\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819442\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819452\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168819463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168819479\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819489\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168819498\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168819508\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168819518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168819527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819537\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168819548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168819557\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168821906\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00001|bfd(handler401)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168821934\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|bfd(handler401)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168821952\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168821979\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168821994\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xa62322ab your_disc:0x0\"\n },\n {\n \"at\": \"1789233168822010\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168822027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168822041\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168822058\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822073\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168822082\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822094\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822112\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550686ms\"\n },\n {\n \"at\": \"1789233168822132\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +787ms\"\n },\n {\n \"at\": \"1789233168822147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789233168822175\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168822190\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168822204\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822214\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168822224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822239\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822249\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168822258\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168822270\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168822290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168822300\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822313\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822326\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00003|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168822337\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168822347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168822356\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168822365\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822375\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168822385\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168822399\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +787ms\"\n },\n {\n \"at\": \"1789233168822409\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -3ms\"\n },\n {\n \"at\": \"1789233168822421\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168822430\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168822439\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822448\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233168822457\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822467\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822476\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168822491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168822506\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168822515\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233168822527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822539\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168822549\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168823236\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00291|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168823261\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168823275\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168823289\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168823303\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168823317\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168823330\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823347\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823360\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -1596550687ms\"\n },\n {\n \"at\": \"1789233168823369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168823379\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168823389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168823398\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168823410\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168823420\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823428\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168823443\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168823458\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168823473\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168823487\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823503\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168823517\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00004|bfd(handler401)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168824147\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00005|bfd(handler401)|INFO|ovn-2da673-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168824164\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:down mult:3 length:24\"\n },\n {\n \"at\": \"1789233168824179\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168824198\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0x61d86ef2 your_disc:0x0\"\n },\n {\n \"at\": \"1789233168824213\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168824227\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168824237\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168824250\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824264\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824293\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824308\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550688ms\"\n },\n {\n \"at\": \"1789233168824328\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +925ms\"\n },\n {\n \"at\": \"1789233168824339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789233168824356\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824366\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168824377\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824389\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168824402\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824411\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824453\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824463\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824472\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824481\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00006|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824501\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824510\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824518\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824528\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824541\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824551\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +925ms\"\n },\n {\n \"at\": \"1789233168824570\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -5ms\"\n },\n {\n \"at\": \"1789233168824585\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824595\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168824604\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824613\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824639\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824650\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824660\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: down\"\n },\n {\n \"at\": \"1789233168824669\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824679\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824688\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824698\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824708\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168925985\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00007|bfd(handler401)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926128\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00008|bfd(handler401)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926146\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926168\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926180\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" my_disc:0xf2fd4c97 your_disc:0x7d56a557\"\n },\n {\n \"at\": \"1789233168926194\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926209\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926224\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926240\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926256\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926275\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926290\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926305\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now -1596550790ms\"\n },\n {\n \"at\": \"1789233168926322\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +754ms\"\n },\n {\n \"at\": \"1789233168926339\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789233168926359\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926381\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168926394\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926414\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168926429\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926455\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168926465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168926478\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926497\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168926512\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168926524\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926538\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926553\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00009|bfd(handler401)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168926568\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168926578\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926589\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926598\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926623\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168926636\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +754ms\"\n },\n {\n \"at\": \"1789233168926649\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -6ms\"\n },\n {\n \"at\": \"1789233168926657\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926667\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168926677\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926687\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0x7d56a557\"\n },\n {\n \"at\": \"1789233168926696\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926706\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926715\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168926725\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168926735\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168926745\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xf2fd4c97\"\n },\n {\n \"at\": \"1789233168926755\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168926774\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170602635\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00010|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233170603050\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233170603076\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170603134\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233170603189\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170603225\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170603251\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233170603273\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +688ms\"\n },\n {\n \"at\": \"1789233170603295\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -152ms\"\n },\n {\n \"at\": \"1789233170603319\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233170603345\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233170603390\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170603413\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xed7c59ec\"\n },\n {\n \"at\": \"1789233170603444\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603465\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603483\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233170603502\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233170603527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170603548\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0xa62322ab\"\n },\n {\n \"at\": \"1789233170603612\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233170603643\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170603666\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170645027\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00011|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233170645219\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233170645255\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170645280\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233170645306\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170645342\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233170645369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233170645460\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Next TX Time: now +105ms\"\n },\n {\n \"at\": \"1789233170645491\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Last TX Time: now -895ms\"\n },\n {\n \"at\": \"1789233170645527\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233170645550\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Session State: init\"\n },\n {\n \"at\": \"1789233170645576\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170645610\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233170645637\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645664\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645691\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233170645715\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Session State: up\"\n },\n {\n \"at\": \"1789233170645741\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233170645771\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233170645795\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum TX Interval: 100ms\"\n },\n {\n \"at\": \"1789233170645820\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233170645851\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233178631369\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00292|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (866 adds, 106 deletes, 1 modifications)\"\n },\n {\n \"at\": \"1789233195485925\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00293|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233195486124\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00294|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233195486138\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00295|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233195512950\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor417)|INFO|monitor thread terminated\"\n },\n {\n \"at\": \"1789233195516631\",\n \"member\": \"nas01.glab.lol\",\n \"message\": \"ovs|00296|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26\"\n }\n]\n", "stderr": "", "error": null, "at": "2026-09-12T17:13:17.400968+00:00"} +{"diagnostics": "after-teardown", "path": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-teardown.txt", "router_mac": null, "at": "2026-09-12T17:13:17.402398+00:00"} diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/create.stderr.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/create.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/create.stdout.json b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/create.stdout.json new file mode 100644 index 0000000..84aca9e --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/create.stdout.json @@ -0,0 +1,38 @@ +{ + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.669, + "first_cross_member_ping_seconds": 2.842, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } +} diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/cycle.json b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/cycle.json new file mode 100644 index 0000000..51bc7a8 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/cycle.json @@ -0,0 +1,119 @@ +{ + "ok": true, + "datapath_ok": true, + "captures_ok": true, + "cleanup_ok": true, + "exit_code": 0, + "keep_on_failure": false, + "teardown": "done", + "started_at": "2026-09-12T17:12:46.384573+00:00", + "ended_at": "2026-09-12T17:13:17.402855+00:00", + "seconds": 31.018, + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:66:eb:74", + "create": { + "ok": true, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "network": "default", + "subnet": "10.253.73.1/24", + "uplink": "fast40-uplink", + "central": "10.10.40.10", + "external_ip": "10.10.40.64", + "network_create_seconds": 0.669, + "first_cross_member_ping_seconds": 2.842, + "instances": { + "one": { + "location": "lab01", + "ipv4": "10.253.73.2" + }, + "two": { + "location": "lab03", + "ipv4": "10.253.73.3" + } + }, + "forward": { + "listen": "10.10.40.79", + "port": 8080, + "target": "one", + "target_ipv4": "10.253.73.2", + "marker": "ovn-spike-ok", + "url": "http://10.10.40.79:8080/index.html" + }, + "large_file": { + "path": "/large.bin", + "bytes": 100000000, + "sha256": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae", + "listen_port": 8080, + "guest_urls": { + "one": "http://10.253.73.2:8080/large.bin", + "two": "http://10.253.73.3:8080/large.bin" + } + } + }, + "stderr": "" + }, + "probe": { + "ok": true, + "exit_code": 0, + "stdout": "+ incus network list nas01: --project ac-ovn-spike\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |\n+---------+------+---------+----------------+------+-------------+---------+---------+\n| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED |\n+---------+------+---------+----------------+------+-------------+---------+---------+\nelapsed_seconds=0.098 exit=0\n+ incus network show nas01:default --project ac-ovn-spike\nconfig:\n bridge.mtu: \"1442\"\n dns.nameservers: 10.10.40.1\n ipv4.address: 10.253.73.1/24\n ipv4.dhcp: \"true\"\n ipv4.nat: \"true\"\n ipv6.address: none\n network: fast40-uplink\n volatile.network.ipv4.address: 10.10.40.64\ndescription: \"\"\nname: default\ntype: ovn\nused_by:\n - /1.0/instances/one?project=ac-ovn-spike\n - /1.0/instances/two?project=ac-ovn-spike\nmanaged: true\nstatus: Created\nlocations:\n - nas01\n - lab01\n - lab02\n - lab03\nproject: ac-ovn-spike\nelapsed_seconds=0.094 exit=0\ndns.nameservers=10.10.40.1\n+ incus list nas01: --project ac-ovn-spike --format json\n[{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\"volatile.eth0.host_name\":\"vethd42ad9e0\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:dd:b1\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\"volatile.uuid.generation\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T17:12:49.642756907Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\"volatile.eth0.host_name\":\"vethd42ad9e0\",\"volatile.eth0.hwaddr\":\"10:66:6a:02:dd:b1\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.2\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\"volatile.uuid.generation\":\"172371c5-b4be-4aec-bd88-4a680cb21ed2\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"one\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T17:12:50.246590203Z\",\"location\":\"lab01\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11902976,\"usage_peak\":0,\"total\":65256516000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.2\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe02:ddb1\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:02:dd:b1\",\"host_name\":\"vethd42ad9e0\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":16461,\"processes\":4,\"cpu\":{\"usage\":493267000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T17:12:49.25999999Z\",\"os_info\":null},\"snapshots\":null},{\"architecture\":\"x86_64\",\"config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\"volatile.eth0.host_name\":\"veth7279dfcc\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:90:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\",\"volatile.uuid.generation\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\"},\"devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"ephemeral\":false,\"profiles\":[],\"stateful\":false,\"description\":\"\",\"created_at\":\"2026-09-12T17:12:50.444501094Z\",\"expanded_config\":{\"image.agentcompute.digest\":\"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\"image.architecture\":\"x86_64\",\"image.description\":\"Router system container (Alpine 3.22.5)\",\"image.name\":\"router\",\"image.os\":\"alpinelinux\",\"image.release\":\"3.22.5\",\"image.serial\":\"phase1\",\"image.variant\":\"router\",\"volatile.base_image\":\"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\"volatile.cloud-init.instance-id\":\"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\"volatile.eth0.host_name\":\"veth7279dfcc\",\"volatile.eth0.hwaddr\":\"10:66:6a:35:90:e5\",\"volatile.eth0.last_state.ip_addresses\":\"10.253.73.3\",\"volatile.idmap.base\":\"0\",\"volatile.idmap.current\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.idmap.next\":\"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\"volatile.last_state.idmap\":\"[]\",\"volatile.last_state.power\":\"RUNNING\",\"volatile.uuid\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\",\"volatile.uuid.generation\":\"4c35ca2f-5270-4de1-9682-6929c8560e10\"},\"expanded_devices\":{\"eth0\":{\"name\":\"eth0\",\"network\":\"default\",\"type\":\"nic\"},\"root\":{\"path\":\"/\",\"pool\":\"data\",\"size\":\"2GiB\",\"type\":\"disk\"}},\"name\":\"two\",\"status\":\"Running\",\"status_code\":103,\"last_used_at\":\"2026-09-12T17:12:51.033114675Z\",\"location\":\"lab03\",\"type\":\"container\",\"project\":\"ac-ovn-spike\",\"backups\":null,\"state\":{\"status\":\"Running\",\"status_code\":103,\"disk\":{\"root\":{\"usage\":192512,\"total\":2147483648}},\"memory\":{\"usage\":11984896,\"usage_peak\":0,\"total\":65256532000,\"swap_usage\":0,\"swap_usage_peak\":0},\"network\":{\"eth0\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"10.253.73.3\",\"netmask\":\"24\",\"scope\":\"global\"},{\"family\":\"inet6\",\"address\":\"fe80::1266:6aff:fe35:90e5\",\"netmask\":\"64\",\"scope\":\"link\"}],\"counters\":{\"bytes_received\":968,\"bytes_sent\":1410,\"packets_received\":6,\"packets_sent\":11,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"10:66:6a:35:90:e5\",\"host_name\":\"veth7279dfcc\",\"mtu\":1442,\"state\":\"up\",\"type\":\"broadcast\"},\"lo\":{\"addresses\":[{\"family\":\"inet\",\"address\":\"127.0.0.1\",\"netmask\":\"8\",\"scope\":\"local\"},{\"family\":\"inet6\",\"address\":\"::1\",\"netmask\":\"128\",\"scope\":\"local\"}],\"counters\":{\"bytes_received\":0,\"bytes_sent\":0,\"packets_received\":0,\"packets_sent\":0,\"errors_received\":0,\"errors_sent\":0,\"packets_dropped_outbound\":0,\"packets_dropped_inbound\":0},\"hwaddr\":\"\",\"host_name\":\"\",\"mtu\":65536,\"state\":\"up\",\"type\":\"loopback\"}},\"pid\":40697,\"processes\":4,\"cpu\":{\"usage\":496528000,\"allocated_time\":24000000000},\"started_at\":\"2026-09-12T17:12:51.039999961Z\",\"os_info\":null},\"snapshots\":null}]\nelapsed_seconds=0.112 exit=0\ninstance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2\ninstance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3\n+ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.672 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu\n1442\nelapsed_seconds=0.234 exit=0\nguest_mtu one=1442 two=1442\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3\nPING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.531 ms\n64 bytes from 10.253.73.3: seq=1 ttl=64 time=1.150 ms\n64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.663 ms\n\n--- 10.253.73.3 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.663/1.114/1.531 ms\nelapsed_seconds=2.255 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2\nPING 10.253.73.2 (10.253.73.2): 56 data bytes\n64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.664 ms\n64 bytes from 10.253.73.2: seq=1 ttl=64 time=1.760 ms\n64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.656 ms\n\n--- 10.253.73.2 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.656/1.360/1.760 ms\nelapsed_seconds=2.255 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.627 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.234 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.635 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 0.635/1.165/1.627 ms\nelapsed_seconds=2.663 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1\nPING 10.10.40.1 (10.10.40.1): 56 data bytes\n64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.509 ms\n64 bytes from 10.10.40.1: seq=1 ttl=63 time=2.614 ms\n64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.453 ms\n\n--- 10.10.40.1 ping statistics ---\n3 packets transmitted, 3 packets received, 0% packet loss\nround-trip min/avg/max = 1.453/2.192/2.614 ms\nelapsed_seconds=2.456 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nNon-authoritative answer:\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.238 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1\nServer:\t\t10.10.40.1\nAddress:\t10.10.40.1:53\n\nName:\texample.com\nAddress: 104.20.23.154\nName:\texample.com\nAddress: 172.66.147.243\n\nName:\texample.com\nAddress: 2606:4700:10::ac42:93f3\nName:\texample.com\nAddress: 2606:4700:10::6814:179a\n\nelapsed_seconds=0.239 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.357 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com\nelapsed_seconds=0.355 exit=0\n+ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html\novn-spike-okelapsed_seconds=0.032 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin\nbytes=100000000 seconds=0.124317 bytes_per_second=804395215\nelapsed_seconds=0.367 exit=0\n+ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.508 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin\nbytes=100000000 seconds=0.113388 bytes_per_second=881927540\nelapsed_seconds=0.352 exit=0\n+ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin\na993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin\nelapsed_seconds=0.494 exit=0\nlarge_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok\nprobe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3\n", + "stderr": "" + }, + "fallback_checks": null, + "destroy": { + "ok": true, + "skipped": false, + "exit_code": 0, + "result": { + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] + }, + "stderr": "" + }, + "captures": [ + { + "name": "monitor-create", + "ready": true, + "pid": 49344, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.log", + "bytes": 176070, + "ready_signal": "time=\"2026-09-12T10:12:46-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T17:12:46.810652+00:00", + "stopped_at": "2026-09-12T17:12:54.806221+00:00" + }, + { + "name": "tcpdump-arp", + "ready": true, + "pid": 49719, + "returncode": 255, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/tcpdump-arp.log", + "bytes": 482, + "ready_signal": "listening on", + "started_at": "2026-09-12T17:12:56.195559+00:00", + "stopped_at": "2026-09-12T17:13:10.841767+00:00" + }, + { + "name": "monitor-delete", + "ready": true, + "pid": 50714, + "returncode": -15, + "error": null, + "log": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.log", + "bytes": 40888, + "ready_signal": "time=\"2026-09-12T10:13:12-07:00\" level=debug msg=\"Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true\"", + "started_at": "2026-09-12T17:13:12.245643+00:00", + "stopped_at": "2026-09-12T17:13:16.082628+00:00" + } + ], + "failures": { + "checks": [], + "captures": [], + "cleanup": [] + }, + "evidence_dir": "/Users/josh/code/lab2/agentcompute/.wt/spike-ovn-recreate-diagnosis/spikes/ovn/parent-recovery-2026-09-12/cycle-1" +} diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/destroy.stderr.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/destroy.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/destroy.stdout.json b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/destroy.stdout.json new file mode 100644 index 0000000..179d816 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/destroy.stdout.json @@ -0,0 +1,5 @@ +{ + "project": "ac-ovn-spike", + "destroyed": true, + "failures": [] +} diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-probe.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-probe.txt new file mode 100644 index 0000000..b9c7b3b --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-probe.txt @@ -0,0 +1,5358 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - lab02 + - lab03 + - nas01 + - lab01 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:02:dd:b1 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:35:90:e5 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 2fabcc2c-8c19-4664-9b37-fc7eae2922d3 (incus-net39-ls-int) + port incus-net39-ls-int-lsp-router + type: router + router-port: incus-net39-lr-lrp-int + port incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0 + addresses: ["10:66:6a:02:dd:b1 dynamic"] + port incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0 + addresses: ["10:66:6a:35:90:e5 dynamic"] +switch a755c7f5-f0d6-4322-a17b-271a274a21da (incus-net39-ls-ext) + port incus-net39-ls-ext-lsp-router + type: router + router-port: incus-net39-lr-lrp-ext + port incus-net39-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router 498600bd-50df-49c1-ab2c-3843a2479f5c (incus-net39-lr) + port incus-net39-lr-lrp-int + mac: "10:66:6a:66:eb:74" + ipv6-lla: "fe80::1266:6aff:fe66:eb74" + networks: ["10.253.73.1/24"] + port incus-net39-lr-lrp-ext + mac: "10:66:6a:66:eb:74" + ipv6-lla: "fe80::1266:6aff:fe66:eb74" + networks: ["10.10.40.64/24"] + nat 317a50de-d456-4a6c-ae06-7587737357a5 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net39-lr-lrp-ext + Port_Binding incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 8d438d4a-dc31-4873-8526-52a5346b882f +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:66:eb:74" +name : incus-net39-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 973cf967-a8ef-42b9-859d-0c8cecb865fe +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 54c3b455-e298-4244-96f5-74f35ecc3fc0 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:66:eb:74" +name : incus-net39-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : f53f332a-127b-4377-91ff-518a407a5dad +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : fe11145c-7ada-4028-a9f7-2ae19989a23b +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 9a5658b7-bc56-4478-9bf9-c84d4cbabe45 +logical_port : cr-incus-net39-lr-lrp-ext +mac : ["10:66:6a:66:eb:74 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net39-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : 54c3b455-e298-4244-96f5-74f35ecc3fc0 +external_ids : {} +ha_chassis : [30c8a37b-38ba-4349-87a9-8851248d621e, 4d0f6aae-1a22-4016-9a22-e8d7a02f445a, e9931224-7bd1-4a73-b58b-e183d7ad7600, ff9a7008-51e4-43fc-9b7e-3dc6a969ca36] +name : incus-net39 +=== ovn-nbctl list HA_Chassis === +_uuid : e9931224-7bd1-4a73-b58b-e183d7ad7600 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 30644 + +_uuid : ff9a7008-51e4-43fc-9b7e-3dc6a969ca36 +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 10877 + +_uuid : 4d0f6aae-1a22-4016-9a22-e8d7a02f445a +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 12329 + +_uuid : 30c8a37b-38ba-4349-87a9-8851248d621e +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 15145 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:66:eb:74 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:66:eb:74 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168821394", + "member": "lab01.glab.lol", + "message": "ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168821548", + "member": "lab01.glab.lol", + "message": "ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c" + }, + { + "at": "1789233168821577", + "member": "lab01.glab.lol", + "message": "ovs|00214|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168823984", + "member": "lab01.glab.lol", + "message": "ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824041", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824065", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824085", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824105", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824126", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824141", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824158", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824178", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824194", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824207", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824225", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824239", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168824256", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824268", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824279", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824291", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824302", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824317", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824329", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824341", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824354", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824369", + "member": "lab01.glab.lol", + "message": "ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824383", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824399", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824410", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824423", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824433", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824444", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824455", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824466", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824478", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824489", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824505", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824517", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824529", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824540", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824550", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824561", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824572", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824583", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824592", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824602", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824619", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824629", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created" + }, + { + "at": "1789233168830826", + "member": "lab01.glab.lol", + "message": "ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168830870", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168830889", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168830901", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168830915", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168830929", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168830941", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483834ms" + }, + { + "at": "1789233168830956", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483834ms" + }, + { + "at": "1789233168830966", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483834ms" + }, + { + "at": "1789233168830979", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168830992", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168831002", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831014", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168831029", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168831040", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831053", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168831069", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168831081", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831092", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168831103", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168831115", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831130", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168919953", + "member": "lab01.glab.lol", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168920177", + "member": "lab01.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3" + }, + { + "at": "1789233168922264", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168922326", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168922365", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168922405", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168922441", + "member": "lab01.glab.lol", + "message": " my_disc:0x8cb25190 your_disc:0xc4521b29" + }, + { + "at": "1789233168922474", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168922508", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168922542", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168922585", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168922614", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168922648", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168922680", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168922710", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483925ms" + }, + { + "at": "1789233168922739", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789233168922777", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789233168922812", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168922846", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168922882", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168922914", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168922946", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168922978", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923012", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923044", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923075", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923106", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923139", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168923179", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923215", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168923247", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168923282", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168923323", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168923356", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168923388", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168923420", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168923454", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168923489", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +751ms" + }, + { + "at": "1789233168923528", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789233168923563", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168923594", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168923625", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923653", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168923684", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923715", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923749", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923780", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923811", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923842", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923873", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923907", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923938", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926377", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926481", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926527", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926562", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168926596", + "member": "lab01.glab.lol", + "message": " my_disc:0x10864ed9 your_disc:0xcfbfe66f" + }, + { + "at": "1789233168926642", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926671", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926702", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926734", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926764", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926796", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926827", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926859", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483929ms" + }, + { + "at": "1789233168926894", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168926927", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168926959", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926991", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168927023", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927057", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927088", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927120", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927148", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927180", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927211", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927239", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168927273", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168927304", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927339", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168927371", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168927407", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168927514", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168927546", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168927578", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168927609", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168927636", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168927668", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168927700", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168927731", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168927758", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168927789", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927817", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927848", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927879", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927910", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927941", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927972", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168928000", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168928031", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168928062", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168928093", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168928123", + "member": "lab01.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168928159", + "member": "lab01.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6" + }, + { + "at": "1789233169749719", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169749802", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169749820", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169749836", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233169749847", + "member": "lab01.glab.lol", + "message": " my_disc:0xae7cb34c your_disc:0x61d86ef2" + }, + { + "at": "1789233169749861", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169749872", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169749882", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169749895", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169749905", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169749927", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169749937", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169749949", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4484753ms" + }, + { + "at": "1789233169749969", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169749988", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750005", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169750019", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169750030", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750040", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750053", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750064", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750078", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750089", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750100", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750111", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750126", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169750139", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750154", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169750165", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169750177", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169750188", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169750200", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169750211", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169750221", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169750230", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169750241", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169750252", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750263", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169750273", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169750285", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750295", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750305", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750323", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750337", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750350", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750363", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750373", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750385", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750397", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750408", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170158976", + "member": "lab01.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7" + }, + { + "at": "1789233178826726", + "member": "lab01.glab.lol", + "message": "ovs|00223|connmgr|INFO|br-int<->unix#3: 913 flow_mods in the 6 s starting 10 s ago (847 adds, 58 deletes, 8 modifications)" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168811784", + "member": "lab02.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168811961", + "member": "lab02.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 00005ecb8e6efe4b" + }, + { + "at": "1789233168811983", + "member": "lab02.glab.lol", + "message": "ovs|00280|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168813667", + "member": "lab02.glab.lol", + "message": "ovs|00281|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168813736", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168813766", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168813788", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168813807", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168813827", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168813849", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168813872", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168813892", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168813912", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168813931", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168813949", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168813981", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168814004", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814022", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814040", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814101", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814123", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814142", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814164", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814184", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814204", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814222", + "member": "lab02.glab.lol", + "message": "ovs|00282|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814245", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814263", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814281", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814298", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814316", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814334", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168814352", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168814370", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168814390", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814413", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814436", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168814456", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814475", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168814494", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814510", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814528", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814546", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814564", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814584", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814602", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814617", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814635", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814655", + "member": "lab02.glab.lol", + "message": "ovs|00283|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814674", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814691", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814709", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814727", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814748", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814770", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168814791", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168814819", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168814846", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814867", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814890", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814927", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168814950", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814974", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814998", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168815027", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168815047", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168815069", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168815089", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168815110", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168815131", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168906956", + "member": "lab02.glab.lol", + "message": "ovs|00284|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168907003", + "member": "lab02.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789233168908983", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler387)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168909067", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler387)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233168909099", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168909125", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168909150", + "member": "lab02.glab.lol", + "message": " my_disc:0x7d56a557 your_disc:0x0" + }, + { + "at": "1789233168909170", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168909195", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168909214", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168909231", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168909250", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168909270", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168909290", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168909312", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423908ms" + }, + { + "at": "1789233168909332", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423908ms" + }, + { + "at": "1789233168909352", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423908ms" + }, + { + "at": "1789233168909369", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168909388", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168909418", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909438", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168909464", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909482", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909496", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168909505", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168909515", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909525", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233168909533", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168909542", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909551", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168909560", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168909573", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168909582", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168909590", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168909598", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168909623", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168909631", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168909642", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423908ms" + }, + { + "at": "1789233168909650", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423908ms" + }, + { + "at": "1789233168909659", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168909667", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168909677", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909685", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168909693", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909701", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909709", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168909717", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168909725", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909732", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233168909740", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909751", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909759", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168910813", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler387)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168910900", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler387)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168910936", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168910964", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168910990", + "member": "lab02.glab.lol", + "message": " my_disc:0x85855f99 your_disc:0xd9afc13d" + }, + { + "at": "1789233168911003", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168911015", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168911023", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168911032", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168911040", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168911049", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168911057", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168911065", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423910ms" + }, + { + "at": "1789233168911080", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +743ms" + }, + { + "at": "1789233168911089", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789233168911097", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168911105", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168911114", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911122", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168911133", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911142", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911150", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168911162", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168911171", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911180", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x85855f99" + }, + { + "at": "1789233168911188", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168911196", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911205", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168911213", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler387)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168911223", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168911231", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168911240", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168911250", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168911259", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168911269", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168911277", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +743ms" + }, + { + "at": "1789233168911284", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789233168911292", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168911300", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168911309", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911317", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168911325", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911332", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911342", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168911349", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168911357", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911364", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x85855f99" + }, + { + "at": "1789233168911378", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911386", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911396", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168912854", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168912911", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168912954", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168912978", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168913000", + "member": "lab02.glab.lol", + "message": " my_disc:0xcfbfe66f your_disc:0x0" + }, + { + "at": "1789233168913025", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168913046", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168913067", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168913090", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168913115", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168913141", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168913161", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168913181", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423912ms" + }, + { + "at": "1789233168913204", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423912ms" + }, + { + "at": "1789233168913228", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423912ms" + }, + { + "at": "1789233168913251", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168913276", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168913297", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913318", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168913340", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168913366", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913386", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168913417", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168913441", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913460", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168913482", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168913503", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913522", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168913543", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168913568", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168913589", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168913615", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168913636", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168913657", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168913676", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168913695", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423912ms" + }, + { + "at": "1789233168913715", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423912ms" + }, + { + "at": "1789233168913777", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168913799", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168913820", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913839", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168913860", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168913878", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913899", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168913919", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168913940", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913961", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168913979", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168914000", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168914021", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168914610", + "member": "lab02.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168914686", + "member": "lab02.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789233169699852", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169699972", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169699985", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169699995", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169700005", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169700015", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169700025", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169700033", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +774ms" + }, + { + "at": "1789233169700042", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -26ms" + }, + { + "at": "1789233169700052", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169700070", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169700084", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169700094", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233169700102", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169700111", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169700121", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169700130", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169700140", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169700149", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233169700158", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169700167", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169700176", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169903740", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169904049", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169904078", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169904101", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169904126", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169904150", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169904179", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169904204", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789233169904238", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -220ms" + }, + { + "at": "1789233169904263", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169904290", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169904324", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169904352", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233169904378", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169904418", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169904447", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169904467", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169904490", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169904510", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233169904532", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169904554", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169904573", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233178815908", + "member": "lab02.glab.lol", + "message": "ovs|00288|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 7 modifications)" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168811894", + "member": "lab03.glab.lol", + "message": "ovs|00308|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168812001", + "member": "lab03.glab.lol", + "message": "ovs|00309|bridge|INFO|bridge incusovn16: using datapath ID 0000da6e2727ca42" + }, + { + "at": "1789233168812014", + "member": "lab03.glab.lol", + "message": "ovs|00310|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168813745", + "member": "lab03.glab.lol", + "message": "ovs|00311|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168813808", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168813830", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168813843", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168813854", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168813865", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168813880", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323811ms" + }, + { + "at": "1789233168813892", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323811ms" + }, + { + "at": "1789233168813909", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323811ms" + }, + { + "at": "1789233168813921", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168813932", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168813944", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168813961", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233168813973", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168813985", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168813996", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814006", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814017", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814028", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814038", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814052", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814066", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814082", + "member": "lab03.glab.lol", + "message": "ovs|00312|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814094", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814110", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814120", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814132", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814144", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814153", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323811ms" + }, + { + "at": "1789233168814168", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323811ms" + }, + { + "at": "1789233168814178", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323811ms" + }, + { + "at": "1789233168814191", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814201", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814212", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814222", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168814239", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814255", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814266", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814278", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814290", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814300", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168814316", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814326", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814337", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814349", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168815784", + "member": "lab03.glab.lol", + "message": "ovs|00313|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168815864", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168815880", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168815892", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168815911", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168815926", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168815939", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323813ms" + }, + { + "at": "1789233168815956", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323813ms" + }, + { + "at": "1789233168815976", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323813ms" + }, + { + "at": "1789233168815990", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816002", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168816015", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816028", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168816041", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168816054", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168816071", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168816086", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168816098", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816115", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168816129", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168816143", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168816157", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168816417", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168816451", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168816469", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168816490", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168816508", + "member": "lab03.glab.lol", + "message": " my_disc:0xc4521b29 your_disc:0x0" + }, + { + "at": "1789233168816521", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168816536", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168816549", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168816563", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168816577", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168816596", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168816608", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168816626", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323814ms" + }, + { + "at": "1789233168816643", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323814ms" + }, + { + "at": "1789233168816656", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323814ms" + }, + { + "at": "1789233168816674", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816687", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168816703", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816714", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168816725", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168816737", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168816751", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168816769", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168816787", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816800", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233168816818", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168816829", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168816841", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168816858", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168816873", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168816889", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168816907", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168816919", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168816931", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168816943", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168816957", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323814ms" + }, + { + "at": "1789233168816969", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323814ms" + }, + { + "at": "1789233168816980", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816991", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168817003", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168817014", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168817026", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168817038", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168817049", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168817064", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168817080", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168817093", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233168817104", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168817119", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168817132", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168817931", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler395)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168817977", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler395)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168817994", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168818009", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168818022", + "member": "lab03.glab.lol", + "message": " my_disc:0xd9afc13d your_disc:0x0" + }, + { + "at": "1789233168818036", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168818049", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168818065", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168818081", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168818092", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168818105", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168818117", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168818129", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323815ms" + }, + { + "at": "1789233168818143", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323815ms" + }, + { + "at": "1789233168818157", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323815ms" + }, + { + "at": "1789233168818170", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168818180", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168818194", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818206", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168818218", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818230", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818242", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168818252", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168818265", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818277", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168818290", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168818302", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818330", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168818347", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168818367", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168818383", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168818394", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168818406", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168818418", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168818430", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168818443", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323815ms" + }, + { + "at": "1789233168818455", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323815ms" + }, + { + "at": "1789233168818467", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168818479", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168818491", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818504", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168818515", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818527", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818541", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168818552", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168818564", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818576", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168818589", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818600", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818614", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168910298", + "member": "lab03.glab.lol", + "message": "ovs|00314|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168910336", + "member": "lab03.glab.lol", + "message": "ovs|00315|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789233168917621", + "member": "lab03.glab.lol", + "message": "ovs|00316|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168917693", + "member": "lab03.glab.lol", + "message": "ovs|00317|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39" + }, + { + "at": "1789233169602771", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler395)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169602882", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler395)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169602923", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169602954", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233169602977", + "member": "lab03.glab.lol", + "message": " my_disc:0xed7c59ec your_disc:0xa62322ab" + }, + { + "at": "1789233169603005", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169603030", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169603057", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169603097", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169603122", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169603145", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169603172", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169603205", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55324600ms" + }, + { + "at": "1789233169603235", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +991ms" + }, + { + "at": "1789233169603266", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789233169603297", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169603322", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169603348", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169603373", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233169603398", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169603420", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169603447", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169603472", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169603498", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169603523", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xed7c59ec" + }, + { + "at": "1789233169603549", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169603577", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169603602", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169603628", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler395)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169603660", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169603751", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169603775", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169603800", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169603828", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169603853", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169603878", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +991ms" + }, + { + "at": "1789233169603901", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789233169603926", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169603950", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169604017", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169604043", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233169604075", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169604105", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169604129", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169604153", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169604182", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169604219", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xed7c59ec" + }, + { + "at": "1789233169604242", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169604266", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169604290", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169658608", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169658702", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169658732", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169658757", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169658780", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169658810", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169658833", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169658857", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +85ms" + }, + { + "at": "1789233169658888", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -745ms" + }, + { + "at": "1789233169658916", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169658994", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169659030", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169659053", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233169659091", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169659117", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169659144", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169659168", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169659193", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169659225", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233169659250", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169659277", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169659301", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169665970", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169666054", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169666078", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169666090", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169666103", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169666116", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169666128", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169666141", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +28ms" + }, + { + "at": "1789233169666154", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -752ms" + }, + { + "at": "1789233169666173", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169666184", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169666197", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169666209", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233169666221", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169666231", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169666241", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169666257", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169666267", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169666277", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233169666290", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169666300", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169666310", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170952370", + "member": "lab03.glab.lol", + "message": "ovs|00318|bridge|INFO|bridge br-int: added interface veth7279dfcc on port 40" + }, + { + "at": "1789233178816901", + "member": "lab03.glab.lol", + "message": "ovs|00319|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168798597", + "member": "nas01.glab.lol", + "message": "ovs|00282|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168798695", + "member": "nas01.glab.lol", + "message": "ovs|00283|bridge|INFO|bridge incusovn16: using datapath ID 00009ee860452c48" + }, + { + "at": "1789233168798710", + "member": "nas01.glab.lol", + "message": "ovs|00284|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168798816", + "member": "nas01.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168798832", + "member": "nas01.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789233168798843", + "member": "nas01.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168798858", + "member": "nas01.glab.lol", + "message": "ovs|00288|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26" + }, + { + "at": "1789233168819005", + "member": "nas01.glab.lol", + "message": "ovs|00289|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168819040", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168819061", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168819075", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168819086", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168819095", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168819106", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550683ms" + }, + { + "at": "1789233168819118", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550683ms" + }, + { + "at": "1789233168819128", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550683ms" + }, + { + "at": "1789233168819138", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168819150", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168819160", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819170", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168819180", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168819191", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819200", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168819212", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168819222", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819234", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168819243", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168819256", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819271", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168819285", + "member": "nas01.glab.lol", + "message": "ovs|00290|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168819302", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168819316", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168819329", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168819347", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168819361", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168819378", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550683ms" + }, + { + "at": "1789233168819393", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550683ms" + }, + { + "at": "1789233168819408", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550683ms" + }, + { + "at": "1789233168819421", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168819432", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168819442", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819452", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168819463", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168819479", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819489", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168819498", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168819508", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819518", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168819527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168819537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819548", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168819557", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168821906", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler401)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168821934", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler401)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168821952", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168821979", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168821994", + "member": "nas01.glab.lol", + "message": " my_disc:0xa62322ab your_disc:0x0" + }, + { + "at": "1789233168822010", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168822027", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168822041", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168822058", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168822073", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168822082", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168822094", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168822112", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550686ms" + }, + { + "at": "1789233168822132", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +787ms" + }, + { + "at": "1789233168822147", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789233168822175", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168822190", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168822204", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822214", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168822224", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822239", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822249", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168822258", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168822270", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822280", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233168822290", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168822300", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822313", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168822326", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168822337", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168822347", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168822356", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168822365", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168822375", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168822385", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168822399", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +787ms" + }, + { + "at": "1789233168822409", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789233168822421", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168822430", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168822439", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822448", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168822457", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822467", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822476", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168822491", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168822506", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822515", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233168822527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822539", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822549", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168823236", + "member": "nas01.glab.lol", + "message": "ovs|00291|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168823261", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168823275", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168823289", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168823303", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168823317", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168823330", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550687ms" + }, + { + "at": "1789233168823347", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550687ms" + }, + { + "at": "1789233168823360", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550687ms" + }, + { + "at": "1789233168823369", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168823379", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168823389", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168823398", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168823410", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168823420", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168823428", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168823443", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168823458", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168823473", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168823487", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168823503", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168823517", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824126", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler401)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168824147", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler401)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168824164", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168824179", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168824198", + "member": "nas01.glab.lol", + "message": " my_disc:0x61d86ef2 your_disc:0x0" + }, + { + "at": "1789233168824213", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168824227", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168824237", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168824250", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824264", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824279", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824293", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168824308", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550688ms" + }, + { + "at": "1789233168824328", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +925ms" + }, + { + "at": "1789233168824339", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789233168824356", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824366", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168824377", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824389", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168824402", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824411", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824423", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824433", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168824444", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824453", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824463", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824472", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824481", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168824491", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824501", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824510", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824518", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824528", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824541", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168824551", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168824561", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +925ms" + }, + { + "at": "1789233168824570", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789233168824585", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824595", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168824604", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824613", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168824629", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824639", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824650", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824660", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168824669", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824679", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824688", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824698", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824708", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168925985", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler401)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926128", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler401)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926146", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926168", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168926180", + "member": "nas01.glab.lol", + "message": " my_disc:0xf2fd4c97 your_disc:0x7d56a557" + }, + { + "at": "1789233168926194", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926209", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926224", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926240", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926256", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926275", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926290", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926305", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550790ms" + }, + { + "at": "1789233168926322", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +754ms" + }, + { + "at": "1789233168926339", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789233168926359", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926381", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168926394", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926414", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168926429", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926444", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926455", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168926465", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168926478", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926497", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168926512", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168926524", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926538", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926553", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler401)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168926568", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168926578", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926589", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926598", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926610", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926623", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168926636", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +754ms" + }, + { + "at": "1789233168926649", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789233168926657", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926667", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168926677", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926687", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168926696", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926706", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926715", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168926725", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168926735", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926745", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168926755", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926764", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926774", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170602635", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233170603050", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233170603076", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233170603134", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233170603189", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233170603225", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233170603251", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233170603273", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +688ms" + }, + { + "at": "1789233170603295", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -152ms" + }, + { + "at": "1789233170603319", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233170603345", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233170603390", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233170603413", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233170603444", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233170603465", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170603483", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233170603502", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233170603527", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233170603548", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233170603612", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233170603643", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170603666", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170645027", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233170645219", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233170645255", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233170645280", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233170645306", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233170645342", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233170645369", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233170645460", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789233170645491", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -895ms" + }, + { + "at": "1789233170645527", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233170645550", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233170645576", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233170645610", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233170645637", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233170645664", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170645691", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233170645715", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233170645741", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233170645771", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233170645795", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233170645820", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170645851", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233178631369", + "member": "nas01.glab.lol", + "message": "ovs|00292|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (866 adds, 106 deletes, 1 modifications)" + } +] diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-teardown.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-teardown.txt new file mode 100644 index 0000000..0e0db6d --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-after-teardown.txt @@ -0,0 +1,5329 @@ +=== incus network show exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== incus network list-allocations exit=1 === +Error: Failed to load project "ac-ovn-spike": Project not found +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} +=== ovn-nbctl list Logical_Router_Port === +=== ovn-sbctl find Port_Binding type=chassisredirect === +=== ovn-nbctl list HA_Chassis_Group === +=== ovn-nbctl list HA_Chassis === +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:66:eb:74 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:66:eb:74 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168821394", + "member": "lab01.glab.lol", + "message": "ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168821548", + "member": "lab01.glab.lol", + "message": "ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c" + }, + { + "at": "1789233168821577", + "member": "lab01.glab.lol", + "message": "ovs|00214|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168823984", + "member": "lab01.glab.lol", + "message": "ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824041", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824065", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824085", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824105", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824126", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824141", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824158", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824178", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824194", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824207", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824225", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824239", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168824256", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824268", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824279", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824291", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824302", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824317", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824329", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824341", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824354", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824369", + "member": "lab01.glab.lol", + "message": "ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824383", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824399", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824410", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824423", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824433", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824444", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824455", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824466", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824478", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824489", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824505", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824517", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824529", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824540", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824550", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824561", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824572", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824583", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824592", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824602", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824619", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824629", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created" + }, + { + "at": "1789233168830826", + "member": "lab01.glab.lol", + "message": "ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168830870", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168830889", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168830901", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168830915", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168830929", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168830941", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483834ms" + }, + { + "at": "1789233168830956", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483834ms" + }, + { + "at": "1789233168830966", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483834ms" + }, + { + "at": "1789233168830979", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168830992", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168831002", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831014", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168831029", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168831040", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831053", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168831069", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168831081", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831092", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168831103", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168831115", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831130", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168919953", + "member": "lab01.glab.lol", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168920177", + "member": "lab01.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3" + }, + { + "at": "1789233168922264", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168922326", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168922365", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168922405", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168922441", + "member": "lab01.glab.lol", + "message": " my_disc:0x8cb25190 your_disc:0xc4521b29" + }, + { + "at": "1789233168922474", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168922508", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168922542", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168922585", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168922614", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168922648", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168922680", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168922710", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483925ms" + }, + { + "at": "1789233168922739", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789233168922777", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789233168922812", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168922846", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168922882", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168922914", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168922946", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168922978", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923012", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923044", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923075", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923106", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923139", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168923179", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923215", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168923247", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168923282", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168923323", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168923356", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168923388", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168923420", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168923454", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168923489", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +751ms" + }, + { + "at": "1789233168923528", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789233168923563", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168923594", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168923625", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923653", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168923684", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923715", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923749", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923780", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923811", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923842", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923873", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923907", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923938", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926377", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926481", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926527", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926562", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168926596", + "member": "lab01.glab.lol", + "message": " my_disc:0x10864ed9 your_disc:0xcfbfe66f" + }, + { + "at": "1789233168926642", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926671", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926702", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926734", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926764", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926796", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926827", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926859", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483929ms" + }, + { + "at": "1789233168926894", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168926927", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168926959", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926991", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168927023", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927057", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927088", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927120", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927148", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927180", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927211", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927239", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168927273", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168927304", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927339", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168927371", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168927407", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168927514", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168927546", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168927578", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168927609", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168927636", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168927668", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168927700", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168927731", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168927758", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168927789", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927817", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927848", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927879", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927910", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927941", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927972", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168928000", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168928031", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168928062", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168928093", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168928123", + "member": "lab01.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168928159", + "member": "lab01.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6" + }, + { + "at": "1789233169749719", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169749802", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169749820", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169749836", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233169749847", + "member": "lab01.glab.lol", + "message": " my_disc:0xae7cb34c your_disc:0x61d86ef2" + }, + { + "at": "1789233169749861", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169749872", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169749882", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169749895", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169749905", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169749927", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169749937", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169749949", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4484753ms" + }, + { + "at": "1789233169749969", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169749988", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750005", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169750019", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169750030", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750040", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750053", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750064", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750078", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750089", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750100", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750111", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750126", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169750139", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750154", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169750165", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169750177", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169750188", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169750200", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169750211", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169750221", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169750230", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169750241", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169750252", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750263", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169750273", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169750285", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750295", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750305", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750323", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750337", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750350", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750363", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750373", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750385", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750397", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750408", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170158976", + "member": "lab01.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7" + }, + { + "at": "1789233178826726", + "member": "lab01.glab.lol", + "message": "ovs|00223|connmgr|INFO|br-int<->unix#3: 913 flow_mods in the 6 s starting 10 s ago (847 adds, 58 deletes, 8 modifications)" + }, + { + "at": "1789233193165011", + "member": "lab01.glab.lol", + "message": "ovs|00224|bridge|INFO|bridge br-int: deleted interface vethd42ad9e0 on port 7" + }, + { + "at": "1789233195484004", + "member": "lab01.glab.lol", + "message": "ovs|00225|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789233195484249", + "member": "lab01.glab.lol", + "message": "ovs|00226|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233195484344", + "member": "lab01.glab.lol", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789233195501004", + "member": "lab01.glab.lol", + "message": "ovs|00228|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6" + }, + { + "at": "1789233195501040", + "member": "lab01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor65)|INFO|monitor thread terminated" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168811784", + "member": "lab02.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168811961", + "member": "lab02.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 00005ecb8e6efe4b" + }, + { + "at": "1789233168811983", + "member": "lab02.glab.lol", + "message": "ovs|00280|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168813667", + "member": "lab02.glab.lol", + "message": "ovs|00281|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168813736", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168813766", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168813788", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168813807", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168813827", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168813849", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168813872", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168813892", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168813912", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168813931", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168813949", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168813981", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168814004", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814022", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814040", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814101", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814123", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814142", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814164", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814184", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814204", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814222", + "member": "lab02.glab.lol", + "message": "ovs|00282|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814245", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814263", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814281", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814298", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814316", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814334", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168814352", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168814370", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168814390", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814413", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814436", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168814456", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814475", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168814494", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814510", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814528", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814546", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814564", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814584", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814602", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814617", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814635", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814655", + "member": "lab02.glab.lol", + "message": "ovs|00283|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814674", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814691", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814709", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814727", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814748", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814770", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168814791", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168814819", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168814846", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814867", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814890", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814927", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168814950", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814974", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814998", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168815027", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168815047", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168815069", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168815089", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168815110", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168815131", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168906956", + "member": "lab02.glab.lol", + "message": "ovs|00284|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168907003", + "member": "lab02.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789233168908983", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler387)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168909067", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler387)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233168909099", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168909125", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168909150", + "member": "lab02.glab.lol", + "message": " my_disc:0x7d56a557 your_disc:0x0" + }, + { + "at": "1789233168909170", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168909195", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168909214", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168909231", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168909250", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168909270", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168909290", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168909312", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423908ms" + }, + { + "at": "1789233168909332", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423908ms" + }, + { + "at": "1789233168909352", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423908ms" + }, + { + "at": "1789233168909369", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168909388", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168909418", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909438", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168909464", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909482", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909496", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168909505", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168909515", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909525", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233168909533", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168909542", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909551", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168909560", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168909573", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168909582", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168909590", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168909598", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168909623", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168909631", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168909642", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423908ms" + }, + { + "at": "1789233168909650", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423908ms" + }, + { + "at": "1789233168909659", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168909667", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168909677", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909685", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168909693", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909701", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909709", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168909717", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168909725", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909732", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233168909740", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909751", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909759", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168910813", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler387)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168910900", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler387)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168910936", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168910964", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168910990", + "member": "lab02.glab.lol", + "message": " my_disc:0x85855f99 your_disc:0xd9afc13d" + }, + { + "at": "1789233168911003", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168911015", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168911023", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168911032", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168911040", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168911049", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168911057", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168911065", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423910ms" + }, + { + "at": "1789233168911080", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +743ms" + }, + { + "at": "1789233168911089", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789233168911097", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168911105", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168911114", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911122", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168911133", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911142", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911150", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168911162", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168911171", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911180", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x85855f99" + }, + { + "at": "1789233168911188", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168911196", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911205", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168911213", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler387)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168911223", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168911231", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168911240", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168911250", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168911259", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168911269", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168911277", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +743ms" + }, + { + "at": "1789233168911284", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789233168911292", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168911300", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168911309", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911317", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168911325", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911332", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911342", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168911349", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168911357", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911364", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x85855f99" + }, + { + "at": "1789233168911378", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911386", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911396", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168912854", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168912911", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168912954", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168912978", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168913000", + "member": "lab02.glab.lol", + "message": " my_disc:0xcfbfe66f your_disc:0x0" + }, + { + "at": "1789233168913025", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168913046", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168913067", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168913090", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168913115", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168913141", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168913161", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168913181", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423912ms" + }, + { + "at": "1789233168913204", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423912ms" + }, + { + "at": "1789233168913228", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423912ms" + }, + { + "at": "1789233168913251", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168913276", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168913297", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913318", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168913340", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168913366", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913386", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168913417", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168913441", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913460", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168913482", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168913503", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913522", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168913543", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168913568", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168913589", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168913615", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168913636", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168913657", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168913676", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168913695", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423912ms" + }, + { + "at": "1789233168913715", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423912ms" + }, + { + "at": "1789233168913777", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168913799", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168913820", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913839", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168913860", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168913878", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913899", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168913919", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168913940", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913961", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168913979", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168914000", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168914021", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168914610", + "member": "lab02.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168914686", + "member": "lab02.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789233169699852", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169699972", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169699985", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169699995", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169700005", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169700015", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169700025", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169700033", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +774ms" + }, + { + "at": "1789233169700042", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -26ms" + }, + { + "at": "1789233169700052", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169700070", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169700084", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169700094", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233169700102", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169700111", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169700121", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169700130", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169700140", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169700149", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233169700158", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169700167", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169700176", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169903740", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169904049", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169904078", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169904101", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169904126", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169904150", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169904179", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169904204", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789233169904238", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -220ms" + }, + { + "at": "1789233169904263", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169904290", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169904324", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169904352", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233169904378", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169904418", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169904447", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169904467", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169904490", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169904510", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233169904532", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169904554", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169904573", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233178815908", + "member": "lab02.glab.lol", + "message": "ovs|00288|connmgr|INFO|br-int<->unix#7: 875 flow_mods in the 6 s starting 10 s ago (814 adds, 54 deletes, 7 modifications)" + }, + { + "at": "1789233195471158", + "member": "lab02.glab.lol", + "message": "ovs|00289|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789233195471289", + "member": "lab02.glab.lol", + "message": "ovs|00290|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233195471311", + "member": "lab02.glab.lol", + "message": "ovs|00291|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789233195487898", + "member": "lab02.glab.lol", + "message": "ovs|00292|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789233195488184", + "member": "lab02.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor417)|INFO|monitor thread terminated" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168811894", + "member": "lab03.glab.lol", + "message": "ovs|00308|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168812001", + "member": "lab03.glab.lol", + "message": "ovs|00309|bridge|INFO|bridge incusovn16: using datapath ID 0000da6e2727ca42" + }, + { + "at": "1789233168812014", + "member": "lab03.glab.lol", + "message": "ovs|00310|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168813745", + "member": "lab03.glab.lol", + "message": "ovs|00311|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168813808", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168813830", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168813843", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168813854", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168813865", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168813880", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323811ms" + }, + { + "at": "1789233168813892", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323811ms" + }, + { + "at": "1789233168813909", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323811ms" + }, + { + "at": "1789233168813921", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168813932", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168813944", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168813961", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233168813973", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168813985", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168813996", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814006", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814017", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814028", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814038", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814052", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814066", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814082", + "member": "lab03.glab.lol", + "message": "ovs|00312|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814094", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814110", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814120", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814132", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814144", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814153", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323811ms" + }, + { + "at": "1789233168814168", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323811ms" + }, + { + "at": "1789233168814178", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323811ms" + }, + { + "at": "1789233168814191", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814201", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814212", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814222", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168814239", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814255", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814266", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814278", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814290", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814300", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168814316", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814326", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814337", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814349", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168815784", + "member": "lab03.glab.lol", + "message": "ovs|00313|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168815864", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168815880", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168815892", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168815911", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168815926", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168815939", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323813ms" + }, + { + "at": "1789233168815956", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323813ms" + }, + { + "at": "1789233168815976", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323813ms" + }, + { + "at": "1789233168815990", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816002", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168816015", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816028", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168816041", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168816054", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168816071", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168816086", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168816098", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816115", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168816129", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168816143", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168816157", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168816417", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168816451", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168816469", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168816490", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168816508", + "member": "lab03.glab.lol", + "message": " my_disc:0xc4521b29 your_disc:0x0" + }, + { + "at": "1789233168816521", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168816536", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168816549", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168816563", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168816577", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168816596", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168816608", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168816626", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323814ms" + }, + { + "at": "1789233168816643", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323814ms" + }, + { + "at": "1789233168816656", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323814ms" + }, + { + "at": "1789233168816674", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816687", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168816703", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816714", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168816725", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168816737", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168816751", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168816769", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168816787", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816800", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233168816818", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168816829", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168816841", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168816858", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168816873", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168816889", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168816907", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168816919", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168816931", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168816943", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168816957", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323814ms" + }, + { + "at": "1789233168816969", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323814ms" + }, + { + "at": "1789233168816980", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816991", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168817003", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168817014", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168817026", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168817038", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168817049", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168817064", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168817080", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168817093", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233168817104", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168817119", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168817132", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168817931", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler395)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168817977", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler395)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168817994", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168818009", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168818022", + "member": "lab03.glab.lol", + "message": " my_disc:0xd9afc13d your_disc:0x0" + }, + { + "at": "1789233168818036", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168818049", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168818065", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168818081", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168818092", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168818105", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168818117", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168818129", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323815ms" + }, + { + "at": "1789233168818143", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323815ms" + }, + { + "at": "1789233168818157", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323815ms" + }, + { + "at": "1789233168818170", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168818180", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168818194", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818206", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168818218", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818230", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818242", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168818252", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168818265", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818277", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168818290", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168818302", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818330", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168818347", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168818367", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168818383", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168818394", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168818406", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168818418", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168818430", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168818443", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323815ms" + }, + { + "at": "1789233168818455", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323815ms" + }, + { + "at": "1789233168818467", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168818479", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168818491", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818504", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168818515", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818527", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818541", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168818552", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168818564", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818576", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168818589", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818600", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818614", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168910298", + "member": "lab03.glab.lol", + "message": "ovs|00314|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168910336", + "member": "lab03.glab.lol", + "message": "ovs|00315|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789233168917621", + "member": "lab03.glab.lol", + "message": "ovs|00316|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168917693", + "member": "lab03.glab.lol", + "message": "ovs|00317|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39" + }, + { + "at": "1789233169602771", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler395)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169602882", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler395)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169602923", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169602954", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233169602977", + "member": "lab03.glab.lol", + "message": " my_disc:0xed7c59ec your_disc:0xa62322ab" + }, + { + "at": "1789233169603005", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169603030", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169603057", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169603097", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169603122", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169603145", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169603172", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169603205", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55324600ms" + }, + { + "at": "1789233169603235", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +991ms" + }, + { + "at": "1789233169603266", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789233169603297", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169603322", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169603348", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169603373", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233169603398", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169603420", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169603447", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169603472", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169603498", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169603523", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xed7c59ec" + }, + { + "at": "1789233169603549", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169603577", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169603602", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169603628", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler395)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169603660", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169603751", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169603775", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169603800", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169603828", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169603853", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169603878", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +991ms" + }, + { + "at": "1789233169603901", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789233169603926", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169603950", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169604017", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169604043", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233169604075", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169604105", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169604129", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169604153", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169604182", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169604219", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xed7c59ec" + }, + { + "at": "1789233169604242", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169604266", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169604290", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169658608", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169658702", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169658732", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169658757", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169658780", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169658810", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169658833", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169658857", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +85ms" + }, + { + "at": "1789233169658888", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -745ms" + }, + { + "at": "1789233169658916", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169658994", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169659030", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169659053", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233169659091", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169659117", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169659144", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169659168", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169659193", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169659225", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233169659250", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169659277", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169659301", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169665970", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169666054", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169666078", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169666090", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169666103", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169666116", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169666128", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169666141", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +28ms" + }, + { + "at": "1789233169666154", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -752ms" + }, + { + "at": "1789233169666173", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169666184", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169666197", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169666209", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233169666221", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169666231", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169666241", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169666257", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169666267", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169666277", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233169666290", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169666300", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169666310", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170952370", + "member": "lab03.glab.lol", + "message": "ovs|00318|bridge|INFO|bridge br-int: added interface veth7279dfcc on port 40" + }, + { + "at": "1789233178816901", + "member": "lab03.glab.lol", + "message": "ovs|00319|connmgr|INFO|br-int<->unix#7: 940 flow_mods in the 6 s starting 10 s ago (852 adds, 80 deletes, 8 modifications)" + }, + { + "at": "1789233194282292", + "member": "lab03.glab.lol", + "message": "ovs|00320|bridge|INFO|bridge br-int: deleted interface veth7279dfcc on port 40" + }, + { + "at": "1789233195473171", + "member": "lab03.glab.lol", + "message": "ovs|00321|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789233195473436", + "member": "lab03.glab.lol", + "message": "ovs|00322|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233195473590", + "member": "lab03.glab.lol", + "message": "ovs|00323|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789233195496481", + "member": "lab03.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor417)|INFO|monitor thread terminated" + }, + { + "at": "1789233195499041", + "member": "lab03.glab.lol", + "message": "ovs|00324|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168798597", + "member": "nas01.glab.lol", + "message": "ovs|00282|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168798695", + "member": "nas01.glab.lol", + "message": "ovs|00283|bridge|INFO|bridge incusovn16: using datapath ID 00009ee860452c48" + }, + { + "at": "1789233168798710", + "member": "nas01.glab.lol", + "message": "ovs|00284|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168798816", + "member": "nas01.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168798832", + "member": "nas01.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789233168798843", + "member": "nas01.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168798858", + "member": "nas01.glab.lol", + "message": "ovs|00288|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26" + }, + { + "at": "1789233168819005", + "member": "nas01.glab.lol", + "message": "ovs|00289|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168819040", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168819061", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168819075", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168819086", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168819095", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168819106", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550683ms" + }, + { + "at": "1789233168819118", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550683ms" + }, + { + "at": "1789233168819128", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550683ms" + }, + { + "at": "1789233168819138", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168819150", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168819160", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819170", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168819180", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168819191", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819200", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168819212", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168819222", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819234", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168819243", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168819256", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819271", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168819285", + "member": "nas01.glab.lol", + "message": "ovs|00290|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168819302", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168819316", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168819329", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168819347", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168819361", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168819378", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550683ms" + }, + { + "at": "1789233168819393", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550683ms" + }, + { + "at": "1789233168819408", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550683ms" + }, + { + "at": "1789233168819421", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168819432", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168819442", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819452", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168819463", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168819479", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819489", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168819498", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168819508", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819518", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168819527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168819537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819548", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168819557", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168821906", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler401)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168821934", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler401)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168821952", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168821979", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168821994", + "member": "nas01.glab.lol", + "message": " my_disc:0xa62322ab your_disc:0x0" + }, + { + "at": "1789233168822010", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168822027", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168822041", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168822058", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168822073", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168822082", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168822094", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168822112", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550686ms" + }, + { + "at": "1789233168822132", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +787ms" + }, + { + "at": "1789233168822147", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789233168822175", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168822190", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168822204", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822214", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168822224", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822239", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822249", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168822258", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168822270", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822280", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233168822290", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168822300", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822313", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168822326", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168822337", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168822347", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168822356", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168822365", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168822375", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168822385", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168822399", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +787ms" + }, + { + "at": "1789233168822409", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789233168822421", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168822430", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168822439", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822448", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168822457", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822467", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822476", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168822491", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168822506", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822515", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233168822527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822539", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822549", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168823236", + "member": "nas01.glab.lol", + "message": "ovs|00291|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168823261", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168823275", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168823289", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168823303", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168823317", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168823330", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550687ms" + }, + { + "at": "1789233168823347", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550687ms" + }, + { + "at": "1789233168823360", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550687ms" + }, + { + "at": "1789233168823369", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168823379", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168823389", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168823398", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168823410", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168823420", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168823428", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168823443", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168823458", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168823473", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168823487", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168823503", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168823517", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824126", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler401)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168824147", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler401)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168824164", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168824179", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168824198", + "member": "nas01.glab.lol", + "message": " my_disc:0x61d86ef2 your_disc:0x0" + }, + { + "at": "1789233168824213", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168824227", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168824237", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168824250", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824264", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824279", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824293", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168824308", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550688ms" + }, + { + "at": "1789233168824328", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +925ms" + }, + { + "at": "1789233168824339", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789233168824356", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824366", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168824377", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824389", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168824402", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824411", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824423", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824433", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168824444", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824453", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824463", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824472", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824481", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168824491", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824501", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824510", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824518", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824528", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824541", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168824551", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168824561", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +925ms" + }, + { + "at": "1789233168824570", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789233168824585", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824595", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168824604", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824613", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168824629", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824639", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824650", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824660", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168824669", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824679", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824688", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824698", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824708", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168925985", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler401)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926128", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler401)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926146", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926168", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168926180", + "member": "nas01.glab.lol", + "message": " my_disc:0xf2fd4c97 your_disc:0x7d56a557" + }, + { + "at": "1789233168926194", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926209", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926224", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926240", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926256", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926275", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926290", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926305", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550790ms" + }, + { + "at": "1789233168926322", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +754ms" + }, + { + "at": "1789233168926339", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789233168926359", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926381", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168926394", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926414", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168926429", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926444", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926455", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168926465", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168926478", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926497", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168926512", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168926524", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926538", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926553", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler401)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168926568", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168926578", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926589", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926598", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926610", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926623", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168926636", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +754ms" + }, + { + "at": "1789233168926649", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789233168926657", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926667", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168926677", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926687", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168926696", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926706", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926715", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168926725", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168926735", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926745", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168926755", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926764", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926774", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170602635", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233170603050", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233170603076", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233170603134", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233170603189", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233170603225", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233170603251", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233170603273", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +688ms" + }, + { + "at": "1789233170603295", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -152ms" + }, + { + "at": "1789233170603319", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233170603345", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233170603390", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233170603413", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233170603444", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233170603465", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170603483", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233170603502", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233170603527", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233170603548", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233170603612", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233170603643", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170603666", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170645027", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233170645219", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233170645255", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233170645280", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233170645306", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233170645342", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233170645369", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233170645460", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789233170645491", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -895ms" + }, + { + "at": "1789233170645527", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233170645550", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233170645576", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233170645610", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233170645637", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233170645664", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170645691", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233170645715", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233170645741", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233170645771", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233170645795", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233170645820", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170645851", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233178631369", + "member": "nas01.glab.lol", + "message": "ovs|00292|connmgr|INFO|br-int<->unix#7: 973 flow_mods in the 6 s starting 10 s ago (866 adds, 106 deletes, 1 modifications)" + }, + { + "at": "1789233195485925", + "member": "nas01.glab.lol", + "message": "ovs|00293|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789233195486124", + "member": "nas01.glab.lol", + "message": "ovs|00294|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233195486138", + "member": "nas01.glab.lol", + "message": "ovs|00295|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789233195512950", + "member": "nas01.glab.lol", + "message": "ovs|00002|ofproto_dpif_monitor(monitor417)|INFO|monitor thread terminated" + }, + { + "at": "1789233195516631", + "member": "nas01.glab.lol", + "message": "ovs|00296|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26" + } +] diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-before-probe.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-before-probe.txt new file mode 100644 index 0000000..d916885 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/diagnostics-before-probe.txt @@ -0,0 +1,5338 @@ +=== incus network show exit=0 === +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +=== incus network list-allocations exit=0 === ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| USED BY | ADDRESS | NETWORK | TYPE | NAT | MAC ADDRESS | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/one?project=ac-ovn-spike | 10.253.73.2/32 | default | instance | YES | 10:66:6a:02:dd:b1 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/instances/two?project=ac-ovn-spike | 10.253.73.3/32 | default | instance | YES | 10:66:6a:35:90:e5 | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike | 10.10.40.79/32 | default | network-forward | NO | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +| /1.0/networks/default?project=ac-ovn-spike | 10.253.73.1/24 | default | network | YES | | ++-----------------------------------------------------------------+----------------+---------+-----------------+-----+-------------------+ +=== sandbox01 nb/sb/neigh exit=0 === +=== ovn-nbctl show === +switch 2fabcc2c-8c19-4664-9b37-fc7eae2922d3 (incus-net39-ls-int) + port incus-net39-ls-int-lsp-router + type: router + router-port: incus-net39-lr-lrp-int + port incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0 + addresses: ["10:66:6a:02:dd:b1 dynamic"] + port incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0 + addresses: ["10:66:6a:35:90:e5 dynamic"] +switch a755c7f5-f0d6-4322-a17b-271a274a21da (incus-net39-ls-ext) + port incus-net39-ls-ext-lsp-router + type: router + router-port: incus-net39-lr-lrp-ext + port incus-net39-ls-ext-lsp-provider + type: localnet + addresses: ["unknown"] +router 498600bd-50df-49c1-ab2c-3843a2479f5c (incus-net39-lr) + port incus-net39-lr-lrp-int + mac: "10:66:6a:66:eb:74" + ipv6-lla: "fe80::1266:6aff:fe66:eb74" + networks: ["10.253.73.1/24"] + port incus-net39-lr-lrp-ext + mac: "10:66:6a:66:eb:74" + ipv6-lla: "fe80::1266:6aff:fe66:eb74" + networks: ["10.10.40.64/24"] + nat 317a50de-d456-4a6c-ae06-7587737357a5 + external ip: "10.10.40.64" + logical ip: "10.253.73.0/24" + type: "snat" +=== ovn-sbctl show === +Chassis "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" + hostname: lab03.glab.lol + Encap geneve + ip: "10.10.30.13" + options: {csum="true"} + Port_Binding incus-net39-instance-4c35ca2f-5270-4de1-9682-6929c8560e10-eth0 +Chassis "c2919898-1135-4799-80cf-860ae7e7ef9e" + hostname: nas01.glab.lol + Encap geneve + ip: "10.10.30.14" + options: {csum="true"} +Chassis "67314e94-b0b4-4c97-8146-0c67aff4d585" + hostname: lab02.glab.lol + Encap geneve + ip: "10.10.30.12" + options: {csum="true"} +Chassis "2da6738c-78eb-4738-98be-0898402c0eaa" + hostname: lab01.glab.lol + Encap geneve + ip: "10.10.30.11" + options: {csum="true"} + Port_Binding cr-incus-net39-lr-lrp-ext + Port_Binding incus-net39-instance-172371c5-b4be-4aec-bd88-4a680cb21ed2-eth0 +=== ovn-nbctl list Logical_Router_Port === +_uuid : 8d438d4a-dc31-4873-8526-52a5346b882f +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : [] +ipv6_prefix : [] +ipv6_ra_configs : {send_periodic="false"} +mac : "10:66:6a:66:eb:74" +name : incus-net39-lr-lrp-int +networks : ["10.253.73.1/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {} + +_uuid : 973cf967-a8ef-42b9-859d-0c8cecb865fe +dhcp_relay : [] +enabled : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 54c3b455-e298-4244-96f5-74f35ecc3fc0 +ipv6_prefix : [] +ipv6_ra_configs : {} +mac : "10:66:6a:66:eb:74" +name : incus-net39-lr-lrp-ext +networks : ["10.10.40.64/24"] +options : {gateway_mtu="1442"} +peer : [] +status : {hosting-chassis="2da6738c-78eb-4738-98be-0898402c0eaa"} +=== ovn-sbctl find Port_Binding type=chassisredirect === +_uuid : f53f332a-127b-4377-91ff-518a407a5dad +additional_chassis : [] +additional_encap : [] +chassis : 72b73acb-7cce-4153-829c-7d6bb0eb202c +datapath : fe11145c-7ada-4028-a9f7-2ae19989a23b +encap : [] +external_ids : {} +gateway_chassis : [] +ha_chassis_group : 9a5658b7-bc56-4478-9bf9-c84d4cbabe45 +logical_port : cr-incus-net39-lr-lrp-ext +mac : ["10:66:6a:66:eb:74 10.10.40.64/24"] +mirror_port : [] +mirror_rules : [] +nat_addresses : [] +options : {always-redirect="true", distributed-port=incus-net39-lr-lrp-ext} +parent_port : [] +port_security : [] +requested_additional_chassis: [] +requested_chassis : [] +tag : [] +tunnel_key : 2 +type : chassisredirect +up : true +virtual_parent : [] +=== ovn-nbctl list HA_Chassis_Group === +_uuid : 54c3b455-e298-4244-96f5-74f35ecc3fc0 +external_ids : {} +ha_chassis : [30c8a37b-38ba-4349-87a9-8851248d621e, 4d0f6aae-1a22-4016-9a22-e8d7a02f445a, e9931224-7bd1-4a73-b58b-e183d7ad7600, ff9a7008-51e4-43fc-9b7e-3dc6a969ca36] +name : incus-net39 +=== ovn-nbctl list HA_Chassis === +_uuid : e9931224-7bd1-4a73-b58b-e183d7ad7600 +chassis_name : "2da6738c-78eb-4738-98be-0898402c0eaa" +external_ids : {} +priority : 30644 + +_uuid : ff9a7008-51e4-43fc-9b7e-3dc6a969ca36 +chassis_name : "67314e94-b0b4-4c97-8146-0c67aff4d585" +external_ids : {} +priority : 10877 + +_uuid : 4d0f6aae-1a22-4016-9a22-e8d7a02f445a +chassis_name : "c2919898-1135-4799-80cf-860ae7e7ef9e" +external_ids : {} +priority : 12329 + +_uuid : 30c8a37b-38ba-4349-87a9-8851248d621e +chassis_name : "5ec8d171-fbe4-49cf-9923-9d21f9c5d29b" +external_ids : {} +priority : 15145 +=== ovn-sbctl list Chassis === +{"data":[["5ec8d171-fbe4-49cf-9923-9d21f9c5d29b","lab03.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["c2919898-1135-4799-80cf-860ae7e7ef9e","nas01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["67314e94-b0b4-4c97-8146-0c67aff4d585","lab02.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]],["2da6738c-78eb-4738-98be-0898402c0eaa","lab01.glab.lol",["map",[["ct-commit-nat-v2","true"],["ct-commit-to-zone","true"],["ct-label-flush","true"],["ct-next-zone","true"],["ct-no-masked-label","true"],["ct-state-save","true"],["datapath-type","system"],["fdb-timestamp","true"],["iface-types","bareudp,erspan,geneve,gre,gtpu,internal,ip6erspan,ip6gre,patch,srv6,system,tap,vxlan"],["is-interconn","false"],["ls-dpg-column","true"],["mac-binding-timestamp","true"],["ovn-bridge-mappings","fast40-uplink:incusovn16"],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""],["ovn-ct-lb-related","true"],["ovn-enable-lflow-cache","true"],["ovn-evpn-local-ip",""],["ovn-evpn-vxlan-ports",""],["ovn-limit-lflow-cache",""],["ovn-memlimit-lflow-cache-kb",""],["ovn-monitor-all","false"],["ovn-sample-with-registers","true"],["ovn-trim-limit-lflow-cache",""],["ovn-trim-timeout-ms",""],["ovn-trim-wmark-perc-lflow-cache",""],["port-up-notif","true"]]]]],"headings":["name","hostname","other_config"]} +=== ip neigh === +10.10.40.64 dev enp2s0 lladdr 10:66:6a:66:eb:74 STALE +=== gateway neigh exit=0 === +10.10.40.64 dev br40 lladdr 10:66:6a:66:eb:74 REACHABLE +=== lab01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168821394", + "member": "lab01.glab.lol", + "message": "ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168821548", + "member": "lab01.glab.lol", + "message": "ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c" + }, + { + "at": "1789233168821577", + "member": "lab01.glab.lol", + "message": "ovs|00214|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168823984", + "member": "lab01.glab.lol", + "message": "ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824041", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824065", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824085", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824105", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824126", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824141", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824158", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824178", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824194", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824207", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824225", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824239", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168824256", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824268", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824279", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824291", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824302", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824317", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824329", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824341", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824354", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824369", + "member": "lab01.glab.lol", + "message": "ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824383", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824399", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824410", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824423", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824433", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824444", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824455", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824466", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824478", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824489", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824505", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824517", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824529", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824540", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824550", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824561", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824572", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824583", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824592", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824602", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824619", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824629", + "member": "lab01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created" + }, + { + "at": "1789233168830826", + "member": "lab01.glab.lol", + "message": "ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168830870", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168830889", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168830901", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168830915", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168830929", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168830941", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483834ms" + }, + { + "at": "1789233168830956", + "member": "lab01.glab.lol", + "message": " Next TX Time: now -4483834ms" + }, + { + "at": "1789233168830966", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -4483834ms" + }, + { + "at": "1789233168830979", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168830992", + "member": "lab01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168831002", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831014", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168831029", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168831040", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831053", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168831069", + "member": "lab01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168831081", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831092", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168831103", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168831115", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831130", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168919953", + "member": "lab01.glab.lol", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168920177", + "member": "lab01.glab.lol", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3" + }, + { + "at": "1789233168922264", + "member": "lab01.glab.lol", + "message": "ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168922326", + "member": "lab01.glab.lol", + "message": "ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168922365", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168922405", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168922441", + "member": "lab01.glab.lol", + "message": " my_disc:0x8cb25190 your_disc:0xc4521b29" + }, + { + "at": "1789233168922474", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168922508", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168922542", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168922585", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168922614", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168922648", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168922680", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168922710", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483925ms" + }, + { + "at": "1789233168922739", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789233168922777", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789233168922812", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168922846", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168922882", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168922914", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168922946", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168922978", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923012", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923044", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923075", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923106", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923139", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168923179", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923215", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168923247", + "member": "lab01.glab.lol", + "message": "ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168923282", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168923323", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168923356", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168923388", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168923420", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168923454", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168923489", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +751ms" + }, + { + "at": "1789233168923528", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789233168923563", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168923594", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168923625", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923653", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168923684", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923715", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923749", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923780", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923811", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923842", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923873", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923907", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923938", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926377", + "member": "lab01.glab.lol", + "message": "ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926481", + "member": "lab01.glab.lol", + "message": "ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926527", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926562", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168926596", + "member": "lab01.glab.lol", + "message": " my_disc:0x10864ed9 your_disc:0xcfbfe66f" + }, + { + "at": "1789233168926642", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926671", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926702", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926734", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926764", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926796", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926827", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926859", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4483929ms" + }, + { + "at": "1789233168926894", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168926927", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168926959", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926991", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168927023", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927057", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927088", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927120", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927148", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927180", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927211", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927239", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168927273", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168927304", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927339", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168927371", + "member": "lab01.glab.lol", + "message": "ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168927407", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168927514", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168927546", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168927578", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168927609", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168927636", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168927668", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168927700", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168927731", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168927758", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168927789", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927817", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927848", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927879", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927910", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927941", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927972", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168928000", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168928031", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168928062", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168928093", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168928123", + "member": "lab01.glab.lol", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168928159", + "member": "lab01.glab.lol", + "message": "ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6" + }, + { + "at": "1789233169749719", + "member": "lab01.glab.lol", + "message": "ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169749802", + "member": "lab01.glab.lol", + "message": "ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169749820", + "member": "lab01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169749836", + "member": "lab01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233169749847", + "member": "lab01.glab.lol", + "message": " my_disc:0xae7cb34c your_disc:0x61d86ef2" + }, + { + "at": "1789233169749861", + "member": "lab01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169749872", + "member": "lab01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169749882", + "member": "lab01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169749895", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169749905", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169749927", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169749937", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169749949", + "member": "lab01.glab.lol", + "message": " Detect Time: now -4484753ms" + }, + { + "at": "1789233169749969", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169749988", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750005", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169750019", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169750030", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750040", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750053", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750064", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750078", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750089", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750100", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750111", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750126", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169750139", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750154", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169750165", + "member": "lab01.glab.lol", + "message": "ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169750177", + "member": "lab01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169750188", + "member": "lab01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169750200", + "member": "lab01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169750211", + "member": "lab01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169750221", + "member": "lab01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169750230", + "member": "lab01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169750241", + "member": "lab01.glab.lol", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169750252", + "member": "lab01.glab.lol", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750263", + "member": "lab01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169750273", + "member": "lab01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169750285", + "member": "lab01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750295", + "member": "lab01.glab.lol", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750305", + "member": "lab01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750323", + "member": "lab01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750337", + "member": "lab01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750350", + "member": "lab01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750363", + "member": "lab01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750373", + "member": "lab01.glab.lol", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750385", + "member": "lab01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750397", + "member": "lab01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750408", + "member": "lab01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170158976", + "member": "lab01.glab.lol", + "message": "ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7" + } +] +=== lab02 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168811784", + "member": "lab02.glab.lol", + "message": "ovs|00278|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168811961", + "member": "lab02.glab.lol", + "message": "ovs|00279|bridge|INFO|bridge incusovn16: using datapath ID 00005ecb8e6efe4b" + }, + { + "at": "1789233168811983", + "member": "lab02.glab.lol", + "message": "ovs|00280|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168813667", + "member": "lab02.glab.lol", + "message": "ovs|00281|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168813736", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168813766", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168813788", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168813807", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168813827", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168813849", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168813872", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168813892", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168813912", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168813931", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168813949", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168813981", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168814004", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814022", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814040", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814101", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814123", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814142", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814164", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814184", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814204", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814222", + "member": "lab02.glab.lol", + "message": "ovs|00282|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814245", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814263", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814281", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814298", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814316", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814334", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168814352", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168814370", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168814390", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814413", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814436", + "member": "lab02.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168814456", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814475", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168814494", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814510", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814528", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814546", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814564", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814584", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814602", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814617", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814635", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814655", + "member": "lab02.glab.lol", + "message": "ovs|00283|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814674", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814691", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814709", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814727", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814748", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814770", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423813ms" + }, + { + "at": "1789233168814791", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423813ms" + }, + { + "at": "1789233168814819", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423813ms" + }, + { + "at": "1789233168814846", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814867", + "member": "lab02.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814890", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814927", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168814950", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814974", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814998", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168815027", + "member": "lab02.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168815047", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168815069", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168815089", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168815110", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168815131", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168906956", + "member": "lab02.glab.lol", + "message": "ovs|00284|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168907003", + "member": "lab02.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: using datapath ID 000038052532dd99" + }, + { + "at": "1789233168908983", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler387)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168909067", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler387)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233168909099", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168909125", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168909150", + "member": "lab02.glab.lol", + "message": " my_disc:0x7d56a557 your_disc:0x0" + }, + { + "at": "1789233168909170", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168909195", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168909214", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168909231", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168909250", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168909270", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168909290", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168909312", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423908ms" + }, + { + "at": "1789233168909332", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423908ms" + }, + { + "at": "1789233168909352", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423908ms" + }, + { + "at": "1789233168909369", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168909388", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168909418", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909438", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168909464", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909482", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909496", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168909505", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168909515", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909525", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233168909533", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168909542", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909551", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168909560", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168909573", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168909582", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168909590", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168909598", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168909623", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168909631", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168909642", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423908ms" + }, + { + "at": "1789233168909650", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423908ms" + }, + { + "at": "1789233168909659", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168909667", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168909677", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909685", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168909693", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909701", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909709", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168909717", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168909725", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168909732", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233168909740", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168909751", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168909759", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168910813", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler387)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168910900", + "member": "lab02.glab.lol", + "message": "ovs|00005|bfd(handler387)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168910936", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168910964", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168910990", + "member": "lab02.glab.lol", + "message": " my_disc:0x85855f99 your_disc:0xd9afc13d" + }, + { + "at": "1789233168911003", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168911015", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168911023", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168911032", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168911040", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168911049", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168911057", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168911065", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423910ms" + }, + { + "at": "1789233168911080", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +743ms" + }, + { + "at": "1789233168911089", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789233168911097", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168911105", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168911114", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911122", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168911133", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911142", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911150", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168911162", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168911171", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911180", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x85855f99" + }, + { + "at": "1789233168911188", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168911196", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911205", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168911213", + "member": "lab02.glab.lol", + "message": "ovs|00006|bfd(handler387)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168911223", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168911231", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168911240", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168911250", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168911259", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168911269", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168911277", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +743ms" + }, + { + "at": "1789233168911284", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -97ms" + }, + { + "at": "1789233168911292", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168911300", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168911309", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911317", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168911325", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911332", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911342", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168911349", + "member": "lab02.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168911357", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168911364", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x85855f99" + }, + { + "at": "1789233168911378", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168911386", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168911396", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168912854", + "member": "lab02.glab.lol", + "message": "ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168912911", + "member": "lab02.glab.lol", + "message": "ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168912954", + "member": "lab02.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168912978", + "member": "lab02.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168913000", + "member": "lab02.glab.lol", + "message": " my_disc:0xcfbfe66f your_disc:0x0" + }, + { + "at": "1789233168913025", + "member": "lab02.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168913046", + "member": "lab02.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168913067", + "member": "lab02.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168913090", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168913115", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168913141", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168913161", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168913181", + "member": "lab02.glab.lol", + "message": " Detect Time: now -1596423912ms" + }, + { + "at": "1789233168913204", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423912ms" + }, + { + "at": "1789233168913228", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423912ms" + }, + { + "at": "1789233168913251", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168913276", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168913297", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913318", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168913340", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168913366", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913386", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168913417", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168913441", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913460", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168913482", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168913503", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913522", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168913543", + "member": "lab02.glab.lol", + "message": "ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168913568", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168913589", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168913615", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168913636", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168913657", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168913676", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168913695", + "member": "lab02.glab.lol", + "message": " Next TX Time: now -1596423912ms" + }, + { + "at": "1789233168913715", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -1596423912ms" + }, + { + "at": "1789233168913777", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168913799", + "member": "lab02.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168913820", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913839", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233168913860", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168913878", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168913899", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168913919", + "member": "lab02.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168913940", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168913961", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168913979", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168914000", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168914021", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168914610", + "member": "lab02.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168914686", + "member": "lab02.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 24" + }, + { + "at": "1789233169699852", + "member": "lab02.glab.lol", + "message": "ovs|00007|bfd(handler387)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169699972", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169699985", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169699995", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169700005", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169700015", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169700025", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169700033", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +774ms" + }, + { + "at": "1789233169700042", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -26ms" + }, + { + "at": "1789233169700052", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169700070", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169700084", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169700094", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233169700102", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169700111", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169700121", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169700130", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169700140", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169700149", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0x7d56a557" + }, + { + "at": "1789233169700158", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169700167", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169700176", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169903740", + "member": "lab02.glab.lol", + "message": "ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169904049", + "member": "lab02.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169904078", + "member": "lab02.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169904101", + "member": "lab02.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169904126", + "member": "lab02.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169904150", + "member": "lab02.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169904179", + "member": "lab02.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169904204", + "member": "lab02.glab.lol", + "message": " Next TX Time: now +670ms" + }, + { + "at": "1789233169904238", + "member": "lab02.glab.lol", + "message": " Last TX Time: now -220ms" + }, + { + "at": "1789233169904263", + "member": "lab02.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169904290", + "member": "lab02.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169904324", + "member": "lab02.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169904352", + "member": "lab02.glab.lol", + "message": " Local Discriminator: 0x10864ed9" + }, + { + "at": "1789233169904378", + "member": "lab02.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169904418", + "member": "lab02.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169904447", + "member": "lab02.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169904467", + "member": "lab02.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169904490", + "member": "lab02.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169904510", + "member": "lab02.glab.lol", + "message": " Remote Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233169904532", + "member": "lab02.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169904554", + "member": "lab02.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169904573", + "member": "lab02.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] +=== lab03 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168811894", + "member": "lab03.glab.lol", + "message": "ovs|00308|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168812001", + "member": "lab03.glab.lol", + "message": "ovs|00309|bridge|INFO|bridge incusovn16: using datapath ID 0000da6e2727ca42" + }, + { + "at": "1789233168812014", + "member": "lab03.glab.lol", + "message": "ovs|00310|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168813745", + "member": "lab03.glab.lol", + "message": "ovs|00311|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168813808", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168813830", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168813843", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168813854", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168813865", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168813880", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323811ms" + }, + { + "at": "1789233168813892", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323811ms" + }, + { + "at": "1789233168813909", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323811ms" + }, + { + "at": "1789233168813921", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168813932", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168813944", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168813961", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233168813973", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168813985", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168813996", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814006", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814017", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814028", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814038", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814052", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814066", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168814082", + "member": "lab03.glab.lol", + "message": "ovs|00312|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168814094", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168814110", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168814120", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168814132", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168814144", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168814153", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323811ms" + }, + { + "at": "1789233168814168", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323811ms" + }, + { + "at": "1789233168814178", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323811ms" + }, + { + "at": "1789233168814191", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168814201", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168814212", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814222", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168814239", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168814255", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814266", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168814278", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168814290", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168814300", + "member": "lab03.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168814316", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168814326", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168814337", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168814349", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168815784", + "member": "lab03.glab.lol", + "message": "ovs|00313|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168815864", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168815880", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168815892", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168815911", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168815926", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168815939", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323813ms" + }, + { + "at": "1789233168815956", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323813ms" + }, + { + "at": "1789233168815976", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323813ms" + }, + { + "at": "1789233168815990", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816002", + "member": "lab03.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168816015", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816028", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168816041", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168816054", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168816071", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168816086", + "member": "lab03.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168816098", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816115", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168816129", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168816143", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168816157", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168816417", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler392)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168816451", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler392)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168816469", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168816490", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168816508", + "member": "lab03.glab.lol", + "message": " my_disc:0xc4521b29 your_disc:0x0" + }, + { + "at": "1789233168816521", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168816536", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168816549", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168816563", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168816577", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168816596", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168816608", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168816626", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323814ms" + }, + { + "at": "1789233168816643", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323814ms" + }, + { + "at": "1789233168816656", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323814ms" + }, + { + "at": "1789233168816674", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816687", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168816703", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816714", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168816725", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168816737", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168816751", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168816769", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168816787", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168816800", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233168816818", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168816829", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168816841", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168816858", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168816873", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168816889", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168816907", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168816919", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168816931", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168816943", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168816957", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323814ms" + }, + { + "at": "1789233168816969", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323814ms" + }, + { + "at": "1789233168816980", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168816991", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168817003", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168817014", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233168817026", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168817038", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168817049", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168817064", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168817080", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168817093", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233168817104", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168817119", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168817132", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168817931", + "member": "lab03.glab.lol", + "message": "ovs|00001|bfd(handler395)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168817977", + "member": "lab03.glab.lol", + "message": "ovs|00002|bfd(handler395)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168817994", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168818009", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168818022", + "member": "lab03.glab.lol", + "message": " my_disc:0xd9afc13d your_disc:0x0" + }, + { + "at": "1789233168818036", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168818049", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168818065", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168818081", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168818092", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168818105", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168818117", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168818129", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55323815ms" + }, + { + "at": "1789233168818143", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323815ms" + }, + { + "at": "1789233168818157", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323815ms" + }, + { + "at": "1789233168818170", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168818180", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168818194", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818206", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168818218", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818230", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818242", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168818252", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168818265", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818277", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168818290", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168818302", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818330", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168818347", + "member": "lab03.glab.lol", + "message": "ovs|00003|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168818367", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168818383", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168818394", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168818406", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168818418", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168818430", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168818443", + "member": "lab03.glab.lol", + "message": " Next TX Time: now -55323815ms" + }, + { + "at": "1789233168818455", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -55323815ms" + }, + { + "at": "1789233168818467", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168818479", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168818491", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818504", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233168818515", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818527", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818541", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168818552", + "member": "lab03.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168818564", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168818576", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233168818589", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168818600", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168818614", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168910298", + "member": "lab03.glab.lol", + "message": "ovs|00314|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168910336", + "member": "lab03.glab.lol", + "message": "ovs|00315|bridge|INFO|bridge incusovn16: using datapath ID 000038052532e13b" + }, + { + "at": "1789233168917621", + "member": "lab03.glab.lol", + "message": "ovs|00316|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168917693", + "member": "lab03.glab.lol", + "message": "ovs|00317|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 39" + }, + { + "at": "1789233169602771", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler395)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169602882", + "member": "lab03.glab.lol", + "message": "ovs|00005|bfd(handler395)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169602923", + "member": "lab03.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169602954", + "member": "lab03.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233169602977", + "member": "lab03.glab.lol", + "message": " my_disc:0xed7c59ec your_disc:0xa62322ab" + }, + { + "at": "1789233169603005", + "member": "lab03.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169603030", + "member": "lab03.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169603057", + "member": "lab03.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169603097", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169603122", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169603145", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169603172", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169603205", + "member": "lab03.glab.lol", + "message": " Detect Time: now -55324600ms" + }, + { + "at": "1789233169603235", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +991ms" + }, + { + "at": "1789233169603266", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789233169603297", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169603322", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169603348", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169603373", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233169603398", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169603420", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169603447", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169603472", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169603498", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169603523", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xed7c59ec" + }, + { + "at": "1789233169603549", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169603577", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169603602", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169603628", + "member": "lab03.glab.lol", + "message": "ovs|00006|bfd(handler395)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169603660", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169603751", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169603775", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169603800", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169603828", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169603853", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169603878", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +991ms" + }, + { + "at": "1789233169603901", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -9ms" + }, + { + "at": "1789233169603926", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169603950", + "member": "lab03.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233169604017", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169604043", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0xa62322ab" + }, + { + "at": "1789233169604075", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169604105", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169604129", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169604153", + "member": "lab03.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233169604182", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169604219", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xed7c59ec" + }, + { + "at": "1789233169604242", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169604266", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169604290", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169658608", + "member": "lab03.glab.lol", + "message": "ovs|00007|bfd(handler395)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169658702", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169658732", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169658757", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169658780", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169658810", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169658833", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169658857", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +85ms" + }, + { + "at": "1789233169658888", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -745ms" + }, + { + "at": "1789233169658916", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169658994", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169659030", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169659053", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x85855f99" + }, + { + "at": "1789233169659091", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169659117", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169659144", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169659168", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169659193", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169659225", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xd9afc13d" + }, + { + "at": "1789233169659250", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169659277", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169659301", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169665970", + "member": "lab03.glab.lol", + "message": "ovs|00004|bfd(handler392)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169666054", + "member": "lab03.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233169666078", + "member": "lab03.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169666090", + "member": "lab03.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169666103", + "member": "lab03.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169666116", + "member": "lab03.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169666128", + "member": "lab03.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169666141", + "member": "lab03.glab.lol", + "message": " Next TX Time: now +28ms" + }, + { + "at": "1789233169666154", + "member": "lab03.glab.lol", + "message": " Last TX Time: now -752ms" + }, + { + "at": "1789233169666173", + "member": "lab03.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233169666184", + "member": "lab03.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233169666197", + "member": "lab03.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169666209", + "member": "lab03.glab.lol", + "message": " Local Discriminator: 0x8cb25190" + }, + { + "at": "1789233169666221", + "member": "lab03.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169666231", + "member": "lab03.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169666241", + "member": "lab03.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233169666257", + "member": "lab03.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233169666267", + "member": "lab03.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169666277", + "member": "lab03.glab.lol", + "message": " Remote Discriminator: 0xc4521b29" + }, + { + "at": "1789233169666290", + "member": "lab03.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233169666300", + "member": "lab03.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169666310", + "member": "lab03.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170952370", + "member": "lab03.glab.lol", + "message": "ovs|00318|bridge|INFO|bridge br-int: added interface veth7279dfcc on port 40" + } +] +=== nas01 ovs-vswitchd journal since cycle start exit=0 === +[ + { + "at": "1789233168798597", + "member": "nas01.glab.lol", + "message": "ovs|00282|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168798695", + "member": "nas01.glab.lol", + "message": "ovs|00283|bridge|INFO|bridge incusovn16: using datapath ID 00009ee860452c48" + }, + { + "at": "1789233168798710", + "member": "nas01.glab.lol", + "message": "ovs|00284|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168798816", + "member": "nas01.glab.lol", + "message": "ovs|00285|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168798832", + "member": "nas01.glab.lol", + "message": "ovs|00286|bridge|INFO|bridge incusovn16: using datapath ID 0000380525378d7b" + }, + { + "at": "1789233168798843", + "member": "nas01.glab.lol", + "message": "ovs|00287|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168798858", + "member": "nas01.glab.lol", + "message": "ovs|00288|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 26" + }, + { + "at": "1789233168819005", + "member": "nas01.glab.lol", + "message": "ovs|00289|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168819040", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168819061", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168819075", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168819086", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168819095", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168819106", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550683ms" + }, + { + "at": "1789233168819118", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550683ms" + }, + { + "at": "1789233168819128", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550683ms" + }, + { + "at": "1789233168819138", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168819150", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168819160", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819170", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168819180", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168819191", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819200", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168819212", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168819222", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819234", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168819243", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168819256", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819271", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168819285", + "member": "nas01.glab.lol", + "message": "ovs|00290|bfd|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168819302", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168819316", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168819329", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168819347", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168819361", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168819378", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550683ms" + }, + { + "at": "1789233168819393", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550683ms" + }, + { + "at": "1789233168819408", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550683ms" + }, + { + "at": "1789233168819421", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168819432", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168819442", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819452", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168819463", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168819479", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819489", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168819498", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168819508", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168819518", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168819527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168819537", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168819548", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168819557", + "member": "nas01.glab.lol", + "message": "ovs|00001|ofproto_dpif_monitor(monitor417)|INFO|monitor thread created" + }, + { + "at": "1789233168821906", + "member": "nas01.glab.lol", + "message": "ovs|00001|bfd(handler401)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168821934", + "member": "nas01.glab.lol", + "message": "ovs|00002|bfd(handler401)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168821952", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168821979", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168821994", + "member": "nas01.glab.lol", + "message": " my_disc:0xa62322ab your_disc:0x0" + }, + { + "at": "1789233168822010", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168822027", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168822041", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168822058", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168822073", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168822082", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168822094", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168822112", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550686ms" + }, + { + "at": "1789233168822132", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +787ms" + }, + { + "at": "1789233168822147", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789233168822175", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168822190", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168822204", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822214", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168822224", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822239", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822249", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168822258", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168822270", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822280", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233168822290", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168822300", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822313", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168822326", + "member": "nas01.glab.lol", + "message": "ovs|00003|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168822337", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168822347", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168822356", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168822365", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168822375", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168822385", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168822399", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +787ms" + }, + { + "at": "1789233168822409", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -3ms" + }, + { + "at": "1789233168822421", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168822430", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168822439", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822448", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233168822457", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822467", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822476", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168822491", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168822506", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168822515", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233168822527", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168822539", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168822549", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168823236", + "member": "nas01.glab.lol", + "message": "ovs|00291|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168823261", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168823275", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168823289", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168823303", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168823317", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168823330", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550687ms" + }, + { + "at": "1789233168823347", + "member": "nas01.glab.lol", + "message": " Next TX Time: now -1596550687ms" + }, + { + "at": "1789233168823360", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -1596550687ms" + }, + { + "at": "1789233168823369", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168823379", + "member": "nas01.glab.lol", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168823389", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168823398", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168823410", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168823420", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168823428", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168823443", + "member": "nas01.glab.lol", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168823458", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168823473", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168823487", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168823503", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168823517", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824126", + "member": "nas01.glab.lol", + "message": "ovs|00004|bfd(handler401)|INFO|Interface ovn-2da673-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168824147", + "member": "nas01.glab.lol", + "message": "ovs|00005|bfd(handler401)|INFO|ovn-2da673-0: New remote min_rx." + }, + { + "at": "1789233168824164", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:down mult:3 length:24" + }, + { + "at": "1789233168824179", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168824198", + "member": "nas01.glab.lol", + "message": " my_disc:0x61d86ef2 your_disc:0x0" + }, + { + "at": "1789233168824213", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168824227", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168824237", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168824250", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824264", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824279", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824293", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168824308", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550688ms" + }, + { + "at": "1789233168824328", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +925ms" + }, + { + "at": "1789233168824339", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789233168824356", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824366", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168824377", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824389", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168824402", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824411", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824423", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824433", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168824444", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824453", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824463", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824472", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824481", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168824491", + "member": "nas01.glab.lol", + "message": "ovs|00006|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824501", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168824510", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824518", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824528", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824541", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168824551", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168824561", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +925ms" + }, + { + "at": "1789233168824570", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -5ms" + }, + { + "at": "1789233168824585", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168824595", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168824604", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824613", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233168824629", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824639", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824650", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824660", + "member": "nas01.glab.lol", + "message": " Remote Session State: down" + }, + { + "at": "1789233168824669", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824679", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824688", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824698", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168824708", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168925985", + "member": "nas01.glab.lol", + "message": "ovs|00007|bfd(handler401)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926128", + "member": "nas01.glab.lol", + "message": "ovs|00008|bfd(handler401)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926146", + "member": "nas01.glab.lol", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926168", + "member": "nas01.glab.lol", + "message": " flags: none" + }, + { + "at": "1789233168926180", + "member": "nas01.glab.lol", + "message": " my_disc:0xf2fd4c97 your_disc:0x7d56a557" + }, + { + "at": "1789233168926194", + "member": "nas01.glab.lol", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926209", + "member": "nas01.glab.lol", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926224", + "member": "nas01.glab.lol", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926240", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926256", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926275", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926290", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926305", + "member": "nas01.glab.lol", + "message": " Detect Time: now -1596550790ms" + }, + { + "at": "1789233168926322", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +754ms" + }, + { + "at": "1789233168926339", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789233168926359", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926381", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168926394", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926414", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168926429", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926444", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926455", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168926465", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168926478", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926497", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168926512", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168926524", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926538", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926553", + "member": "nas01.glab.lol", + "message": "ovs|00009|bfd(handler401)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168926568", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233168926578", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926589", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926598", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926610", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926623", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168926636", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +754ms" + }, + { + "at": "1789233168926649", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -6ms" + }, + { + "at": "1789233168926657", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233168926667", + "member": "nas01.glab.lol", + "message": " Local Session State: down" + }, + { + "at": "1789233168926677", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926687", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0x7d56a557" + }, + { + "at": "1789233168926696", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926706", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926715", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233168926725", + "member": "nas01.glab.lol", + "message": " Remote Session State: init" + }, + { + "at": "1789233168926735", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168926745", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xf2fd4c97" + }, + { + "at": "1789233168926755", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168926764", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168926774", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170602635", + "member": "nas01.glab.lol", + "message": "ovs|00010|bfd(handler401)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233170603050", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233170603076", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233170603134", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233170603189", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233170603225", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233170603251", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233170603273", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +688ms" + }, + { + "at": "1789233170603295", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -152ms" + }, + { + "at": "1789233170603319", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233170603345", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233170603390", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233170603413", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xed7c59ec" + }, + { + "at": "1789233170603444", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233170603465", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170603483", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233170603502", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233170603527", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233170603548", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0xa62322ab" + }, + { + "at": "1789233170603612", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233170603643", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170603666", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170645027", + "member": "nas01.glab.lol", + "message": "ovs|00011|bfd(handler401)|INFO|ovn-2da673-0: BFD state change: (bfd.SessionState: init, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233170645219", + "member": "nas01.glab.lol", + "message": " Forwarding: false" + }, + { + "at": "1789233170645255", + "member": "nas01.glab.lol", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233170645280", + "member": "nas01.glab.lol", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233170645306", + "member": "nas01.glab.lol", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233170645342", + "member": "nas01.glab.lol", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233170645369", + "member": "nas01.glab.lol", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233170645460", + "member": "nas01.glab.lol", + "message": " Next TX Time: now +105ms" + }, + { + "at": "1789233170645491", + "member": "nas01.glab.lol", + "message": " Last TX Time: now -895ms" + }, + { + "at": "1789233170645527", + "member": "nas01.glab.lol", + "message": " Local Flags: none" + }, + { + "at": "1789233170645550", + "member": "nas01.glab.lol", + "message": " Local Session State: init" + }, + { + "at": "1789233170645576", + "member": "nas01.glab.lol", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233170645610", + "member": "nas01.glab.lol", + "message": " Local Discriminator: 0xae7cb34c" + }, + { + "at": "1789233170645637", + "member": "nas01.glab.lol", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233170645664", + "member": "nas01.glab.lol", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170645691", + "member": "nas01.glab.lol", + "message": " Remote Flags: none" + }, + { + "at": "1789233170645715", + "member": "nas01.glab.lol", + "message": " Remote Session State: up" + }, + { + "at": "1789233170645741", + "member": "nas01.glab.lol", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233170645771", + "member": "nas01.glab.lol", + "message": " Remote Discriminator: 0x61d86ef2" + }, + { + "at": "1789233170645795", + "member": "nas01.glab.lol", + "message": " Remote Minimum TX Interval: 100ms" + }, + { + "at": "1789233170645820", + "member": "nas01.glab.lol", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233170645851", + "member": "nas01.glab.lol", + "message": " Remote Detect Multiplier: 3" + } +] diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.debug.log b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.debug.log new file mode 100644 index 0000000..6644b48 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.debug.log @@ -0,0 +1 @@ +time="2026-09-12T10:12:46-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.log b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.log new file mode 100644 index 0000000..4c51db5 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-create.log @@ -0,0 +1,545 @@ +time="2026-09-12T17:12:46Z" level=debug msg="[nas01] Event listener server handler started" id=a84965b9-2d3c-4ad7-a255-d25a2d44ac0e local="10.10.10.14:8443" remote="100.122.142.76:51654" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51676" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51677" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51678" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51679" method=GET protocol=tls url="/1.0/networks/fast40-uplink?project=default" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51680" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51681" method=GET protocol=tls url="/1.0/images/aliases/router?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51682" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51683" method=POST protocol=tls url=/1.0/projects username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51684" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51685" method=POST protocol=tls url="/1.0/networks?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Setting up network" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Create" clientType=normal config="map[dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink]" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Stable MAC generated" driver=ovn hwAddr="10:66:6a:66:eb:74" network=default project=ac-ovn-spike seed=2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010.0.39 +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Start" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Chassis group entry added" chassisGroup=incus-net39 driver=ovn memberID=1 network=default priority=12329 project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Marked network local status as created" network=default project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Created network on local cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" network=default project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.12:8443/1.0" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.12:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.12:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.10.30.12:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"qemu | lxc\",\n\t\t\t\"driver_version\": \"11.1.1 | 7.0.0\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.1.10-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202608242359\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab02\",\n\t\t\t\"server_pid\": 735920,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.3-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.3-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.13:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.13:8443\",\n\t\t\t\t\"10.10.30.13:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\",\n\t\t\t\t\"10.57.139.1:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab03\",\n\t\t\t\"server_pid\": 2092,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"name\": \"default\",\n\t\t\"type\": \"ovn\"\n\t}" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks?project=ac-ovn-spike" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] \n\t{\n\t\t\"config\": {\n\t\t\t\"cluster.https_address\": \"10.10.10.11:8443\",\n\t\t\t\"core.https_address\": \":8443\",\n\t\t\t\"network.ovn.northbound_connection\": \"tcp:10.10.40.10:6641\"\n\t\t},\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t\"profile_usedby\",\n\t\t\t\"container_push\",\n\t\t\t\"container_exec_recording\",\n\t\t\t\"certificate_update\",\n\t\t\t\"container_exec_signal_handling\",\n\t\t\t\"gpu_devices\",\n\t\t\t\"container_image_properties\",\n\t\t\t\"migration_progress\",\n\t\t\t\"id_map\",\n\t\t\t\"network_firewall_filtering\",\n\t\t\t\"network_routes\",\n\t\t\t\"storage\",\n\t\t\t\"file_delete\",\n\t\t\t\"file_append\",\n\t\t\t\"network_dhcp_expiry\",\n\t\t\t\"storage_lvm_vg_rename\",\n\t\t\t\"storage_lvm_thinpool_rename\",\n\t\t\t\"network_vlan\",\n\t\t\t\"image_create_aliases\",\n\t\t\t\"container_stateless_copy\",\n\t\t\t\"container_only_migration\",\n\t\t\t\"storage_zfs_clone_copy\",\n\t\t\t\"unix_device_rename\",\n\t\t\t\"storage_lvm_use_thinpool\",\n\t\t\t\"storage_rsync_bwlimit\",\n\t\t\t\"network_vxlan_interface\",\n\t\t\t\"storage_btrfs_mount_options\",\n\t\t\t\"entity_description\",\n\t\t\t\"image_force_refresh\",\n\t\t\t\"storage_lvm_lv_resizing\",\n\t\t\t\"id_map_base\",\n\t\t\t\"file_symlinks\",\n\t\t\t\"container_push_target\",\n\t\t\t\"network_vlan_physical\",\n\t\t\t\"storage_images_delete\",\n\t\t\t\"container_edit_metadata\",\n\t\t\t\"container_snapshot_stateful_migration\",\n\t\t\t\"storage_driver_ceph\",\n\t\t\t\"storage_ceph_user_name\",\n\t\t\t\"resource_limits\",\n\t\t\t\"storage_volatile_initial_source\",\n\t\t\t\"storage_ceph_force_osd_reuse\",\n\t\t\t\"storage_block_filesystem_btrfs\",\n\t\t\t\"resources\",\n\t\t\t\"kernel_limits\",\n\t\t\t\"storage_api_volume_rename\",\n\t\t\t\"network_sriov\",\n\t\t\t\"console\",\n\t\t\t\"restrict_dev_incus\",\n\t\t\t\"migration_pre_copy\",\n\t\t\t\"infiniband\",\n\t\t\t\"dev_incus_events\",\n\t\t\t\"proxy\",\n\t\t\t\"network_dhcp_gateway\",\n\t\t\t\"file_get_symlink\",\n\t\t\t\"network_leases\",\n\t\t\t\"unix_device_hotplug\",\n\t\t\t\"storage_api_local_volume_handling\",\n\t\t\t\"operation_description\",\n\t\t\t\"clustering\",\n\t\t\t\"event_lifecycle\",\n\t\t\t\"storage_api_remote_volume_handling\",\n\t\t\t\"nvidia_runtime\",\n\t\t\t\"container_mount_propagation\",\n\t\t\t\"container_backup\",\n\t\t\t\"dev_incus_images\",\n\t\t\t\"container_local_cross_pool_handling\",\n\t\t\t\"proxy_unix\",\n\t\t\t\"proxy_udp\",\n\t\t\t\"clustering_join\",\n\t\t\t\"proxy_tcp_udp_multi_port_handling\",\n\t\t\t\"network_state\",\n\t\t\t\"proxy_unix_dac_properties\",\n\t\t\t\"container_protection_delete\",\n\t\t\t\"unix_priv_drop\",\n\t\t\t\"pprof_http\",\n\t\t\t\"proxy_haproxy_protocol\",\n\t\t\t\"network_hwaddr\",\n\t\t\t\"proxy_nat\",\n\t\t\t\"network_nat_order\",\n\t\t\t\"container_full\",\n\t\t\t\"backup_compression\",\n\t\t\t\"nvidia_runtime_config\",\n\t\t\t\"storage_api_volume_snapshots\",\n\t\t\t\"storage_unmapped\",\n\t\t\t\"projects\",\n\t\t\t\"network_vxlan_ttl\",\n\t\t\t\"container_incremental_copy\",\n\t\t\t\"usb_optional_vendorid\",\n\t\t\t\"snapshot_scheduling\",\n\t\t\t\"snapshot_schedule_aliases\",\n\t\t\t\"container_copy_project\",\n\t\t\t\"clustering_server_address\",\n\t\t\t\"clustering_image_replication\",\n\t\t\t\"container_protection_shift\",\n\t\t\t\"snapshot_expiry\",\n\t\t\t\"container_backup_override_pool\",\n\t\t\t\"snapshot_expiry_creation\",\n\t\t\t\"network_leases_location\",\n\t\t\t\"resources_cpu_socket\",\n\t\t\t\"resources_gpu\",\n\t\t\t\"resources_numa\",\n\t\t\t\"kernel_features\",\n\t\t\t\"id_map_current\",\n\t\t\t\"event_location\",\n\t\t\t\"storage_api_remote_volume_snapshots\",\n\t\t\t\"network_nat_address\",\n\t\t\t\"container_nic_routes\",\n\t\t\t\"cluster_internal_copy\",\n\t\t\t\"seccomp_notify\",\n\t\t\t\"lxc_features\",\n\t\t\t\"container_nic_ipvlan\",\n\t\t\t\"network_vlan_sriov\",\n\t\t\t\"storage_cephfs\",\n\t\t\t\"container_nic_ipfilter\",\n\t\t\t\"resources_v2\",\n\t\t\t\"container_exec_user_group_cwd\",\n\t\t\t\"container_syscall_intercept\",\n\t\t\t\"container_disk_shift\",\n\t\t\t\"storage_shifted\",\n\t\t\t\"resources_infiniband\",\n\t\t\t\"daemon_storage\",\n\t\t\t\"instances\",\n\t\t\t\"image_types\",\n\t\t\t\"resources_disk_sata\",\n\t\t\t\"clustering_roles\",\n\t\t\t\"images_expiry\",\n\t\t\t\"resources_network_firmware\",\n\t\t\t\"backup_compression_algorithm\",\n\t\t\t\"ceph_data_pool_name\",\n\t\t\t\"container_syscall_intercept_mount\",\n\t\t\t\"compression_squashfs\",\n\t\t\t\"container_raw_mount\",\n\t\t\t\"container_nic_routed\",\n\t\t\t\"container_syscall_intercept_mount_fuse\",\n\t\t\t\"container_disk_ceph\",\n\t\t\t\"virtual-machines\",\n\t\t\t\"image_profiles\",\n\t\t\t\"clustering_architecture\",\n\t\t\t\"resources_disk_id\",\n\t\t\t\"storage_lvm_stripes\",\n\t\t\t\"vm_boot_priority\",\n\t\t\t\"unix_hotplug_devices\",\n\t\t\t\"api_filtering\",\n\t\t\t\"instance_nic_network\",\n\t\t\t\"clustering_sizing\",\n\t\t\t\"firewall_driver\",\n\t\t\t\"projects_limits\",\n\t\t\t\"container_syscall_intercept_hugetlbfs\",\n\t\t\t\"limits_hugepages\",\n\t\t\t\"container_nic_routed_gateway\",\n\t\t\t\"projects_restrictions\",\n\t\t\t\"custom_volume_snapshot_expiry\",\n\t\t\t\"volume_snapshot_scheduling\",\n\t\t\t\"trust_ca_certificates\",\n\t\t\t\"snapshot_disk_usage\",\n\t\t\t\"clustering_edit_roles\",\n\t\t\t\"container_nic_routed_host_address\",\n\t\t\t\"container_nic_ipvlan_gateway\",\n\t\t\t\"resources_usb_pci\",\n\t\t\t\"resources_cpu_threads_numa\",\n\t\t\t\"resources_cpu_core_die\",\n\t\t\t\"api_os\",\n\t\t\t\"container_nic_routed_host_table\",\n\t\t\t\"container_nic_ipvlan_host_table\",\n\t\t\t\"container_nic_ipvlan_mode\",\n\t\t\t\"resources_system\",\n\t\t\t\"images_push_relay\",\n\t\t\t\"network_dns_search\",\n\t\t\t\"container_nic_routed_limits\",\n\t\t\t\"instance_nic_bridged_vlan\",\n\t\t\t\"network_state_bond_bridge\",\n\t\t\t\"usedby_consistency\",\n\t\t\t\"custom_block_volumes\",\n\t\t\t\"clustering_failure_domains\",\n\t\t\t\"resources_gpu_mdev\",\n\t\t\t\"console_vga_type\",\n\t\t\t\"projects_limits_disk\",\n\t\t\t\"network_type_macvlan\",\n\t\t\t\"network_type_sriov\",\n\t\t\t\"container_syscall_intercept_bpf_devices\",\n\t\t\t\"network_type_ovn\",\n\t\t\t\"projects_networks\",\n\t\t\t\"projects_networks_restricted_uplinks\",\n\t\t\t\"custom_volume_backup\",\n\t\t\t\"backup_override_name\",\n\t\t\t\"storage_rsync_compression\",\n\t\t\t\"network_type_physical\",\n\t\t\t\"network_ovn_external_subnets\",\n\t\t\t\"network_ovn_nat\",\n\t\t\t\"network_ovn_external_routes_remove\",\n\t\t\t\"tpm_device_type\",\n\t\t\t\"storage_zfs_clone_copy_rebase\",\n\t\t\t\"gpu_mdev\",\n\t\t\t\"resources_pci_iommu\",\n\t\t\t\"resources_network_usb\",\n\t\t\t\"resources_disk_address\",\n\t\t\t\"network_physical_ovn_ingress_mode\",\n\t\t\t\"network_ovn_dhcp\",\n\t\t\t\"network_physical_routes_anycast\",\n\t\t\t\"projects_limits_instances\",\n\t\t\t\"network_state_vlan\",\n\t\t\t\"instance_nic_bridged_port_isolation\",\n\t\t\t\"instance_bulk_state_change\",\n\t\t\t\"network_gvrp\",\n\t\t\t\"instance_pool_move\",\n\t\t\t\"gpu_sriov\",\n\t\t\t\"pci_device_type\",\n\t\t\t\"storage_volume_state\",\n\t\t\t\"network_acl\",\n\t\t\t\"migration_stateful\",\n\t\t\t\"disk_state_quota\",\n\t\t\t\"storage_ceph_features\",\n\t\t\t\"projects_compression\",\n\t\t\t\"projects_images_remote_cache_expiry\",\n\t\t\t\"certificate_project\",\n\t\t\t\"network_ovn_acl\",\n\t\t\t\"projects_images_auto_update\",\n\t\t\t\"projects_restricted_cluster_target\",\n\t\t\t\"images_default_architecture\",\n\t\t\t\"network_ovn_acl_defaults\",\n\t\t\t\"gpu_mig\",\n\t\t\t\"project_usage\",\n\t\t\t\"network_bridge_acl\",\n\t\t\t\"warnings\",\n\t\t\t\"projects_restricted_backups_and_snapshots\",\n\t\t\t\"clustering_join_token\",\n\t\t\t\"clustering_description\",\n\t\t\t\"server_trusted_proxy\",\n\t\t\t\"clustering_update_cert\",\n\t\t\t\"storage_api_project\",\n\t\t\t\"server_instance_driver_operational\",\n\t\t\t\"server_supported_storage_drivers\",\n\t\t\t\"event_lifecycle_requestor_address\",\n\t\t\t\"resources_gpu_usb\",\n\t\t\t\"clustering_evacuation\",\n\t\t\t\"network_ovn_nat_address\",\n\t\t\t\"network_bgp\",\n\t\t\t\"network_forward\",\n\t\t\t\"custom_volume_refresh\",\n\t\t\t\"network_counters_errors_dropped\",\n\t\t\t\"metrics\",\n\t\t\t\"image_source_project\",\n\t\t\t\"clustering_config\",\n\t\t\t\"network_peer\",\n\t\t\t\"linux_sysctl\",\n\t\t\t\"network_dns\",\n\t\t\t\"ovn_nic_acceleration\",\n\t\t\t\"certificate_self_renewal\",\n\t\t\t\"instance_project_move\",\n\t\t\t\"storage_volume_project_move\",\n\t\t\t\"cloud_init\",\n\t\t\t\"network_dns_nat\",\n\t\t\t\"database_leader\",\n\t\t\t\"instance_all_projects\",\n\t\t\t\"clustering_groups\",\n\t\t\t\"ceph_rbd_du\",\n\t\t\t\"instance_get_full\",\n\t\t\t\"qemu_metrics\",\n\t\t\t\"gpu_mig_uuid\",\n\t\t\t\"event_project\",\n\t\t\t\"clustering_evacuation_live\",\n\t\t\t\"instance_allow_inconsistent_copy\",\n\t\t\t\"network_state_ovn\",\n\t\t\t\"storage_volume_api_filtering\",\n\t\t\t\"image_restrictions\",\n\t\t\t\"storage_zfs_export\",\n\t\t\t\"network_dns_records\",\n\t\t\t\"storage_zfs_reserve_space\",\n\t\t\t\"network_acl_log\",\n\t\t\t\"storage_zfs_blocksize\",\n\t\t\t\"metrics_cpu_seconds\",\n\t\t\t\"instance_snapshot_never\",\n\t\t\t\"certificate_token\",\n\t\t\t\"instance_nic_routed_neighbor_probe\",\n\t\t\t\"event_hub\",\n\t\t\t\"agent_nic_config\",\n\t\t\t\"projects_restricted_intercept\",\n\t\t\t\"metrics_authentication\",\n\t\t\t\"images_target_project\",\n\t\t\t\"images_all_projects\",\n\t\t\t\"cluster_migration_inconsistent_copy\",\n\t\t\t\"cluster_ovn_chassis\",\n\t\t\t\"container_syscall_intercept_sched_setscheduler\",\n\t\t\t\"storage_lvm_thinpool_metadata_size\",\n\t\t\t\"storage_volume_state_total\",\n\t\t\t\"instance_file_head\",\n\t\t\t\"instances_nic_host_name\",\n\t\t\t\"image_copy_profile\",\n\t\t\t\"container_syscall_intercept_sysinfo\",\n\t\t\t\"clustering_evacuation_mode\",\n\t\t\t\"resources_pci_vpd\",\n\t\t\t\"qemu_raw_conf\",\n\t\t\t\"storage_cephfs_fscache\",\n\t\t\t\"network_load_balancer\",\n\t\t\t\"vsock_api\",\n\t\t\t\"instance_ready_state\",\n\t\t\t\"network_bgp_holdtime\",\n\t\t\t\"storage_volumes_all_projects\",\n\t\t\t\"metrics_memory_oom_total\",\n\t\t\t\"storage_buckets\",\n\t\t\t\"storage_buckets_create_credentials\",\n\t\t\t\"metrics_cpu_effective_total\",\n\t\t\t\"projects_networks_restricted_access\",\n\t\t\t\"storage_buckets_local\",\n\t\t\t\"loki\",\n\t\t\t\"acme\",\n\t\t\t\"internal_metrics\",\n\t\t\t\"cluster_join_token_expiry\",\n\t\t\t\"remote_token_expiry\",\n\t\t\t\"init_preseed\",\n\t\t\t\"storage_volumes_created_at\",\n\t\t\t\"cpu_hotplug\",\n\t\t\t\"projects_networks_zones\",\n\t\t\t\"network_txqueuelen\",\n\t\t\t\"cluster_member_state\",\n\t\t\t\"instances_placement_scriptlet\",\n\t\t\t\"storage_pool_source_wipe\",\n\t\t\t\"zfs_block_mode\",\n\t\t\t\"instance_generation_id\",\n\t\t\t\"disk_io_cache\",\n\t\t\t\"amd_sev\",\n\t\t\t\"storage_pool_loop_resize\",\n\t\t\t\"migration_vm_live\",\n\t\t\t\"ovn_nic_nesting\",\n\t\t\t\"oidc\",\n\t\t\t\"network_ovn_l3only\",\n\t\t\t\"ovn_nic_acceleration_vdpa\",\n\t\t\t\"cluster_healing\",\n\t\t\t\"instances_state_total\",\n\t\t\t\"auth_user\",\n\t\t\t\"security_csm\",\n\t\t\t\"instances_rebuild\",\n\t\t\t\"numa_cpu_placement\",\n\t\t\t\"custom_volume_iso\",\n\t\t\t\"network_allocations\",\n\t\t\t\"zfs_delegate\",\n\t\t\t\"storage_api_remote_volume_snapshot_copy\",\n\t\t\t\"operations_get_query_all_projects\",\n\t\t\t\"metadata_configuration\",\n\t\t\t\"syslog_socket\",\n\t\t\t\"event_lifecycle_name_and_project\",\n\t\t\t\"instances_nic_limits_priority\",\n\t\t\t\"disk_initial_volume_configuration\",\n\t\t\t\"operation_wait\",\n\t\t\t\"image_restriction_privileged\",\n\t\t\t\"cluster_internal_custom_volume_copy\",\n\t\t\t\"disk_io_bus\",\n\t\t\t\"storage_cephfs_create_missing\",\n\t\t\t\"instance_move_config\",\n\t\t\t\"ovn_ssl_config\",\n\t\t\t\"certificate_description\",\n\t\t\t\"disk_io_bus_virtio_blk\",\n\t\t\t\"loki_config_instance\",\n\t\t\t\"instance_create_start\",\n\t\t\t\"clustering_evacuation_stop_options\",\n\t\t\t\"boot_host_shutdown_action\",\n\t\t\t\"agent_config_drive\",\n\t\t\t\"network_state_ovn_lr\",\n\t\t\t\"image_template_permissions\",\n\t\t\t\"storage_bucket_backup\",\n\t\t\t\"storage_lvm_cluster\",\n\t\t\t\"shared_custom_block_volumes\",\n\t\t\t\"auth_tls_jwt\",\n\t\t\t\"oidc_claim\",\n\t\t\t\"device_usb_serial\",\n\t\t\t\"numa_cpu_balanced\",\n\t\t\t\"image_restriction_nesting\",\n\t\t\t\"network_integrations\",\n\t\t\t\"instance_memory_swap_bytes\",\n\t\t\t\"network_bridge_external_create\",\n\t\t\t\"network_zones_all_projects\",\n\t\t\t\"storage_zfs_vdev\",\n\t\t\t\"container_migration_stateful\",\n\t\t\t\"profiles_all_projects\",\n\t\t\t\"instances_scriptlet_get_instances\",\n\t\t\t\"instances_scriptlet_get_cluster_members\",\n\t\t\t\"instances_scriptlet_get_project\",\n\t\t\t\"network_acl_stateless\",\n\t\t\t\"instance_state_started_at\",\n\t\t\t\"networks_all_projects\",\n\t\t\t\"network_acls_all_projects\",\n\t\t\t\"storage_buckets_all_projects\",\n\t\t\t\"resources_load\",\n\t\t\t\"instance_access\",\n\t\t\t\"project_access\",\n\t\t\t\"projects_force_delete\",\n\t\t\t\"resources_cpu_flags\",\n\t\t\t\"disk_io_bus_cache_filesystem\",\n\t\t\t\"instance_oci\",\n\t\t\t\"clustering_groups_config\",\n\t\t\t\"instances_lxcfs_per_instance\",\n\t\t\t\"clustering_groups_vm_cpu_definition\",\n\t\t\t\"disk_volume_subpath\",\n\t\t\t\"projects_limits_disk_pool\",\n\t\t\t\"network_ovn_isolated\",\n\t\t\t\"qemu_raw_qmp\",\n\t\t\t\"network_load_balancer_health_check\",\n\t\t\t\"oidc_scopes\",\n\t\t\t\"network_integrations_peer_name\",\n\t\t\t\"qemu_scriptlet\",\n\t\t\t\"instance_auto_restart\",\n\t\t\t\"storage_lvm_metadatasize\",\n\t\t\t\"ovn_nic_promiscuous\",\n\t\t\t\"ovn_nic_ip_address_none\",\n\t\t\t\"instances_state_os_info\",\n\t\t\t\"network_load_balancer_state\",\n\t\t\t\"instance_nic_macvlan_mode\",\n\t\t\t\"storage_lvm_cluster_create\",\n\t\t\t\"network_ovn_external_interfaces\",\n\t\t\t\"instances_scriptlet_get_instances_count\",\n\t\t\t\"cluster_rebalance\",\n\t\t\t\"custom_volume_refresh_exclude_older_snapshots\",\n\t\t\t\"storage_initial_owner\",\n\t\t\t\"storage_live_migration\",\n\t\t\t\"instance_console_screenshot\",\n\t\t\t\"image_import_alias\",\n\t\t\t\"authorization_scriptlet\",\n\t\t\t\"console_force\",\n\t\t\t\"network_ovn_state_addresses\",\n\t\t\t\"network_bridge_acl_devices\",\n\t\t\t\"instance_debug_memory\",\n\t\t\t\"init_preseed_storage_volumes\",\n\t\t\t\"init_preseed_profile_project\",\n\t\t\t\"instance_nic_routed_host_address\",\n\t\t\t\"instance_smbios11\",\n\t\t\t\"api_filtering_extended\",\n\t\t\t\"acme_dns01\",\n\t\t\t\"security_iommu\",\n\t\t\t\"network_ipv4_dhcp_routes\",\n\t\t\t\"network_state_ovn_ls\",\n\t\t\t\"network_dns_nameservers\",\n\t\t\t\"acme_http01_port\",\n\t\t\t\"network_ovn_ipv4_dhcp_expiry\",\n\t\t\t\"instance_state_cpu_time\",\n\t\t\t\"network_io_bus\",\n\t\t\t\"disk_io_bus_usb\",\n\t\t\t\"storage_driver_linstor\",\n\t\t\t\"instance_oci_entrypoint\",\n\t\t\t\"network_address_set\",\n\t\t\t\"server_logging\",\n\t\t\t\"network_forward_snat\",\n\t\t\t\"memory_hotplug\",\n\t\t\t\"instance_nic_routed_host_tables\",\n\t\t\t\"instance_publish_split\",\n\t\t\t\"init_preseed_certificates\",\n\t\t\t\"custom_volume_sftp\",\n\t\t\t\"network_ovn_external_nic_address\",\n\t\t\t\"network_physical_gateway_hwaddr\",\n\t\t\t\"backup_s3_upload\",\n\t\t\t\"snapshot_manual_expiry\",\n\t\t\t\"resources_cpu_address_sizes\",\n\t\t\t\"disk_attached\",\n\t\t\t\"limits_memory_hotplug\",\n\t\t\t\"disk_wwn\",\n\t\t\t\"server_logging_webhook\",\n\t\t\t\"storage_driver_truenas\",\n\t\t\t\"container_disk_tmpfs\",\n\t\t\t\"instance_limits_oom\",\n\t\t\t\"backup_override_config\",\n\t\t\t\"network_ovn_tunnels\",\n\t\t\t\"init_preseed_cluster_groups\",\n\t\t\t\"usb_attached\",\n\t\t\t\"backup_iso\",\n\t\t\t\"instance_systemd_credentials\",\n\t\t\t\"cluster_group_usedby\",\n\t\t\t\"bpf_token_delegation\",\n\t\t\t\"file_storage_volume\",\n\t\t\t\"network_hwaddr_pattern\",\n\t\t\t\"storage_volume_full\",\n\t\t\t\"storage_bucket_full\",\n\t\t\t\"device_pci_firmware\",\n\t\t\t\"resources_serial\",\n\t\t\t\"ovn_nic_limits\",\n\t\t\t\"storage_lvmcluster_qcow2\",\n\t\t\t\"oidc_allowed_subnets\",\n\t\t\t\"file_delete_force\",\n\t\t\t\"nic_sriov_select_ext\",\n\t\t\t\"network_zones_dns_contact\",\n\t\t\t\"nic_attached_connected\",\n\t\t\t\"nic_sriov_security_trusted\",\n\t\t\t\"direct_backup\",\n\t\t\t\"instance_snapshot_disk_only_restore\",\n\t\t\t\"unix_hotplug_pci\",\n\t\t\t\"cluster_evacuating_restoring\",\n\t\t\t\"projects_restricted_image_servers\",\n\t\t\t\"storage_lvmcluster_size\",\n\t\t\t\"authorization_scriptlet_cert\",\n\t\t\t\"lvmcluster_remove_snapshots\",\n\t\t\t\"daemon_storage_logs\",\n\t\t\t\"instances_debug_repair\",\n\t\t\t\"network_io_bus_ovn\",\n\t\t\t\"dependent\",\n\t\t\t\"metrics_project_resources\",\n\t\t\t\"storage_volume_nbd\",\n\t\t\t\"projects_restricted_storage_pool_access\",\n\t\t\t\"server_shutdown_action\",\n\t\t\t\"instances_placement_scriptlet_rebalance\",\n\t\t\t\"network_bridge_multicast_snooping\",\n\t\t\t\"storage_create_options\",\n\t\t\t\"instances_tpm_platform_cert\",\n\t\t\t\"linstor_raw\",\n\t\t\t\"network_address_set_ip_ranges\",\n\t\t\t\"storage_volumes_rebuild\",\n\t\t\t\"api_fragments\",\n\t\t\t\"instance_limits_cpu_topology\",\n\t\t\t\"instance_nbd\",\n\t\t\t\"network_bridge_bgp_instances\",\n\t\t\t\"core_https_allowed_websocket_origin\",\n\t\t\t\"storage_btrfs_compression\",\n\t\t\t\"oci_network_config\",\n\t\t\t\"infiniband_sriov_guid\",\n\t\t\t\"instance_selinux\",\n\t\t\t\"network_bgp_peer_interface\",\n\t\t\t\"projects_restricted_virtual_machines_nesting\",\n\t\t\t\"authorization_config\",\n\t\t\t\"network_allocations_network\",\n\t\t\t\"gpu_native_context\",\n\t\t\t\"instance_port_forward\",\n\t\t\t\"unix_block_limits\",\n\t\t\t\"authorization_client_routing\",\n\t\t\t\"instance_nvram\",\n\t\t\t\"disk_io_limits_combined\",\n\t\t\t\"resources_cpu_cluster\",\n\t\t\t\"acme_eab\",\n\t\t\t\"instance_protection_start\",\n\t\t\t\"instance_nvram_bulk_update\",\n\t\t\t\"instance_refresh_migration\",\n\t\t\t\"image_locations\",\n\t\t\t\"network_ovn_multicast\",\n\t\t\t\"device_burst_limits\",\n\t\t\t\"network_ipv6_ra\",\n\t\t\t\"qemu_scriptlet_nvram\",\n\t\t\t\"storage_ceph_rbd_backend\",\n\t\t\t\"instance_nvram_config\",\n\t\t\t\"storage_cephobject_endpoint_cert\",\n\t\t\t\"device_queue_disc\"\n\t\t],\n\t\t\"api_status\": \"stable\",\n\t\t\"api_version\": \"1.0\",\n\t\t\"auth\": \"trusted\",\n\t\t\"public\": false,\n\t\t\"auth_methods\": [\n\t\t\t\"tls\"\n\t\t],\n\t\t\"auth_user_name\": \"\",\n\t\t\"auth_user_method\": \"\",\n\t\t\"environment\": {\n\t\t\t\"addresses\": [\n\t\t\t\t\"10.10.10.11:8443\",\n\t\t\t\t\"10.10.30.11:8443\",\n\t\t\t\t\"10.57.139.1:8443\",\n\t\t\t\t\"10.158.84.1:8443\",\n\t\t\t\t\"[fd42:37d0:7f47:b4d::1]:8443\"\n\t\t\t],\n\t\t\t\"architectures\": [\n\t\t\t\t\"x86_64\",\n\t\t\t\t\"i686\"\n\t\t\t],\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"certificate_fingerprint\": \"2786a3a9e01eed6287d5e4db7caa46732117f4539d21429f618af3bd8a3de010\",\n\t\t\t\"driver\": \"lxc | qemu\",\n\t\t\t\"driver_version\": \"7.0.0 | 11.1.1\",\n\t\t\t\"firewall\": \"nftables\",\n\t\t\t\"kernel\": \"Linux\",\n\t\t\t\"kernel_architecture\": \"x86_64\",\n\t\t\t\"kernel_features\": {},\n\t\t\t\"kernel_version\": \"7.2.4-zabbly+\",\n\t\t\t\"lxc_features\": {},\n\t\t\t\"os_name\": \"IncusOS\",\n\t\t\t\"os_version\": \"202609100026\",\n\t\t\t\"project\": \"default\",\n\t\t\t\"server\": \"incus\",\n\t\t\t\"server_clustered\": true,\n\t\t\t\"server_event_mode\": \"full-mesh\",\n\t\t\t\"server_name\": \"lab01\",\n\t\t\t\"server_pid\": 2048,\n\t\t\t\"server_version\": \"7.4\",\n\t\t\t\"storage\": \"zfs\",\n\t\t\t\"storage_version\": \"2.4.4-1\",\n\t\t\t\"storage_supported_drivers\": [\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"dir\",\n\t\t\t\t\t\"Version\": \"1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvm\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"lvmcluster\",\n\t\t\t\t\t\"Version\": \"2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.50.0\",\n\t\t\t\t\t\"Remote\": true\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"zfs\",\n\t\t\t\t\t\"Version\": \"2.4.4-1\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"Name\": \"btrfs\",\n\t\t\t\t\t\"Version\": \"6.14\",\n\t\t\t\t\t\"Remote\": false\n\t\t\t\t}\n\t\t\t]\n\t\t}\n\t}" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab02 network=default project=ac-ovn-spike +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Heartbeat updating local raft members" members="[{{1 10.10.10.14:8443 voter} nas01} {{2 10.10.10.11:8443 stand-by} lab01} {{3 10.10.10.12:8443 voter} lab02} {{4 10.10.10.13:8443 voter} lab03}]" +time="2026-09-12T17:12:48Z" level=debug msg="[nas01] Starting heartbeat round" mode=normal +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab03 network=default project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Created network on cluster member" config="map[bridge.mtu:1442 dns.nameservers:10.10.40.1 ipv4.address:10.253.73.1/24 ipv4.dhcp:true ipv4.nat:true ipv6.address:none network:fast40-uplink volatile.network.ipv4.address:10.10.40.64]" member=lab01 network=default project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Marked network global status as created" network=default project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51686" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51687" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51688" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51689" method=GET protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51690" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51691" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51692" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51693" method=GET protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51694" method=GET protocol=tls url="/1.0/events?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Event listener server handler started" id=e9fb9957-2f15-4b98-a71f-95a42ec51a71 local="10.10.10.14:8443" remote="100.122.142.76:51694" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51695" method=POST protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f/secret?project=image-build" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Started operation" class=token description="Image download token" operation=325cfbdb-279e-4b86-a5db-8596520203ca project=image-build +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] New operation" class=token description="Image download token" operation=325cfbdb-279e-4b86-a5db-8596520203ca project=image-build +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51696" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Event listener server handler started" id=cbea493b-c447-481b-ae4d-b0d6b053ee7d local="10.10.10.14:8443" remote="100.122.142.76:51696" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51697" method=POST protocol=tls url="/1.0/images?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] New operation" class=task description="Downloading image" operation=483132b1-5681-4efb-a34b-de543da4ab04 project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Started operation" class=task description="Downloading image" operation=483132b1-5681-4efb-a34b-de543da4ab04 project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Connecting to a remote public Incus over HTTPS" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Image already exists in the DB" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51698" method=GET protocol=tls url="/1.0/operations/483132b1-5681-4efb-a34b-de543da4ab04?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Updated metadata for operation" class=task description="Downloading image" operation=483132b1-5681-4efb-a34b-de543da4ab04 project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=info msg="[nas01] Syncing image to members started" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=info msg="[nas01] Syncing image to members finished" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=info msg="[nas01] Sufficient members have image" desiredSyncCount=3 fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f project=ac-ovn-spike syncedCount=4 +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Success for operation" class=task description="Downloading image" operation=483132b1-5681-4efb-a34b-de543da4ab04 project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Event listener server handler stopped" listener=cbea493b-c447-481b-ae4d-b0d6b053ee7d local="10.10.10.14:8443" remote="100.122.142.76:51696" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Event listener server handler stopped" listener=e9fb9957-2f15-4b98-a71f-95a42ec51a71 local="10.10.10.14:8443" remote="100.122.142.76:51694" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51699" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51700" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab01" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&target=lab01" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"one\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab01 targetAddress="10.10.10.11:8443" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"fc998e02-3593-461b-a9be-bd2542472f7f\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T17:12:49.617772108Z\",\n\t\t\"updated_at\": \"2026-09-12T17:12:49.617772108Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab01\"\n\t}" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51701" method=GET protocol=tls url="/1.0/operations/fc998e02-3593-461b-a9be-bd2542472f7f/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:49Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:49Z" level=info msg="[lab01] Creating instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T17:12:49Z" level=info msg="[lab01] Created instance" ephemeral=false instance=one instanceType=container project=ac-ovn-spike +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51702" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51703" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51704" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Event listener server handler started" id=c16be2a0-8b3e-4bae-9608-bd73034ad976 local="10.10.10.14:8443" remote="100.122.142.76:51704" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51705" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=info msg="[lab01] Starting instance" action=start created="2026-09-12 17:12:49.642756907 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51706" method=GET protocol=tls url="/1.0/operations/3b43e92d-9f6f-4e6d-96ea-58756374376a?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:50Z" level=info msg="[lab01] Started instance" action=start created="2026-09-12 17:12:49.642756907 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Event listener server handler stopped" listener=c16be2a0-8b3e-4bae-9608-bd73034ad976 local="10.10.10.14:8443" remote="100.122.142.76:51704" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51708" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Responding to instance create" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51709" method=POST protocol=tls url="/1.0/instances?project=ac-ovn-spike&target=lab03" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Forward instance post request" local=nas01 target=lab03 targetAddress="10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] \n\t{\n\t\t\"architecture\": \"\",\n\t\t\"config\": {},\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"profiles\": [],\n\t\t\"stateful\": false,\n\t\t\"description\": \"\",\n\t\t\"name\": \"two\",\n\t\t\"source\": {\n\t\t\t\"type\": \"image\",\n\t\t\t\"certificate\": \"\",\n\t\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"allow_inconsistent\": false\n\t\t},\n\t\t\"instance_type\": \"\",\n\t\t\"type\": \"container\",\n\t\t\"start\": false\n\t}" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&target=lab03" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Got operation from Incus" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] \n\t{\n\t\t\"id\": \"cb83833d-072d-43b1-b6d7-1ab56c1bb3b9\",\n\t\t\"class\": \"task\",\n\t\t\"description\": \"Creating instance\",\n\t\t\"created_at\": \"2026-09-12T17:12:50.379458221Z\",\n\t\t\"updated_at\": \"2026-09-12T17:12:50.379458221Z\",\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"resources\": {\n\t\t\t\"instances\": [\n\t\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t\t]\n\t\t},\n\t\t\"metadata\": {},\n\t\t\"may_cancel\": false,\n\t\t\"err\": \"\",\n\t\t\"location\": \"lab03\"\n\t}" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51710" method=GET protocol=tls url="/1.0/operations/cb83833d-072d-43b1-b6d7-1ab56c1bb3b9/wait?" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=info msg="[lab03] Creating instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T17:12:50Z" level=info msg="[lab03] Created instance" ephemeral=false instance=two instanceType=container project=ac-ovn-spike +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] OVN router external IP address reachable" driver=ovn ip=10.10.40.64 network=default project=ac-ovn-spike +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51711" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51712" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Event listener server handler started" id=2228d521-3c82-489f-bff5-76468b6c854f local="10.10.10.14:8443" remote="100.122.142.76:51713" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51713" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51714" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=info msg="[lab03] Starting instance" action=start created="2026-09-12 17:12:50.444501094 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51715" method=GET protocol=tls url="/1.0/operations/2dbc3e23-3e54-426c-af30-7e4b0c011c30?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to update warning status for warning \"519f6fb0-a631-4d61-8805-d814f3ffb22f\": database is locked" +time="2026-09-12T17:12:50Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Database error, retrying" attempt=1 err="Failed to update warning status for warning \"519f6fb0-a631-4d61-8805-d814f3ffb22f\": database is locked" +time="2026-09-12T17:12:51Z" level=info msg="[lab03] Started instance" action=start created="2026-09-12 17:12:50.444501094 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="1970-01-01 00:00:00 +0000 UTC" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Event listener server handler stopped" listener=2228d521-3c82-489f-bff5-76468b6c854f local="10.10.10.14:8443" remote="100.122.142.76:51713" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51716" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51717" method=GET protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51718" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51719" method=GET protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51720" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51721" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51722" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51723" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51724" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51725" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Event listener server handler started" id=36d18ac6-757b-4d52-a117-3a903586f665 local="10.10.10.14:8443" remote="100.122.142.76:51725" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51726" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"ping -c 1 -W 2 10.253.73.3\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51727" method=GET protocol=tls url="/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=00d5484b409393a61b192be3396316773e6608d23d534e57b47ecb7827162331" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=00d5484b409393a61b192be3396316773e6608d23d534e57b47ecb7827162331" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51727" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51728" method=GET protocol=tls url="/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=aa8e05b2237041632c34102b6a1bfb3e917d949c674f19baa53f62c01fd1143f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51728" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=aa8e05b2237041632c34102b6a1bfb3e917d949c674f19baa53f62c01fd1143f" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51729" method=GET protocol=tls url="/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=73aaf8e8a6e26c846bd86d95a94beda320056bc2fa82fac288d093c013ba8a6d" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=73aaf8e8a6e26c846bd86d95a94beda320056bc2fa82fac288d093c013ba8a6d" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51729" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51730" method=GET protocol=tls url="/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=57d20ad510790324f4359b8ca85abc80f11018aeac8a049a927094b6db58c5ca" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51730" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703/websocket?secret=57d20ad510790324f4359b8ca85abc80f11018aeac8a049a927094b6db58c5ca" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51728" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51731" method=GET protocol=tls url="/1.0/operations/9c04637b-96b1-4f79-94a9-55a192ea7703?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51727" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51730" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51729" +time="2026-09-12T17:12:51Z" level=debug msg="[nas01] Event listener server handler stopped" listener=36d18ac6-757b-4d52-a117-3a903586f665 local="10.10.10.14:8443" remote="100.122.142.76:51725" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51732" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51733" method=GET protocol=tls url="/1.0/instances/one/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51734" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51735" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Event listener server handler started" id=9eb809f7-23d9-47e2-9969-df8a05c685ef local="10.10.10.14:8443" remote="100.122.142.76:51735" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51736" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51737" method=GET protocol=tls url="/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=da1036828491910f6b5ceccefaf80957b671627c1723b7b260f4acc4caae5d65" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=da1036828491910f6b5ceccefaf80957b671627c1723b7b260f4acc4caae5d65" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51737" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51738" method=GET protocol=tls url="/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=3fe2a57c9b739db6a5c59cb78b35edd213ef1fdbefe3737eb8e2e83b3988a707" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51738" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=3fe2a57c9b739db6a5c59cb78b35edd213ef1fdbefe3737eb8e2e83b3988a707" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51739" method=GET protocol=tls url="/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=6b989c394cfc1aac822a6ae7d20affb63f3f3e064b09f4313a564c3a55c565c4" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=6b989c394cfc1aac822a6ae7d20affb63f3f3e064b09f4313a564c3a55c565c4" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51739" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51740" method=GET protocol=tls url="/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=1df7e3f1a65c3f234468650cfb8b40dd34df120a9ee496d23a5a742053b9ed97" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740/websocket?secret=1df7e3f1a65c3f234468650cfb8b40dd34df120a9ee496d23a5a742053b9ed97" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51740" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51738" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51741" method=GET protocol=tls url="/1.0/operations/fcf22223-aa17-4037-a7f5-b27015b93740?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51737" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51740" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51739" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Event listener server handler stopped" listener=9eb809f7-23d9-47e2-9969-df8a05c685ef local="10.10.10.14:8443" remote="100.122.142.76:51735" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51742" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51743" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Event listener server handler started" id=fffc006d-4119-4ea4-8ee2-1aa4e6a60775 local="10.10.10.14:8443" remote="100.122.142.76:51743" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51744" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51745" method=GET protocol=tls url="/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=8dc79937d26f461001d93573ef877c66e904c45505d20fcfa24bd2caeb14256a" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51745" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=8dc79937d26f461001d93573ef877c66e904c45505d20fcfa24bd2caeb14256a" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51746" method=GET protocol=tls url="/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=2e6ba18c99842cfda37ba1e77c64d92a997f8fa3222f28f80669c31401b1c1d7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=2e6ba18c99842cfda37ba1e77c64d92a997f8fa3222f28f80669c31401b1c1d7" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51746" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51747" method=GET protocol=tls url="/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=92570b049f78a831ce6ffe9d3cf00b471726a9064fac1af8aec14a4b194494a1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=92570b049f78a831ce6ffe9d3cf00b471726a9064fac1af8aec14a4b194494a1" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51747" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51748" method=GET protocol=tls url="/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=b1c3928bf36a89933499f8c7363c83df6baa17b4c7272b027dc393641374f3cc" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51748" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2/websocket?secret=b1c3928bf36a89933499f8c7363c83df6baa17b4c7272b027dc393641374f3cc" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51746" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51749" method=GET protocol=tls url="/1.0/operations/3ec7eab9-b450-4e27-a413-f4896ebffdd2?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51745" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51747" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51748" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Event listener server handler stopped" listener=fffc006d-4119-4ea4-8ee2-1aa4e6a60775 local="10.10.10.14:8443" remote="100.122.142.76:51743" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51750" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:52Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51751" method=GET protocol=tls url="/1.0/instances/two/sftp?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51752" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51753" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Event listener server handler started" id=28081e05-d0d0-4aef-94f2-5d540eba254e local="10.10.10.14:8443" remote="100.122.142.76:51753" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51754" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"mkdir -p /tmp/probe-tools \\u0026\\u0026 tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51755" method=GET protocol=tls url="/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=7b73d7eebf29fb6f4f272dbfdd3b758a136f5b4f584631398ccb698cd022f689" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=7b73d7eebf29fb6f4f272dbfdd3b758a136f5b4f584631398ccb698cd022f689" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51755" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51756" method=GET protocol=tls url="/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=26c15ffc3b458e58b28b4dfda44024f2ada2d8c1486e6191e179ed58b9f6c0d9" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51756" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=26c15ffc3b458e58b28b4dfda44024f2ada2d8c1486e6191e179ed58b9f6c0d9" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51757" method=GET protocol=tls url="/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=14de5e339836f9ba515153d6bb44777aadb66fce9e95aaac65cae715913d6a4c" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51757" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=14de5e339836f9ba515153d6bb44777aadb66fce9e95aaac65cae715913d6a4c" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51758" method=GET protocol=tls url="/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=352d37eacec94fee28e51819aa5420e3c96ce2a5f8d01085125dfd7996c64ea1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097/websocket?secret=352d37eacec94fee28e51819aa5420e3c96ce2a5f8d01085125dfd7996c64ea1" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51758" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51756" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51759" method=GET protocol=tls url="/1.0/operations/37c052a3-7761-4c9a-9f27-5b4194577097?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51755" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51757" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51758" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Event listener server handler stopped" listener=28081e05-d0d0-4aef-94f2-5d540eba254e local="10.10.10.14:8443" remote="100.122.142.76:51753" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51760" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51761" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Event listener server handler started" id=bddecd2b-b955-4c34-873d-f6a40df6eed9 local="10.10.10.14:8443" remote="100.122.142.76:51761" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51762" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"apk add --no-network /tmp/probe-tools/*.apk\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51763" method=GET protocol=tls url="/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=048373cbd29134ff80498ec939f64ba9b59a6793ed2e8e97d04c87fcd8d96f91" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=048373cbd29134ff80498ec939f64ba9b59a6793ed2e8e97d04c87fcd8d96f91" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51763" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51764" method=GET protocol=tls url="/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=3cb90d8f6f878a355dd82ac557d2aed14ded20356eea6dbc0e6c8c727706581f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51764" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=3cb90d8f6f878a355dd82ac557d2aed14ded20356eea6dbc0e6c8c727706581f" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51765" method=GET protocol=tls url="/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=db7584ce64369e999238faa1d8dce82160b12f5f18f5540077fdd86e9136429e" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51765" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=db7584ce64369e999238faa1d8dce82160b12f5f18f5540077fdd86e9136429e" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51766" method=GET protocol=tls url="/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=ba3a6ecc4f98f75e46be483535387238939b6168fcb2b086766ba7ad27a7fea2" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51766" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580/websocket?secret=ba3a6ecc4f98f75e46be483535387238939b6168fcb2b086766ba7ad27a7fea2" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51764" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51767" method=GET protocol=tls url="/1.0/operations/d2667845-930d-4a47-8bf8-03e735785580?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51763" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51766" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51765" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Event listener server handler stopped" listener=bddecd2b-b955-4c34-873d-f6a40df6eed9 local="10.10.10.14:8443" remote="100.122.142.76:51761" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51768" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51769" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Event listener server handler started" id=b87b809b-e5eb-4152-99fc-8c667bad6c28 local="10.10.10.14:8443" remote="100.122.142.76:51769" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51770" method=POST protocol=tls url="/1.0/instances/one/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/instances/one/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51771" method=GET protocol=tls url="/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=d80114968b390a1b93922bea54d1ba041575b505b7c9c3ad8c09ec02e28afdab" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=d80114968b390a1b93922bea54d1ba041575b505b7c9c3ad8c09ec02e28afdab" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51771" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51772" method=GET protocol=tls url="/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=2a52f879a96e4fd1c0494f3f890df0b0a4e5e021fc4db1c53b42320129546575" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51772" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=2a52f879a96e4fd1c0494f3f890df0b0a4e5e021fc4db1c53b42320129546575" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51773" method=GET protocol=tls url="/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=c282fd71cfe711d71c9770f90070a27090515b8ac08ae3ac1f054a5cb93d5b7f" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=c282fd71cfe711d71c9770f90070a27090515b8ac08ae3ac1f054a5cb93d5b7f" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51773" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51774" method=GET protocol=tls url="/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=19ac2d933837fa376c2f165c8120e9ff214761701590def3a2a5b7ba08bc48b0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.11:8443" target="100.122.142.76:51774" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.11:8443/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af/websocket?secret=19ac2d933837fa376c2f165c8120e9ff214761701590def3a2a5b7ba08bc48b0" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51772" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51775" method=GET protocol=tls url="/1.0/operations/8d35f77f-2fd8-4c63-9d73-b0fdb0a544af?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:53Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51771" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51773" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.155042508s +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.11:8443" target="100.122.142.76:51774" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Event listener server handler stopped" listener=b87b809b-e5eb-4152-99fc-8c667bad6c28 local="10.10.10.14:8443" remote="100.122.142.76:51769" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51776" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51777" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Event listener server handler started" id=0733a2ff-807f-4699-81b8-ba2802d9306d local="10.10.10.14:8443" remote="100.122.142.76:51777" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51778" method=POST protocol=tls url="/1.0/instances/two/exec?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"command\": [\n\t\t\t\"sh\",\n\t\t\t\"-c\",\n\t\t\t\"\\nset -eu\\nmkdir -p /srv/www\\nprintf '%s' 'ovn-spike-ok' \\u003e /srv/www/index.html\\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\\nbusybox-extras httpd -p 8080 -h /srv/www\\nsha256sum /srv/www/large.bin\\n\"\n\t\t],\n\t\t\"wait-for-websocket\": true,\n\t\t\"interactive\": false,\n\t\t\"environment\": {\n\t\t\t\"TERM\": \"\"\n\t\t},\n\t\t\"width\": 0,\n\t\t\"height\": 0,\n\t\t\"record-output\": false,\n\t\t\"user\": 0,\n\t\t\"group\": 0,\n\t\t\"cwd\": \"\"\n\t}" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/instances/two/exec?project=ac-ovn-spike" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51779" method=GET protocol=tls url="/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=b85ccd56001c0840e0b85af730360660c098209e6aec7ea690de312f3d7a6494" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=b85ccd56001c0840e0b85af730360660c098209e6aec7ea690de312f3d7a6494" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51779" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51780" method=GET protocol=tls url="/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=701f10113c6877efb034e7f989e3c3f10541ebe3130949ae2f3f0dcffc3474a0" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=701f10113c6877efb034e7f989e3c3f10541ebe3130949ae2f3f0dcffc3474a0" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51780" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51781" method=GET protocol=tls url="/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=eec970d846aba4f10a2c624e214cdd1d0bf34d94a331476a950759dcaaa20fe7" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=eec970d846aba4f10a2c624e214cdd1d0bf34d94a331476a950759dcaaa20fe7" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51781" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51782" method=GET protocol=tls url="/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=d3da365857b26bc36ed3a7a60496fa02837ab324b5acd561d1d9eb9d641412a5" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Started proxy" source="10.10.10.13:8443" target="100.122.142.76:51782" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connected to the websocket: wss://10.10.10.13:8443/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18/websocket?secret=d3da365857b26bc36ed3a7a60496fa02837ab324b5acd561d1d9eb9d641412a5" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51780" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51783" method=GET protocol=tls url="/1.0/operations/375556f4-1bfd-4198-ba6f-0bd899a89c18?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51781" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51779" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Websocket: Stopped proxy" source="10.10.10.13:8443" target="100.122.142.76:51782" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Event listener server handler stopped" listener=0733a2ff-807f-4699-81b8-ba2802d9306d local="10.10.10.14:8443" remote="100.122.142.76:51777" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51784" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51785" method=POST protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.13:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.12:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] Sending request to Incus" etag= method=POST url="https://10.10.10.11:8443/1.0/networks/default/forwards?project=ac-ovn-spike" +time="2026-09-12T17:12:54Z" level=debug msg="[nas01] \n\t{\n\t\t\"description\": \"\",\n\t\t\"config\": null,\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"target_port\": \"8080\",\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"snat\": false\n\t\t\t}\n\t\t],\n\t\t\"listen_address\": \"10.10.40.79\"\n\t}" diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.debug.log b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.debug.log new file mode 100644 index 0000000..8e376c9 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.debug.log @@ -0,0 +1 @@ +time="2026-09-12T10:13:12-07:00" level=debug msg="Connected to the websocket: wss://10.10.10.14:8443/1.0/events?all-projects=true" diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.log b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.log new file mode 100644 index 0000000..528b57a --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/monitor-delete.log @@ -0,0 +1,171 @@ +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Event listener server handler started" id=3fa3d20a-c67c-4440-876a-2b340ebafd88 local="10.10.10.14:8443" remote="100.122.142.76:51941" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51942" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51943" method=GET protocol=tls url="/1.0/projects?recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51944" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51945" method=GET protocol=tls url="/1.0/instances?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.13:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Sending request to Incus" etag= method=GET url="https://10.10.10.11:8443/1.0/instances?project=ac-ovn-spike&recursion=1" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T17:12:49.642756907Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"one\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T17:12:50.246590203Z\",\n\t\t\t\"location\": \"lab01\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] Got response struct from Incus" +time="2026-09-12T17:13:12Z" level=debug msg="[nas01] \n\t[\n\t\t{\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t\t\t},\n\t\t\t\"devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"ephemeral\": false,\n\t\t\t\"profiles\": [],\n\t\t\t\"stateful\": false,\n\t\t\t\"description\": \"\",\n\t\t\t\"created_at\": \"2026-09-12T17:12:50.444501094Z\",\n\t\t\t\"expanded_config\": {\n\t\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\t\"image.name\": \"router\",\n\t\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\t\"image.variant\": \"router\",\n\t\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t\t\t},\n\t\t\t\"expanded_devices\": {\n\t\t\t\t\"eth0\": {\n\t\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\t\"network\": \"default\",\n\t\t\t\t\t\"type\": \"nic\"\n\t\t\t\t},\n\t\t\t\t\"root\": {\n\t\t\t\t\t\"path\": \"/\",\n\t\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\t\"type\": \"disk\"\n\t\t\t\t}\n\t\t\t},\n\t\t\t\"name\": \"two\",\n\t\t\t\"status\": \"Running\",\n\t\t\t\"status_code\": 103,\n\t\t\t\"last_used_at\": \"2026-09-12T17:12:51.033114675Z\",\n\t\t\t\"location\": \"lab03\",\n\t\t\t\"type\": \"container\",\n\t\t\t\"project\": \"ac-ovn-spike\"\n\t\t}\n\t]" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51946" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51947" method=GET protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51948" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Event listener server handler started" id=ac1b52dc-5b73-4b8a-8a20-e52643d30039 local="10.10.10.14:8443" remote="100.122.142.76:51948" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51949" method=PUT protocol=tls url="/1.0/instances/one/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=info msg="[lab01] Stopping instance" action=stop created="2026-09-12 17:12:49.642756907 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 17:12:50.246590203 +0000 UTC" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51950" method=GET protocol=tls url="/1.0/operations/40957a9f-82f8-4914-9e71-4ab68bc1acf0?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.12:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.12:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51951" method=DELETE protocol=tls url="/1.0/instances/one?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:13Z" level=info msg="[lab01] Deleting instance" created="2026-09-12 17:12:49.642756907 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 17:12:50.246590203 +0000 UTC" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:13Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51952" method=GET protocol=tls url="/1.0/operations/4d0bd21e-abba-47d1-8e22-ad6f10dcbc71?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:14Z" level=info msg="[lab01] Deleted instance" created="2026-09-12 17:12:49.642756907 +0000 UTC" ephemeral=false instance=one instanceType=container project=ac-ovn-spike used="2026-09-12 17:12:50.246590203 +0000 UTC" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Event listener server handler stopped" listener=ac1b52dc-5b73-4b8a-8a20-e52643d30039 local="10.10.10.14:8443" remote="100.122.142.76:51948" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51953" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51954" method=GET protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51955" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Event listener server handler started" id=7604f407-1b32-4082-99f4-53fd7785f504 local="10.10.10.14:8443" remote="100.122.142.76:51955" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51956" method=PUT protocol=tls url="/1.0/instances/two/state?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=info msg="[lab03] Stopping instance" action=stop created="2026-09-12 17:12:50.444501094 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike stateful=false used="2026-09-12 17:12:51.033114675 +0000 UTC" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51957" method=GET protocol=tls url="/1.0/operations/f3bcf320-c603-4878-a26c-9dedaafd92c7?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Sending heartbeat request" address="10.10.10.13:8443" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Successful heartbeat" remote="10.10.10.13:8443" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Rebalancing member roles in heartbeat" local="10.10.10.14:8443" +time="2026-09-12T17:13:14Z" level=debug msg="[nas01] Completed heartbeat round" duration=5.425053786s +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51958" method=DELETE protocol=tls url="/1.0/instances/two?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:15Z" level=info msg="[lab03] Deleting instance" created="2026-09-12 17:12:50.444501094 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 17:12:51.033114675 +0000 UTC" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51959" method=GET protocol=tls url="/1.0/operations/fe9ce186-1165-47c0-917c-b35a8bc99508?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=info msg="[lab03] Deleted instance" created="2026-09-12 17:12:50.444501094 +0000 UTC" ephemeral=false instance=two instanceType=container project=ac-ovn-spike used="2026-09-12 17:12:51.033114675 +0000 UTC" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Event listener server handler stopped" listener=7604f407-1b32-4082-99f4-53fd7785f504 local="10.10.10.14:8443" remote="100.122.142.76:51955" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51960" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51962" method=GET protocol=tls url="/1.0/networks?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51963" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51964" method=GET protocol=tls url="/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51965" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51966" method=DELETE protocol=tls url="/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51967" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51968" method=DELETE protocol=tls url="/1.0/networks/default?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Notify node 10.10.10.11:8443 of state changes" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Notify node 10.10.10.12:8443 of state changes" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.13:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Notify node 10.10.10.13:8443 of state changes" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.11:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.12:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.13:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Connecting to a remote Incus over HTTPS" url="https://10.10.10.12:8443" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Sending request to Incus" etag= method=DELETE url="https://10.10.10.11:8443/1.0/networks/default?project=ac-ovn-spike" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Stop" driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Delete" clientType=normal driver=ovn network=default project=ac-ovn-spike +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51969" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51970" method=GET protocol=tls url="/1.0/profiles?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51971" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51972" method=GET protocol=tls url="/1.0/images/aliases?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51974" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51975" method=GET protocol=tls url="/1.0/images?project=ac-ovn-spike&recursion=1" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51976" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51977" method=GET protocol=tls url="/1.0/images/aliases/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Event listener server handler started" id=f92f1913-ff6d-4f65-97cc-aa04d6e5e136 local="10.10.10.14:8443" remote="100.122.142.76:51978" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51978" method=GET protocol=tls url="/1.0/events?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51979" method=DELETE protocol=tls url="/1.0/images/6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:15Z" level=debug msg="[nas01] Database error, retrying" attempt=0 err="Failed to create \"operations\" entry: database is locked" +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] New operation" class=task description="Deleting image" operation=d8d405dc-0434-4687-ae59-41b343a17eb5 project=ac-ovn-spike +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Acquiring lock for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Lock acquired for image" fingerprint=6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Started operation" class=task description="Deleting image" operation=d8d405dc-0434-4687-ae59-41b343a17eb5 project=ac-ovn-spike +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Success for operation" class=task description="Deleting image" operation=d8d405dc-0434-4687-ae59-41b343a17eb5 project=ac-ovn-spike +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51980" method=GET protocol=tls url="/1.0/operations/d8d405dc-0434-4687-ae59-41b343a17eb5?project=ac-ovn-spike" username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Event listener server handler stopped" listener=f92f1913-ff6d-4f65-97cc-aa04d6e5e136 local="10.10.10.14:8443" remote="100.122.142.76:51978" +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51981" method=GET protocol=tls url=/1.0 username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Handling API request" ip="100.122.142.76:51982" method=DELETE protocol=tls url=/1.0/projects/ac-ovn-spike username=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc +time="2026-09-12T17:13:16Z" level=debug msg="[nas01] Matched trusted cert" fingerprint=73e1f42cf39df5ac4d9b6e9523e8456de8745e2204d5586268d592221c6c20bc subject="CN=josh@studio,O=Linux Containers" diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/probe.stderr.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/probe.stderr.txt new file mode 100644 index 0000000..e69de29 diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/probe.stdout.txt b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/probe.stdout.txt new file mode 100644 index 0000000..e71150e --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/probe.stdout.txt @@ -0,0 +1,137 @@ ++ incus network list nas01: --project ac-ovn-spike ++---------+------+---------+----------------+------+-------------+---------+---------+ +| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE | ++---------+------+---------+----------------+------+-------------+---------+---------+ +| default | ovn | YES | 10.253.73.1/24 | none | | 2 | CREATED | ++---------+------+---------+----------------+------+-------------+---------+---------+ +elapsed_seconds=0.098 exit=0 ++ incus network show nas01:default --project ac-ovn-spike +config: + bridge.mtu: "1442" + dns.nameservers: 10.10.40.1 + ipv4.address: 10.253.73.1/24 + ipv4.dhcp: "true" + ipv4.nat: "true" + ipv6.address: none + network: fast40-uplink + volatile.network.ipv4.address: 10.10.40.64 +description: "" +name: default +type: ovn +used_by: + - /1.0/instances/one?project=ac-ovn-spike + - /1.0/instances/two?project=ac-ovn-spike +managed: true +status: Created +locations: + - nas01 + - lab01 + - lab02 + - lab03 +project: ac-ovn-spike +elapsed_seconds=0.094 exit=0 +dns.nameservers=10.10.40.1 ++ incus list nas01: --project ac-ovn-spike --format json +[{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"16900b31-17f5-41f8-a88d-fd6fb7f1d397","volatile.eth0.host_name":"vethd42ad9e0","volatile.eth0.hwaddr":"10:66:6a:02:dd:b1","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"172371c5-b4be-4aec-bd88-4a680cb21ed2","volatile.uuid.generation":"172371c5-b4be-4aec-bd88-4a680cb21ed2"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T17:12:49.642756907Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"16900b31-17f5-41f8-a88d-fd6fb7f1d397","volatile.eth0.host_name":"vethd42ad9e0","volatile.eth0.hwaddr":"10:66:6a:02:dd:b1","volatile.eth0.last_state.ip_addresses":"10.253.73.2","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"172371c5-b4be-4aec-bd88-4a680cb21ed2","volatile.uuid.generation":"172371c5-b4be-4aec-bd88-4a680cb21ed2"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"one","status":"Running","status_code":103,"last_used_at":"2026-09-12T17:12:50.246590203Z","location":"lab01","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11902976,"usage_peak":0,"total":65256516000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.2","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe02:ddb1","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:02:dd:b1","host_name":"vethd42ad9e0","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":16461,"processes":4,"cpu":{"usage":493267000,"allocated_time":24000000000},"started_at":"2026-09-12T17:12:49.25999999Z","os_info":null},"snapshots":null},{"architecture":"x86_64","config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"7be11d18-acb7-4df0-a8cb-dd77bad378ed","volatile.eth0.host_name":"veth7279dfcc","volatile.eth0.hwaddr":"10:66:6a:35:90:e5","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"4c35ca2f-5270-4de1-9682-6929c8560e10","volatile.uuid.generation":"4c35ca2f-5270-4de1-9682-6929c8560e10"},"devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"ephemeral":false,"profiles":[],"stateful":false,"description":"","created_at":"2026-09-12T17:12:50.444501094Z","expanded_config":{"image.agentcompute.digest":"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889","image.architecture":"x86_64","image.description":"Router system container (Alpine 3.22.5)","image.name":"router","image.os":"alpinelinux","image.release":"3.22.5","image.serial":"phase1","image.variant":"router","volatile.base_image":"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f","volatile.cloud-init.instance-id":"7be11d18-acb7-4df0-a8cb-dd77bad378ed","volatile.eth0.host_name":"veth7279dfcc","volatile.eth0.hwaddr":"10:66:6a:35:90:e5","volatile.eth0.last_state.ip_addresses":"10.253.73.3","volatile.idmap.base":"0","volatile.idmap.current":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.idmap.next":"[{\"Isuid\":true,\"Isgid\":false,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000},{\"Isuid\":false,\"Isgid\":true,\"Hostid\":1000000,\"Nsid\":0,\"Maprange\":1000000000}]","volatile.last_state.idmap":"[]","volatile.last_state.power":"RUNNING","volatile.uuid":"4c35ca2f-5270-4de1-9682-6929c8560e10","volatile.uuid.generation":"4c35ca2f-5270-4de1-9682-6929c8560e10"},"expanded_devices":{"eth0":{"name":"eth0","network":"default","type":"nic"},"root":{"path":"/","pool":"data","size":"2GiB","type":"disk"}},"name":"two","status":"Running","status_code":103,"last_used_at":"2026-09-12T17:12:51.033114675Z","location":"lab03","type":"container","project":"ac-ovn-spike","backups":null,"state":{"status":"Running","status_code":103,"disk":{"root":{"usage":192512,"total":2147483648}},"memory":{"usage":11984896,"usage_peak":0,"total":65256532000,"swap_usage":0,"swap_usage_peak":0},"network":{"eth0":{"addresses":[{"family":"inet","address":"10.253.73.3","netmask":"24","scope":"global"},{"family":"inet6","address":"fe80::1266:6aff:fe35:90e5","netmask":"64","scope":"link"}],"counters":{"bytes_received":968,"bytes_sent":1410,"packets_received":6,"packets_sent":11,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"10:66:6a:35:90:e5","host_name":"veth7279dfcc","mtu":1442,"state":"up","type":"broadcast"},"lo":{"addresses":[{"family":"inet","address":"127.0.0.1","netmask":"8","scope":"local"},{"family":"inet6","address":"::1","netmask":"128","scope":"local"}],"counters":{"bytes_received":0,"bytes_sent":0,"packets_received":0,"packets_sent":0,"errors_received":0,"errors_sent":0,"packets_dropped_outbound":0,"packets_dropped_inbound":0},"hwaddr":"","host_name":"","mtu":65536,"state":"up","type":"loopback"}},"pid":40697,"processes":4,"cpu":{"usage":496528000,"allocated_time":24000000000},"started_at":"2026-09-12T17:12:51.039999961Z","os_info":null},"snapshots":null}] +elapsed_seconds=0.112 exit=0 +instance one status=Running location=lab01 eth0_network=default eth0_ipv4=10.253.73.2 +instance two status=Running location=lab03 eth0_network=default eth0_ipv4=10.253.73.3 ++ incus exec nas01:one --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.672 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- cat /sys/class/net/eth0/mtu +1442 +elapsed_seconds=0.234 exit=0 +guest_mtu one=1442 two=1442 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.3 +PING 10.253.73.3 (10.253.73.3): 56 data bytes +64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.531 ms +64 bytes from 10.253.73.3: seq=1 ttl=64 time=1.150 ms +64 bytes from 10.253.73.3: seq=2 ttl=64 time=0.663 ms + +--- 10.253.73.3 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.663/1.114/1.531 ms +elapsed_seconds=2.255 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.253.73.2 +PING 10.253.73.2 (10.253.73.2): 56 data bytes +64 bytes from 10.253.73.2: seq=0 ttl=64 time=1.664 ms +64 bytes from 10.253.73.2: seq=1 ttl=64 time=1.760 ms +64 bytes from 10.253.73.2: seq=2 ttl=64 time=0.656 ms + +--- 10.253.73.2 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.656/1.360/1.760 ms +elapsed_seconds=2.255 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=1.627 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=1.234 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=0.635 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 0.635/1.165/1.627 ms +elapsed_seconds=2.663 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- ping -c 3 -W 2 10.10.40.1 +PING 10.10.40.1 (10.10.40.1): 56 data bytes +64 bytes from 10.10.40.1: seq=0 ttl=63 time=2.509 ms +64 bytes from 10.10.40.1: seq=1 ttl=63 time=2.614 ms +64 bytes from 10.10.40.1: seq=2 ttl=63 time=1.453 ms + +--- 10.10.40.1 ping statistics --- +3 packets transmitted, 3 packets received, 0% packet loss +round-trip min/avg/max = 1.453/2.192/2.614 ms +elapsed_seconds=2.456 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Non-authoritative answer: +Name: example.com +Address: 104.20.23.154 +Name: example.com +Address: 172.66.147.243 + +Non-authoritative answer: +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +elapsed_seconds=0.238 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- nslookup example.com 10.10.40.1 +Server: 10.10.40.1 +Address: 10.10.40.1:53 + +Name: example.com +Address: 104.20.23.154 +Name: example.com +Address: 172.66.147.243 + +Name: example.com +Address: 2606:4700:10::ac42:93f3 +Name: example.com +Address: 2606:4700:10::6814:179a + +elapsed_seconds=0.239 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.357 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com +elapsed_seconds=0.355 exit=0 ++ curl -4 -fsS --connect-timeout 5 --max-time 15 http://10.10.40.79:8080/index.html +ovn-spike-okelapsed_seconds=0.032 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.3:8080/large.bin +bytes=100000000 seconds=0.124317 bytes_per_second=804395215 +elapsed_seconds=0.367 exit=0 ++ incus exec nas01:one --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.508 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin http://10.253.73.2:8080/large.bin +bytes=100000000 seconds=0.113388 bytes_per_second=881927540 +elapsed_seconds=0.352 exit=0 ++ incus exec nas01:two --project ac-ovn-spike -- sha256sum /tmp/ovn-large.bin +a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /tmp/ovn-large.bin +elapsed_seconds=0.494 exit=0 +large_transfer bytes=100000000 sha256=a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae both_directions=ok +probe passed placement=lab01:lab03 ipv4=10.253.73.2:10.253.73.3 diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/tcpdump-arp.log b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/tcpdump-arp.log new file mode 100644 index 0000000..073b0c1 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/tcpdump-arp.log @@ -0,0 +1,5 @@ +tcpdump: verbose output suppressed, use -v[v]... for full protocol decode +listening on enp2s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes +17:12:57.608337 10:66:6a:66:eb:74 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +17:13:05.609430 10:66:6a:66:eb:74 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Request who-has 10.10.40.64 tell 10.10.40.64, length 46 +Connection to sandbox01 closed. diff --git a/spikes/ovn/parent-recovery-2026-09-12/cycle-1/topology.jsonl b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/topology.jsonl new file mode 100644 index 0000000..3abc943 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/cycle-1/topology.jsonl @@ -0,0 +1,40 @@ +{"phase": "prepare-probe-tools", "repository": "https://dl-cdn.alpinelinux.org/alpine/v3.22/main/x86_64", "index_sha256": "948759c222f6d46409bdbcee7d1ea64a7a79ed6be37e2c0ad80bf392a4a97834", "packages": [{"file": "brotli-libs-1.1.0-r2.apk", "sha256": "a693524543421b3a90f163ccb48d5ad0f5fd773b5c3b640acc461eace2cb01b6"}, {"file": "busybox-1.37.0-r20.apk", "sha256": "7cc34c2dda2520b456ab4a55abc37fe245ac90f98ab9f1c7a9be3aec035df48e"}, {"file": "busybox-extras-1.37.0-r20.apk", "sha256": "2b8e8919faa2fc7b52d36eebe2b42844d8a9e19e7e833de8e29883dd4eb0d6c1"}, {"file": "c-ares-1.34.8-r0.apk", "sha256": "1397ec9682ff6153e5d037965c76408e570ae6535ce479cc2af37436fdea52ce"}, {"file": "ca-certificates-bundle-20260611-r0.apk", "sha256": "a18fd1bd8bea03966ee5719aa61e44d9a810db2c8b6641b45f92b30e860f0927"}, {"file": "curl-8.14.1-r3.apk", "sha256": "ec89d3e01d2507e0ece31746018f0c053a4fbd007628dc3016afab406b5c0ff6"}, {"file": "libcrypto3-3.5.8-r0.apk", "sha256": "1d111bc0ad6380fdda22e6513941dc2e7988d6b1621d535bed6b3fa5ef086fae"}, {"file": "libcurl-8.14.1-r3.apk", "sha256": "249e5a3a50558cdb3ce1bab1619b15d88243a628d878700c8d05878c2e71ed71"}, {"file": "libidn2-2.3.7-r0.apk", "sha256": "515cfe061176c7456ea3548651d0014084d77dd3774b78e2c944404ae75a41ff"}, {"file": "libpsl-0.21.5-r3.apk", "sha256": "1e79da4fa1364b7153b8950a363a6de0bef1d1b48d46fcb3b850cd4f233727b2"}, {"file": "libssl3-3.5.8-r0.apk", "sha256": "e8d3ea5e9750cb1f4c4b459d172630925fe6bc13c113c590ac36c78013821e62"}, {"file": "libunistring-1.3-r0.apk", "sha256": "989640e58f7646c0495c3950df36eb7b4df152d8150c2c888f8ab954fed8c908"}, {"file": "musl-1.2.5-r12.apk", "sha256": "4990a5e0ba312e478f94cfe431a70efef1538004eb361c8ae424516848be45bb"}, {"file": "nghttp2-libs-1.69.0-r0.apk", "sha256": "d6ee515d30d703e94b55ef9c0a02aea053313f654acbd2c655d18e3907ecb66a"}, {"file": "zlib-1.3.2-r0.apk", "sha256": "1f3d5f463f490dad3a68097376711bfe5e8156e9e8daff3070513aa4378cdeca"}, {"file": "zstd-libs-1.5.7-r0.apk", "sha256": "1bdd6e57cfbfbfd6e8481cad37ddd5d199950715bec1879b3afb600272dbb09e"}], "signature_check": "apk verifies signatures with the guest's trusted Alpine keys"} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.09, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 18\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/networks/fast40-uplink?project=default", "--request", "GET", "--wait"], "code": 0, "seconds": 0.086, "stdout": "{\n\t\"config\": {\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.gateway\": \"10.10.40.1/24\",\n\t\t\"ipv4.ovn.ranges\": \"10.10.40.64-10.10.40.79\",\n\t\t\"ipv4.routes\": \"10.10.40.64/28\",\n\t\t\"volatile.last_state.created\": \"false\"\n\t},\n\t\"description\": \"physical OVN uplink on IncusOS fast40\",\n\t\"locations\": [\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\",\n\t\t\"lab01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"fast40-uplink\",\n\t\"project\": \"default\",\n\t\"status\": \"Created\",\n\t\"type\": \"physical\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases/router?project=image-build", "--request", "GET", "--wait"], "code": 0, "seconds": 0.087, "stdout": "{\n\t\"description\": \"\",\n\t\"name\": \"router\",\n\t\"target\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects", "--request", "POST", "--wait", "--data", "{\"name\": \"ac-ovn-spike\", \"config\": {\"features.images\": \"true\", \"features.profiles\": \"true\", \"features.networks\": \"true\", \"restricted\": \"true\", \"restricted.containers.nesting\": \"block\", \"restricted.containers.privilege\": \"unprivileged\", \"restricted.containers.lowlevel\": \"block\", \"restricted.cluster.target\": \"allow\", \"restricted.devices.nic\": \"managed\", \"restricted.devices.disk\": \"managed\", \"restricted.devices.gpu\": \"block\", \"restricted.devices.pci\": \"block\", \"restricted.devices.proxy\": \"block\", \"restricted.devices.usb\": \"block\", \"restricted.devices.unix-block\": \"block\", \"restricted.devices.unix-char\": \"block\", \"restricted.devices.unix-hotplug\": \"block\", \"restricted.devices.infiniband\": \"block\", \"restricted.networks.uplinks\": \"fast40-uplink\", \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\", \"user.ovn-spike.owned\": \"true\"}}"], "code": 0, "seconds": 0.149, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"name\": \"default\", \"type\": \"ovn\", \"config\": {\"network\": \"fast40-uplink\", \"ipv4.address\": \"10.253.73.1/24\", \"ipv4.nat\": \"true\", \"ipv4.dhcp\": \"true\", \"ipv6.address\": \"none\", \"dns.nameservers\": \"10.10.40.1\"}}"], "code": 0, "seconds": 0.669, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\",\n\t\t\"nas01\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.081, "stdout": "{\n\t\"config\": {\n\t\t\"bridge.mtu\": \"1442\",\n\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\"ipv4.dhcp\": \"true\",\n\t\t\"ipv4.nat\": \"true\",\n\t\t\"ipv6.address\": \"none\",\n\t\t\"network\": \"fast40-uplink\",\n\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t},\n\t\"description\": \"\",\n\t\"locations\": [\n\t\t\"nas01\",\n\t\t\"lab01\",\n\t\t\"lab02\",\n\t\t\"lab03\"\n\t],\n\t\"managed\": true,\n\t\"name\": \"default\",\n\t\"project\": \"ac-ovn-spike\",\n\t\"status\": \"Created\",\n\t\"type\": \"ovn\",\n\t\"used_by\": []\n}\n\n", "stderr": "", "error": null} +{"args": ["image", "copy", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "nas01:", "--project", "image-build", "--target-project", "ac-ovn-spike"], "code": 0, "seconds": 0.213, "stdout": "\nImage copied successfully!\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab01", "--request", "POST", "--wait", "--data", "{\"name\": \"one\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.417, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T17:12:49.617772108Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"fc998e02-3593-461b-a9be-bd2542472f7f\",\n\t\"location\": \"lab01\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/one?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T17:12:49.617772108Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.364, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&target=lab03", "--request", "POST", "--wait", "--data", "{\"name\": \"two\", \"type\": \"container\", \"profiles\": [], \"source\": {\"type\": \"image\", \"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\"}, \"devices\": {\"root\": {\"type\": \"disk\", \"path\": \"/\", \"pool\": \"data\", \"size\": \"2GiB\"}, \"eth0\": {\"type\": \"nic\", \"network\": \"default\", \"name\": \"eth0\"}}}"], "code": 0, "seconds": 0.436, "stdout": "{\n\t\"class\": \"task\",\n\t\"created_at\": \"2026-09-12T17:12:50.379458221Z\",\n\t\"description\": \"Creating instance\",\n\t\"err\": \"\",\n\t\"id\": \"cb83833d-072d-43b1-b6d7-1ab56c1bb3b9\",\n\t\"location\": \"lab03\",\n\t\"may_cancel\": false,\n\t\"metadata\": {},\n\t\"resources\": {\n\t\t\"instances\": [\n\t\t\t\"/1.0/instances/two?project=ac-ovn-spike\"\n\t\t]\n\t},\n\t\"status\": \"Success\",\n\t\"status_code\": 200,\n\t\"updated_at\": \"2026-09-12T17:12:50.379458221Z\"\n}\n\n", "stderr": "", "error": null} +{"args": ["start", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.379, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.251, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 142451000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256516000,\n\t\t\"usage\": 6467584,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.2\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe02:ddb1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 950,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 5\n\t\t\t},\n\t\t\t\"host_name\": \"vethd42ad9e0\",\n\t\t\t\"hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 16461,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T17:12:49.25999999Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two/state?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.201, "stdout": "{\n\t\"cpu\": {\n\t\t\"allocated_time\": 24000000000,\n\t\t\"usage\": 127373000\n\t},\n\t\"disk\": {\n\t\t\"root\": {\n\t\t\t\"total\": 2147483648,\n\t\t\t\"usage\": 192512\n\t\t}\n\t},\n\t\"memory\": {\n\t\t\"swap_usage\": 0,\n\t\t\"swap_usage_peak\": 0,\n\t\t\"total\": 65256532000,\n\t\t\"usage\": 6479872,\n\t\t\"usage_peak\": 0\n\t},\n\t\"network\": {\n\t\t\"eth0\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"10.253.73.3\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"fe80::1266:6aff:fe35:90e5\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"64\",\n\t\t\t\t\t\"scope\": \"link\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 688,\n\t\t\t\t\"bytes_sent\": 774,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 2,\n\t\t\t\t\"packets_sent\": 3\n\t\t\t},\n\t\t\t\"host_name\": \"veth7279dfcc\",\n\t\t\t\"hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\"mtu\": 1442,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"broadcast\"\n\t\t},\n\t\t\"lo\": {\n\t\t\t\"addresses\": [\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"127.0.0.1\",\n\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\"netmask\": \"8\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t},\n\t\t\t\t{\n\t\t\t\t\t\"address\": \"::1\",\n\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\"netmask\": \"128\",\n\t\t\t\t\t\"scope\": \"local\"\n\t\t\t\t}\n\t\t\t],\n\t\t\t\"counters\": {\n\t\t\t\t\"bytes_received\": 0,\n\t\t\t\t\"bytes_sent\": 0,\n\t\t\t\t\"errors_received\": 0,\n\t\t\t\t\"errors_sent\": 0,\n\t\t\t\t\"packets_dropped_inbound\": 0,\n\t\t\t\t\"packets_dropped_outbound\": 0,\n\t\t\t\t\"packets_received\": 0,\n\t\t\t\t\"packets_sent\": 0\n\t\t\t},\n\t\t\t\"host_name\": \"\",\n\t\t\t\"hwaddr\": \"\",\n\t\t\t\"mtu\": 65536,\n\t\t\t\"state\": \"up\",\n\t\t\t\"type\": \"loopback\"\n\t\t}\n\t},\n\t\"os_info\": null,\n\t\"pid\": 40697,\n\t\"processes\": 9,\n\t\"started_at\": \"2026-09-12T17:12:51.039999961Z\",\n\t\"status\": \"Running\",\n\t\"status_code\": 103\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/one?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.091, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t},\n\t\"created_at\": \"2026-09-12T17:12:49.642756907Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T17:12:50.246590203Z\",\n\t\"location\": \"lab01\",\n\t\"name\": \"one\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/instances/two?project=ac-ovn-spike", "--request", "GET", "--wait"], "code": 0, "seconds": 0.088, "stdout": "{\n\t\"architecture\": \"x86_64\",\n\t\"config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t},\n\t\"created_at\": \"2026-09-12T17:12:50.444501094Z\",\n\t\"description\": \"\",\n\t\"devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"ephemeral\": false,\n\t\"expanded_config\": {\n\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\"image.architecture\": \"x86_64\",\n\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\"image.name\": \"router\",\n\t\t\"image.os\": \"alpinelinux\",\n\t\t\"image.release\": \"3.22.5\",\n\t\t\"image.serial\": \"phase1\",\n\t\t\"image.variant\": \"router\",\n\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\"volatile.idmap.base\": \"0\",\n\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t},\n\t\"expanded_devices\": {\n\t\t\"eth0\": {\n\t\t\t\"name\": \"eth0\",\n\t\t\t\"network\": \"default\",\n\t\t\t\"type\": \"nic\"\n\t\t},\n\t\t\"root\": {\n\t\t\t\"path\": \"/\",\n\t\t\t\"pool\": \"data\",\n\t\t\t\"size\": \"2GiB\",\n\t\t\t\"type\": \"disk\"\n\t\t}\n\t},\n\t\"last_used_at\": \"2026-09-12T17:12:51.033114675Z\",\n\t\"location\": \"lab03\",\n\t\"name\": \"two\",\n\t\"profiles\": [],\n\t\"project\": \"ac-ovn-spike\",\n\t\"stateful\": false,\n\t\"status\": \"Running\",\n\t\"status_code\": 103,\n\t\"type\": \"container\"\n}\n\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "ping -c 1 -W 2 10.253.73.3"], "code": 0, "seconds": 0.226, "stdout": "PING 10.253.73.3 (10.253.73.3): 56 data bytes\n64 bytes from 10.253.73.3: seq=0 ttl=64 time=1.863 ms\n\n--- 10.253.73.3 ping statistics ---\n1 packets transmitted, 1 packets received, 0% packet loss\nround-trip min/avg/max = 1.863/1.863/1.863 ms\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar", "nas01:one/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.307, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.194, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.28, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["file", "push", "/var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar", "nas01:two/tmp/probe-tools.tar", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.324, "stdout": "\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 3% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 5% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 7% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 9% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 12% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 14% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 16% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 18% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 21% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 23% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 25% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 27% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 29% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 32% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 34% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 36% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 38% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 41% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 43% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 45% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 47% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 49% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 52% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 54% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 56% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 58% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 61% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 63% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 65% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 67% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 70% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 72% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 74% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 76% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 78% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 81% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 83% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 85% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 87% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 90% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 92% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 94% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 96% (5.89MB/s)\n \nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 98% (5.89MB/s)\nPushing /var/folders/tm/bbbkbs416vn0bj8n0tdl0h440000gn/T/ovn-probe-tools-wn51z827/probe-tools.tar to /tmp/probe-tools.tar: 100% (5.89MB/s)\n \n", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools"], "code": 0, "seconds": 0.206, "stdout": "", "stderr": "", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "apk add --no-network /tmp/probe-tools/*.apk"], "code": 0, "seconds": 0.28, "stdout": "(1/8) Installing brotli-libs (1.1.0-r2)\n(2/8) Installing busybox-extras (1.37.0-r20)\nExecuting busybox-extras-1.37.0-r20.post-install\n(3/8) Installing libunistring (1.3-r0)\n(4/8) Installing libidn2 (2.3.7-r0)\n(5/8) Installing nghttp2-libs (1.69.0-r0)\n(6/8) Installing libpsl (0.21.5-r3)\n(7/8) Installing libcurl (8.14.1-r3)\n(8/8) Installing curl (8.14.1-r3)\nExecuting busybox-1.37.0-r20.trigger\nOK: 46 MiB in 67 packages\n", "stderr": "", "error": null} +{"args": ["exec", "nas01:one", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.573, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.029846 seconds, 3.1GB/s\n", "error": null} +{"args": ["exec", "nas01:two", "--project", "ac-ovn-spike", "--", "sh", "-c", "\nset -eu\nmkdir -p /srv/www\nprintf '%s' 'ovn-spike-ok' > /srv/www/index.html\ndd if=/dev/zero of=/srv/www/large.bin bs=1000000 count=100\nbusybox-extras httpd -p 8080 -h /srv/www\nsha256sum /srv/www/large.bin\n"], "code": 0, "seconds": 0.51, "stdout": "a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae /srv/www/large.bin\n", "stderr": "100+0 records in\n100+0 records out\n100000000 bytes (95.4MB) copied, 0.026101 seconds, 3.6GB/s\n", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike", "--request", "POST", "--wait", "--data", "{\"listen_address\": \"10.10.40.79\", \"ports\": [{\"protocol\": \"tcp\", \"listen_port\": \"8080\", \"target_address\": \"10.253.73.2\", \"target_port\": \"8080\"}]}"], "code": 0, "seconds": 0.182, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/projects?recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"restricted\": \"true\",\n \"restricted.cluster.target\": \"allow\",\n \"restricted.containers.lowlevel\": \"block\",\n \"restricted.containers.nesting\": \"block\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.gpu\": \"block\",\n \"restricted.devices.infiniband\": \"block\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.devices.pci\": \"block\",\n \"restricted.devices.proxy\": \"block\",\n \"restricted.devices.unix-block\": \"block\",\n \"restricted.devices.unix-char\": \"block\",\n \"restricted.devices.unix-hotplug\": \"block\",\n \"restricted.devices.usb\": \"block\",\n \"restricted.networks.subnets\": \"fast40-uplink:10.10.40.64/28\",\n \"restricted.networks.uplinks\": \"fast40-uplink\",\n \"user.ovn-spike.owned\": \"true\"\n },\n \"description\": \"\",\n \"name\": \"ac-ovn-spike\",\n \"used_by_count\": 5\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"true\",\n \"features.networks.zones\": \"true\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\"\n },\n \"description\": \"Default Incus project\",\n \"name\": \"default\",\n \"used_by_count\": 18\n },\n {\n \"config\": {\n \"features.images\": \"true\",\n \"features.networks\": \"false\",\n \"features.profiles\": \"true\",\n \"features.storage.buckets\": \"true\",\n \"features.storage.volumes\": \"true\",\n \"limits.virtual-machines\": \"0\",\n \"restricted\": \"true\",\n \"restricted.containers.privilege\": \"unprivileged\",\n \"restricted.devices.disk\": \"managed\",\n \"restricted.devices.nic\": \"managed\",\n \"restricted.networks.access\": \"image-build\"\n },\n \"description\": \"Restricted image-build project for agentcompute CI\",\n \"name\": \"image-build\",\n \"used_by_count\": 4\n }\n]\n", "stderr": "", "error": null, "stdout_projection": "Project reference counts replace unrelated resource names"} +{"args": ["query", "nas01:/1.0/instances?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.44, "stdout": "[\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T17:12:49.642756907Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"16900b31-17f5-41f8-a88d-fd6fb7f1d397\",\n\t\t\t\"volatile.eth0.host_name\": \"vethd42ad9e0\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:02:dd:b1\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.2\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\",\n\t\t\t\"volatile.uuid.generation\": \"172371c5-b4be-4aec-bd88-4a680cb21ed2\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T17:12:50.246590203Z\",\n\t\t\"location\": \"lab01\",\n\t\t\"name\": \"one\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t},\n\t{\n\t\t\"architecture\": \"x86_64\",\n\t\t\"config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t\t},\n\t\t\"created_at\": \"2026-09-12T17:12:50.444501094Z\",\n\t\t\"description\": \"\",\n\t\t\"devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"ephemeral\": false,\n\t\t\"expanded_config\": {\n\t\t\t\"image.agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"image.architecture\": \"x86_64\",\n\t\t\t\"image.description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"image.name\": \"router\",\n\t\t\t\"image.os\": \"alpinelinux\",\n\t\t\t\"image.release\": \"3.22.5\",\n\t\t\t\"image.serial\": \"phase1\",\n\t\t\t\"image.variant\": \"router\",\n\t\t\t\"volatile.base_image\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"volatile.cloud-init.instance-id\": \"7be11d18-acb7-4df0-a8cb-dd77bad378ed\",\n\t\t\t\"volatile.eth0.host_name\": \"veth7279dfcc\",\n\t\t\t\"volatile.eth0.hwaddr\": \"10:66:6a:35:90:e5\",\n\t\t\t\"volatile.eth0.last_state.ip_addresses\": \"10.253.73.3\",\n\t\t\t\"volatile.idmap.base\": \"0\",\n\t\t\t\"volatile.idmap.current\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.idmap.next\": \"[{\\\"Isuid\\\":true,\\\"Isgid\\\":false,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000},{\\\"Isuid\\\":false,\\\"Isgid\\\":true,\\\"Hostid\\\":1000000,\\\"Nsid\\\":0,\\\"Maprange\\\":1000000000}]\",\n\t\t\t\"volatile.last_state.idmap\": \"[]\",\n\t\t\t\"volatile.last_state.power\": \"RUNNING\",\n\t\t\t\"volatile.uuid\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\",\n\t\t\t\"volatile.uuid.generation\": \"4c35ca2f-5270-4de1-9682-6929c8560e10\"\n\t\t},\n\t\t\"expanded_devices\": {\n\t\t\t\"eth0\": {\n\t\t\t\t\"name\": \"eth0\",\n\t\t\t\t\"network\": \"default\",\n\t\t\t\t\"type\": \"nic\"\n\t\t\t},\n\t\t\t\"root\": {\n\t\t\t\t\"path\": \"/\",\n\t\t\t\t\"pool\": \"data\",\n\t\t\t\t\"size\": \"2GiB\",\n\t\t\t\t\"type\": \"disk\"\n\t\t\t}\n\t\t},\n\t\t\"last_used_at\": \"2026-09-12T17:12:51.033114675Z\",\n\t\t\"location\": \"lab03\",\n\t\t\"name\": \"two\",\n\t\t\"profiles\": [],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"stateful\": false,\n\t\t\"status\": \"Running\",\n\t\t\"status_code\": 103,\n\t\t\"type\": \"container\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:one", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.064, "stdout": "", "stderr": "", "error": null} +{"args": ["delete", "-f", "nas01:two", "--project", "ac-ovn-spike"], "code": 0, "seconds": 1.018, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.092, "stdout": "[\n\t{\n\t\t\"config\": {\n\t\t\t\"bridge.mtu\": \"1442\",\n\t\t\t\"dns.nameservers\": \"10.10.40.1\",\n\t\t\t\"ipv4.address\": \"10.253.73.1/24\",\n\t\t\t\"ipv4.dhcp\": \"true\",\n\t\t\t\"ipv4.nat\": \"true\",\n\t\t\t\"ipv6.address\": \"none\",\n\t\t\t\"network\": \"fast40-uplink\",\n\t\t\t\"volatile.network.ipv4.address\": \"10.10.40.64\"\n\t\t},\n\t\t\"description\": \"\",\n\t\t\"locations\": [\n\t\t\t\"nas01\",\n\t\t\t\"lab01\",\n\t\t\t\"lab02\",\n\t\t\t\"lab03\"\n\t\t],\n\t\t\"managed\": true,\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"status\": \"Created\",\n\t\t\"type\": \"ovn\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.084, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"\",\n\t\t\"listen_address\": \"10.10.40.79\",\n\t\t\"location\": \"\",\n\t\t\"ports\": [\n\t\t\t{\n\t\t\t\t\"description\": \"\",\n\t\t\t\t\"listen_port\": \"8080\",\n\t\t\t\t\"protocol\": \"tcp\",\n\t\t\t\t\"snat\": false,\n\t\t\t\t\"target_address\": \"10.253.73.2\",\n\t\t\t\t\"target_port\": \"8080\"\n\t\t\t}\n\t\t]\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default/forwards/10.10.40.79?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.13, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/networks/default?project=ac-ovn-spike", "--request", "DELETE", "--wait"], "code": 0, "seconds": 0.117, "stdout": "", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/profiles?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n\t{\n\t\t\"config\": {},\n\t\t\"description\": \"Default Incus profile for project ac-ovn-spike\",\n\t\t\"devices\": {},\n\t\t\"name\": \"default\",\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"used_by\": []\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images/aliases?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.093, "stdout": "[]\n\n", "stderr": "", "error": null} +{"args": ["query", "nas01:/1.0/images?project=ac-ovn-spike&recursion=1", "--request", "GET", "--wait"], "code": 0, "seconds": 0.089, "stdout": "[\n\t{\n\t\t\"aliases\": [],\n\t\t\"architecture\": \"x86_64\",\n\t\t\"auto_update\": false,\n\t\t\"cached\": false,\n\t\t\"created_at\": \"2026-09-11T21:43:42Z\",\n\t\t\"expires_at\": \"2036-09-08T21:43:42Z\",\n\t\t\"filename\": \"\",\n\t\t\"fingerprint\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\"last_used_at\": \"2026-09-12T17:12:50.482165065Z\",\n\t\t\"locations\": [\n\t\t\t\"nas01\"\n\t\t],\n\t\t\"profiles\": [\n\t\t\t\"default\"\n\t\t],\n\t\t\"project\": \"ac-ovn-spike\",\n\t\t\"properties\": {\n\t\t\t\"agentcompute.digest\": \"sha256:6b3ecd8336b6fce7006e764e01373199e2cc1cf46172132b53e0aaebd27be889\",\n\t\t\t\"architecture\": \"x86_64\",\n\t\t\t\"description\": \"Router system container (Alpine 3.22.5)\",\n\t\t\t\"name\": \"router\",\n\t\t\t\"os\": \"alpinelinux\",\n\t\t\t\"release\": \"3.22.5\",\n\t\t\t\"serial\": \"phase1\",\n\t\t\t\"variant\": \"router\"\n\t\t},\n\t\t\"public\": false,\n\t\t\"size\": 11678548,\n\t\t\"type\": \"container\",\n\t\t\"update_source\": {\n\t\t\t\"alias\": \"6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f\",\n\t\t\t\"certificate\": \"-----BEGIN CERTIFICATE-----\\nMIICmDCCAh6gAwIBAgIUfTuELarzbTdOjA9w6rdCSHAyGWgwCgYIKoZIzj0EAwMw\\nNDEZMBcGA1UECgwQTGludXggQ29udGFpbmVyczEXMBUGA1UEAwwOaW5jdXMuZ2xh\\nYi5sb2wwHhcNMjYwODIyMTYxNzExWhcNMzYwODE5MTYxNzExWjA0MRkwFwYDVQQK\\nDBBMaW51eCBDb250YWluZXJzMRcwFQYDVQQDDA5pbmN1cy5nbGFiLmxvbDB2MBAG\\nByqGSM49AgEGBSuBBAAiA2IABGtwmoAgPolww1cpLvMX3TjtKSUtYCSZMyWx3yQH\\n20fIJly405lRFmIEzyZ3u22m+0pLYpFuWf4hNLPIhgbQZ1F4bFfv5IABIaIp0qN+\\nno/21sPeFXrl1YtGFGahhigYXqOB8DCB7TAPBgNVHRMBAf8EBTADAQH/MA4GA1Ud\\nDwEB/wQEAwIChDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwgYsGA1Ud\\nEQSBgzCBgIIOaW5jdXMuZ2xhYi5sb2yCDm5hczAxLmdsYWIubG9sgg5sYWIwMS5n\\nbGFiLmxvbIIObGFiMDIuZ2xhYi5sb2yCDmxhYjAzLmdsYWIubG9shwQKCgoOhwQK\\nCgoLhwQKCgoMhwQKCgoNhwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMB0GA1UdDgQW\\nBBSKX7v2q8VXqmaRmiuq5I1qH1cmADAKBggqhkjOPQQDAwNoADBlAjB8+wiadUTu\\navraovYrkM6XqRE0vBTR1Xu/gGxISAblzjY8yFk5wFwV0PgJOEOXGoACMQCXb75X\\n+fcnKkLynNDsXM0EUEZnqyMLLh3GnHgxWZ/fKxo14RaoZw1mgl4gbd8gb/c=\\n-----END CERTIFICATE-----\\n\",\n\t\t\t\"image_type\": \"\",\n\t\t\t\"protocol\": \"incus\",\n\t\t\t\"server\": \"https://10.10.10.14:8443\"\n\t\t},\n\t\t\"uploaded_at\": \"2026-09-12T17:12:49.503691807Z\"\n\t}\n]\n\n", "stderr": "", "error": null} +{"args": ["image", "delete", "nas01:6e3183fe052e00d89c806c414cb3ff92f757884894414ea1cf83ecbb9ae20c7f", "--project", "ac-ovn-spike"], "code": 0, "seconds": 0.253, "stdout": "", "stderr": "", "error": null} +{"args": ["project", "delete", "nas01:ac-ovn-spike"], "code": 0, "seconds": 0.088, "stdout": "Project nas01:ac-ovn-spike deleted\n", "stderr": "", "error": null} diff --git a/spikes/ovn/parent-recovery-2026-09-12/execution.jsonl b/spikes/ovn/parent-recovery-2026-09-12/execution.jsonl new file mode 100644 index 0000000..67cd700 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/execution.jsonl @@ -0,0 +1,18 @@ +{"at": "2026-09-12T17:11:18.393306+00:00", "command": "env FLEET_OVN_SOAK_ACTION=stop uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_soak_fixture.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 1.872, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_soak_fixture.py\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.InstanceState (instance_name=soak01, project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_soak_fixture.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Stop authorized default/soak01 fixture on lab01 1 (@local) - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:11:49.587434+00:00", "command": "env FLEET_OVN_SOAK_ACTION=stop uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_soak_fixture.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 31.193, "exit_code": 1, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_soak_fixture.py\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_soak_fixture.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Stop authorized default/soak01 fixture on lab01 \n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.InstanceState (instance_name=soak01, project=default, remote=nas01)\n [@local] Error: Failed shutting down instance, status is \"Running\": context deadline exceeded\n [@local] Try `incus info --show-log nas01:soak01` for more info\n [@local] Error: executed 0 commands\n\n--> Disconnecting from hosts...\n--> pyinfra error: No hosts remaining!\n"} +{"at": "2026-09-12T17:12:27.030473+00:00", "command": "env FLEET_OVN_SOAK_ACTION=stop uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_soak_fixture.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 1.152, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_soak_fixture.py\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.InstanceState (instance_name=soak01, project=default, remote=nas01)\n [@local] noop: Incus instance default/soak01 is stopped\n [@local] Ready: src/fleet_cluster/deploys/ovn_soak_fixture.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Stop authorized default/soak01 fixture on lab01 - - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:12:27.905743+00:00", "command": "env FLEET_OVN_SOAK_ACTION=stop uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_soak_fixture.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 0.875, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_soak_fixture.py\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_soak_fixture.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Stop authorized default/soak01 fixture on lab01 \n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.InstanceState (instance_name=soak01, project=default, remote=nas01)\n [@local] noop: Incus instance default/soak01 is stopped\n [@local] No changes\n\n--> Results:\n Operation Hosts Success Error No Change \n Stop authorized default/soak01 fixture on lab01 1 - - 1 \n Grand total 1 - - 1 \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:12:28.657932+00:00", "command": "env FLEET_OVN_SOAK_ACTION=delete uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_soak_fixture.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 0.752, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_soak_fixture.py\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_soak_fixture.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Delete stopped authorized default/soak01 fixture on lab01 1 (@local) - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:12:30.612214+00:00", "command": "env FLEET_OVN_SOAK_ACTION=delete uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_soak_fixture.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 1.954, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_soak_fixture.py\n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Ready: src/fleet_cluster/deploys/ovn_soak_fixture.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Delete stopped authorized default/soak01 fixture on lab01 \n [@local] Loaded fact pyinfra_incus.facts.Instances (project=default, remote=nas01)\n [@local] Success\n\n--> Results:\n Operation Hosts Success Error No Change \n Delete stopped authorized default/soak01 fixture on lab01 1 1 - - \n Grand total 1 1 - - \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:12:30.700537+00:00", "command": "incus query 'nas01:/1.0/instances/soak01?project=default'", "cwd": null, "seconds": 0.088, "exit_code": 1, "stdout": "", "stderr": "Error: Instance not found\n"} +{"at": "2026-09-12T17:12:30.800145+00:00", "command": "incus query 'nas01:/1.0/networks/fast40?project=default&target=lab01'", "cwd": null, "seconds": 0.099, "exit_code": 0, "stdout": "{\n\t\"config\": {},\n\t\"description\": \"\",\n\t\"locations\": null,\n\t\"managed\": false,\n\t\"name\": \"fast40\",\n\t\"project\": \"default\",\n\t\"status\": \"\",\n\t\"type\": \"vlan\",\n\t\"used_by\": [\n\t\t\"/1.0/networks/fast40-uplink\"\n\t]\n}\n\n", "stderr": ""} +{"at": "2026-09-12T17:13:29.436522+00:00", "command": "bash -o pipefail -c 'incus query '\"'\"'nas01:/os/1.0/debug/log?target=lab01&unit=ovs-vswitchd.service&since=2026-09-12T17%3A11%3A16.520995%2B00%3A00'\"'\"' | jq '\"'\"'[.[] | {at: .__REALTIME_TIMESTAMP, member: ._HOSTNAME, boot_id: ._BOOT_ID, message: .MESSAGE}]'\"'\"''", "cwd": null, "seconds": 0.167, "exit_code": 0, "stdout": "[\n {\n \"at\": \"1789233168821394\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233168821548\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c\"\n },\n {\n \"at\": \"1789233168821577\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00214|connmgr|INFO|incusovn16: added service controller \\\"punix:/var/run/openvswitch/incusovn16.mgmt\\\"\"\n },\n {\n \"at\": \"1789233168823984\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824041\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824065\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824085\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824105\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824126\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824141\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824158\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824178\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824194\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824207\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824225\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824239\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168824256\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824268\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824279\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824291\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824302\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824317\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824329\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824341\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824354\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824369\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168824383\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168824399\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168824410\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168824423\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168824433\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168824444\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824455\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824466\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -4483827ms\"\n },\n {\n \"at\": \"1789233168824478\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168824489\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824505\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824517\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233168824529\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168824540\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824550\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168824561\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168824572\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168824583\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168824592\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824602\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168824619\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168824629\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created\"\n },\n {\n \"at\": \"1789233168830826\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168830870\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168830889\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168830901\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168830915\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168830929\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 0ms\"\n },\n {\n \"at\": \"1789233168830941\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830956\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830966\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -4483834ms\"\n },\n {\n \"at\": \"1789233168830979\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168830992\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831002\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831014\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168831029\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168831040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831053\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168831069\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: admin_down\"\n },\n {\n \"at\": \"1789233168831081\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168831092\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x0\"\n },\n {\n \"at\": \"1789233168831103\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831115\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168831130\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 0\"\n },\n {\n \"at\": \"1789233168919953\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233168920177\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3\"\n },\n {\n \"at\": \"1789233168922264\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168922326\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168922365\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168922405\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168922441\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" my_disc:0x8cb25190 your_disc:0xc4521b29\"\n },\n {\n \"at\": \"1789233168922474\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922508\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168922542\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168922585\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168922614\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168922648\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922680\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168922710\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now -4483925ms\"\n },\n {\n \"at\": \"1789233168922739\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now +752ms\"\n },\n {\n \"at\": \"1789233168922777\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -98ms\"\n },\n {\n \"at\": \"1789233168922812\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168922846\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168922882\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168922914\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168922946\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168922978\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923012\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923044\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923075\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923106\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923139\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168923179\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923215\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923247\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168923282\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168923323\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168923356\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168923388\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923420\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168923454\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168923489\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now +751ms\"\n },\n {\n \"at\": \"1789233168923528\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -99ms\"\n },\n {\n \"at\": \"1789233168923563\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168923594\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168923625\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923653\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0xc4521b29\"\n },\n {\n \"at\": \"1789233168923684\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923715\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923749\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168923780\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168923811\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168923842\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x8cb25190\"\n },\n {\n \"at\": \"1789233168923873\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923907\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168923938\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926377\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233168926481\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233168926527\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233168926562\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233168926596\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" my_disc:0x10864ed9 your_disc:0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168926642\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926671\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233168926702\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233168926734\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168926764\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168926796\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926827\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168926859\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now -4483929ms\"\n },\n {\n \"at\": \"1789233168926894\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168926927\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168926959\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168926991\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927023\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927057\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927088\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927120\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927148\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927180\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927211\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927239\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168927273\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233168927304\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927339\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927371\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233168927407\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233168927514\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168927546\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233168927578\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927609\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233168927636\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233168927668\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now +989ms\"\n },\n {\n \"at\": \"1789233168927700\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -1ms\"\n },\n {\n \"at\": \"1789233168927731\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233168927758\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233168927789\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168927817\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0xcfbfe66f\"\n },\n {\n \"at\": \"1789233168927848\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927879\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168927910\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233168927941\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233168927972\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233168928000\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0x10864ed9\"\n },\n {\n \"at\": \"1789233168928031\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928062\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233168928093\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233168928123\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233168928159\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6\"\n },\n {\n \"at\": \"1789233169749719\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3\"\n },\n {\n \"at\": \"1789233169749802\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx.\"\n },\n {\n \"at\": \"1789233169749820\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" vers:1 diag:\\\"No Diagnostic\\\" state:init mult:3 length:24\"\n },\n {\n \"at\": \"1789233169749836\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" flags: none\"\n },\n {\n \"at\": \"1789233169749847\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" my_disc:0xae7cb34c your_disc:0x61d86ef2\"\n },\n {\n \"at\": \"1789233169749861\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_tx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749872\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_rx:1000000us (1000ms)\"\n },\n {\n \"at\": \"1789233169749882\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" min_rx_echo:0us (0ms) Forwarding: false\"\n },\n {\n \"at\": \"1789233169749895\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169749905\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169749927\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749937\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169749949\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now -4484753ms\"\n },\n {\n \"at\": \"1789233169749969\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169749988\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750005\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750019\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750030\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750053\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750064\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750078\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750089\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750100\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750111\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750126\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 0ms\"\n },\n {\n \"at\": \"1789233169750139\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750154\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750165\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \\\"No Diagnostic\\\") -> (bfd.SessionState: up, bfd.LocalDiag: \\\"No Diagnostic\\\")\"\n },\n {\n \"at\": \"1789233169750177\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Forwarding: false\"\n },\n {\n \"at\": \"1789233169750188\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233169750200\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Concatenated Path Down: false\"\n },\n {\n \"at\": \"1789233169750211\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" TX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750221\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" RX Interval: Approx 1000ms\"\n },\n {\n \"at\": \"1789233169750230\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Detect Time: now +3000ms\"\n },\n {\n \"at\": \"1789233169750241\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Next TX Time: now +894ms\"\n },\n {\n \"at\": \"1789233169750252\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Last TX Time: now -56ms\"\n },\n {\n \"at\": \"1789233169750263\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Flags: none\"\n },\n {\n \"at\": \"1789233169750273\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Session State: down\"\n },\n {\n \"at\": \"1789233169750285\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750295\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Discriminator: 0x61d86ef2\"\n },\n {\n \"at\": \"1789233169750305\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750323\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Local Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750337\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Flags: none\"\n },\n {\n \"at\": \"1789233169750350\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Session State: init\"\n },\n {\n \"at\": \"1789233169750363\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Diagnostic: No Diagnostic\"\n },\n {\n \"at\": \"1789233169750373\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Discriminator: 0xae7cb34c\"\n },\n {\n \"at\": \"1789233169750385\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum TX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750397\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Minimum RX Interval: 1000ms\"\n },\n {\n \"at\": \"1789233169750408\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \" Remote Detect Multiplier: 3\"\n },\n {\n \"at\": \"1789233170158976\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7\"\n },\n {\n \"at\": \"1789233178826726\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00223|connmgr|INFO|br-int<->unix#3: 913 flow_mods in the 6 s starting 10 s ago (847 adds, 58 deletes, 8 modifications)\"\n },\n {\n \"at\": \"1789233193165011\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00224|bridge|INFO|bridge br-int: deleted interface vethd42ad9e0 on port 7\"\n },\n {\n \"at\": \"1789233195484004\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00225|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534\"\n },\n {\n \"at\": \"1789233195484249\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00226|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2\"\n },\n {\n \"at\": \"1789233195484344\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1\"\n },\n {\n \"at\": \"1789233195501004\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00228|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6\"\n },\n {\n \"at\": \"1789233195501040\",\n \"member\": \"lab01.glab.lol\",\n \"boot_id\": \"b5e39bb2a73f421c9b89a935f9f116b2\",\n \"message\": \"ovs|00002|ofproto_dpif_monitor(monitor65)|INFO|monitor thread terminated\"\n }\n]\n", "stderr": ""} +{"at": "2026-09-12T17:18:41.143789+00:00", "command": "incus project list nas01: --format csv", "cwd": null, "seconds": 0.347, "exit_code": 0, "stdout": "default (current),YES,YES,YES,YES,YES,YES,Default Incus project,18\nimage-build,YES,YES,YES,YES,NO,NO,Restricted image-build project for agentcompute CI,4\n", "stderr": ""} +{"at": "2026-09-12T17:18:41.442543+00:00", "command": "incus network list nas01: --project default --format csv", "cwd": null, "seconds": 0.298, "exit_code": 0, "stdout": "fast40,vlan,NO,,,,1,\nfast40-uplink,physical,YES,,,physical OVN uplink on IncusOS fast40,0,CREATED\nimage-build,bridge,YES,10.57.139.1/24,none,NAT bridge for the restricted image-build project,1,CREATED\nincusbr0,bridge,YES,10.158.84.1/24,fd42:37d0:7f47:b4d::1/64,Local network bridge (NAT),6,CREATED\n", "stderr": ""} +{"at": "2026-09-12T17:18:41.794838+00:00", "command": "incus cluster list nas01: --format csv", "cwd": null, "seconds": 0.352, "exit_code": 0, "stdout": "lab01,https://10.10.10.11:8443,database-standby,x86_64,default,,ONLINE,Fully operational\nlab02,https://10.10.10.12:8443,database,x86_64,default,,ONLINE,Fully operational\nlab03,https://10.10.10.13:8443,database,x86_64,default,,ONLINE,Fully operational\nnas01,https://10.10.10.14:8443,\"database-leader,database\",x86_64,default,,ONLINE,Fully operational\n", "stderr": ""} +{"at": "2026-09-12T17:18:41.951141+00:00", "command": "ssh -o BatchMode=yes josh@sandbox01 'sudo -n systemctl is-active ovn-central ovn-northd ovn-ovsdb-server-nb ovn-ovsdb-server-sb; sudo -n ovn-nbctl show'", "cwd": null, "seconds": 0.156, "exit_code": 0, "stdout": "active\nactive\nactive\nactive\n", "stderr": ""} +{"at": "2026-09-12T17:24:06.554890+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_parent_check.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 2.742, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_parent_check.py\n [@local] Ready: src/fleet_cluster/deploys/ovn_parent_check.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Refuse default-project fast40 parents except fast40-uplink \n [@local] Loaded fact fleet_cluster.operations.InstancesExpanded (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Profiles (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.ClusterMembers (remote=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=nas01)\n [@local] noop: default/fast40-uplink is the exclusive fast40 parent\n [@local] No changes\n\n--> Results:\n Operation Hosts Success Error No Change \n Refuse default-project fast40 parents except fast40-uplink 1 - - 1 \n Grand total 1 - - 1 \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:26:44.043816+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn_parent_check.py -v --yes", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 2.434, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn_parent_check.py\n [@local] Ready: src/fleet_cluster/deploys/ovn_parent_check.py\n\n--> Skipping change detection\n--> Beginning operation run...\n--> Starting operation: Refuse default-project fast40 parents except fast40-uplink \n [@local] Loaded fact fleet_cluster.operations.InstancesExpanded (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Profiles (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.ClusterMembers (remote=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=nas01)\n [@local] noop: default/fast40-uplink is the exclusive fast40 parent\n [@local] No changes\n\n--> Results:\n Operation Hosts Success Error No Change \n Refuse default-project fast40 parents except fast40-uplink 1 - - 1 \n Grand total 1 - - 1 \n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:26:48.558189+00:00", "command": "uv run --locked pyinfra inventory.py src/fleet_cluster/deploys/ovn.py -v --dry", "cwd": "/Users/josh/code/lab2/fleet/.wt/spike-ovn-recreate-diagnosis/cluster", "seconds": 4.514, "exit_code": 0, "stdout": "", "stderr": "--> Loading config...\n--> Loading inventory...\n--> Connecting to hosts...\n [@local] Connected\n\n--> Preparing operation files...\n Loading: src/fleet_cluster/deploys/ovn.py\n [@local] Loaded fact fleet_cluster.operations.InstancesExpanded (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Profiles (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.ClusterMembers (remote=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=image-build, project=default, remote=nas01, target=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=incusbr0, project=default, remote=nas01, target=nas01)\n [@local] noop: default/fast40-uplink is the exclusive fast40 parent\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=nas01)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab01)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab02)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.IncusOSOVN (remote=nas01, target=lab03)\n [@local] noop: IncusOS OVN service configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=nas01)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab01)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab02)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Server (remote=nas01, target=lab03)\n [@local] noop: Incus server configuration is unchanged\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] noop: Incus network default/fast40-macvlan is absent\n [@local] Loaded fact pyinfra_incus.facts.ClusterMembers (remote=nas01)\n [@local] Loaded fact pyinfra_incus.facts.Networks (project=default, remote=nas01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab01)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab02)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=lab03)\n [@local] Loaded fact fleet_cluster.operations.NetworkMember (network_name=fast40-uplink, project=default, remote=nas01, target=nas01)\n [@local] noop: Incus cluster network default/fast40-uplink is unchanged\n [@local] Ready: src/fleet_cluster/deploys/ovn.py\n\n--> Detected changes:\n Operation Change Conditional Change \n Refuse default-project fast40 parents except fast40-uplink - - \n Ensure nas01 OVN chassis enabled - - \n Ensure lab01 OVN chassis enabled - - \n Ensure lab02 OVN chassis enabled - - \n Ensure lab03 OVN chassis enabled - - \n Ensure nas01 OVN northbound connection - - \n Ensure lab01 OVN northbound connection - - \n Ensure lab02 OVN northbound connection - - \n Ensure lab03 OVN northbound connection - - \n Ensure unused fast40-macvlan is absent - - \n Ensure clustered physical uplink fast40-uplink - - \n\n Detected changes may not include every change pyinfra will execute.\n Hidden side effects of operations may alter behaviour of future operations,\n this will be shown in the results. The remote state will always be updated\n to reflect the state defined by the input operations.\n\n--> Disconnecting from hosts...\n"} +{"at": "2026-09-12T17:31:09.226599+00:00", "command": "gh pr view 16 --repo GilmanLab/agentcompute --json body", "cwd": null, "seconds": 0.409, "exit_code": 0, "stdout": "{\"body\":\"## Current verdict: PROCEED\\n\\nRemoving the owner-authorized default/soak01 03c fixture resolved the macvlan/OVS fast40 RX-handler conflict. The first post-removal cycle selected **lab01**, passed every datapath/capture/cleanup check in **31.018 s**, and logged fast40 added on OVS port 1 with zero EBUSY errors. No reboot, central restart, chassis change, or neighbor clear. The port was removed during normal teardown.\\n\\n## Deliverables\\n\\n- One-command bounded create/probe/diagnose/destroy cycle.\\n- Historical 13-run diagnosis preserved, plus successful post-removal qualification and exact fleet deletion/OVS/probe evidence.\\n- Report supersedes the earlier fixture-confounded FALLBACK verdict.\\n- Two rules: fast40 exclusively belongs to fast40-uplink (managed-only sandbox NICs plus fleet default-project preflight); central must be up for OVN control-plane operations, with Errored networks reaper-deletable after recovery.\\n- ARCHITECTURE_GO.md and Phase 5 prompt updated on journal/jmgilman.\\n\\n## Verification\\n\\nFleet guard passed live unchanged; full OVN dry-run has 11 unchanged operations. Fleet pytest 47 passed, mypy 18 source files and Ruff passed. Companion address-plan site built. Temporary fixture deploy removed, packet captures stopped, no disposable topology/keeper/soak01 remains. Central/uplink/chassis retained; all four members ONLINE.\\n\\nAddress consumption remains two per tested sandbox: NAT router plus one forward address.\\n\\nCompanions: https://github.com/GilmanLab/fleet/pull/16 and https://github.com/GilmanLab/root/pull/31 . Upstream root-cause update: https://github.com/lxc/incus/issues/3986#issuecomment-5647440313 . The independent northbound outage issue https://github.com/lxc/incus/issues/3985 remains open.\"}\n", "stderr": ""} +{"at": "2026-09-12T17:31:10.760462+00:00", "command": "gh pr edit 16 --repo GilmanLab/agentcompute --body '## Current verdict: PROCEED\n\nRemoving the owner-authorized default/soak01 03c fixture resolved the macvlan/OVS fast40 RX-handler conflict. The first post-removal cycle selected **lab01**, passed every datapath/capture/cleanup check in **31.018 s**, and logged fast40 added on OVS port 1 with zero EBUSY errors. No reboot, central restart, chassis change, or neighbor clear. The port was removed during normal teardown.\n\n## Deliverables\n\n- One-command bounded create/probe/diagnose/destroy cycle.\n- Historical 13-run diagnosis preserved, plus successful post-removal qualification and exact fleet deletion/OVS/probe evidence.\n- Report supersedes the earlier fixture-confounded FALLBACK verdict.\n- Two rules: fast40 exclusively belongs to fast40-uplink (managed-only sandbox NICs plus fleet default-project preflight); central must be up for OVN control-plane operations, with Errored networks reaper-deletable after recovery.\n- ARCHITECTURE_GO.md and Phase 5 prompt updated on journal/jmgilman.\n\n## Verification\n\nFleet guard passed live unchanged; full OVN dry-run has 11 unchanged operations. Fleet pytest 47 passed, mypy 18 source files and Ruff passed. Companion address-plan site built. Temporary fixture deploy removed, packet captures stopped, no disposable topology/keeper/soak01 remains. Central/uplink/chassis retained; all four members ONLINE.\n\nAddress consumption remains two per tested sandbox: NAT router plus one forward address.\n\nCompanions: https://github.com/GilmanLab/fleet/pull/16 and https://github.com/GilmanLab/root/pull/31 . Upstream root-cause update: https://github.com/lxc/incus/issues/3986#issuecomment-5647440313 . The independent northbound outage issue https://github.com/lxc/incus/issues/3985 is independent. Both upstream issues were automatically closed by the repository\u2019s web-interface-only submission policy, not technical triage; the root-cause comment was posted to the existing #3986.'", "cwd": null, "seconds": 1.533, "exit_code": 0, "stdout": "https://github.com/GilmanLab/agentcompute/pull/16\n", "stderr": ""} diff --git a/spikes/ovn/parent-recovery-2026-09-12/fixture-deploy.py.txt b/spikes/ovn/parent-recovery-2026-09-12/fixture-deploy.py.txt new file mode 100644 index 0000000..22d2709 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/fixture-deploy.py.txt @@ -0,0 +1,34 @@ +"""Remove only the owner-authorized default/soak01 fixture on lab01.""" + +import os + +from pyinfra import host +from pyinfra_incus.facts import Instances +from pyinfra_incus.operations import instance, instance_state + +from fleet_cluster.config import REMOTE + +ACTION = os.environ["FLEET_OVN_SOAK_ACTION"] +if ACTION not in {"stop", "delete"}: + raise ValueError("FLEET_OVN_SOAK_ACTION must be stop or delete") +current = host.get_fact(Instances, project="default", remote=REMOTE).get("soak01") +if current is not None and current.get("location") != "lab01": + raise ValueError("Refusing fixture removal: default/soak01 is not on lab01") +if ACTION == "stop" and current is not None: + instance_state( + name="Stop authorized default/soak01 fixture on lab01", + instance_name="soak01", + project="default", + desired_state="stopped", + timeout=30, + remote=REMOTE, + force=True, + ) +if ACTION == "delete": + instance( + name="Delete stopped authorized default/soak01 fixture on lab01", + instance_name="soak01", + project="default", + present=False, + remote=REMOTE, + ) diff --git a/spikes/ovn/parent-recovery-2026-09-12/lab01-attachment-journal.json b/spikes/ovn/parent-recovery-2026-09-12/lab01-attachment-journal.json new file mode 100644 index 0000000..c0c7fdf --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/lab01-attachment-journal.json @@ -0,0 +1,1394 @@ +[ + { + "at": "1789233168821394", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00212|bridge|INFO|bridge incusovn16: added interface incusovn16 on port 65534" + }, + { + "at": "1789233168821548", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00213|bridge|INFO|bridge incusovn16: using datapath ID 00009669fb73544c" + }, + { + "at": "1789233168821577", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00214|connmgr|INFO|incusovn16: added service controller \"punix:/var/run/openvswitch/incusovn16.mgmt\"" + }, + { + "at": "1789233168823984", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00215|bfd|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824041", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Forwarding: false" + }, + { + "at": "1789233168824065", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824085", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824105", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824126", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824141", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824158", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824178", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824194", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168824207", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824225", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824239", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168824256", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824268", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824279", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824291", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824302", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824317", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824329", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824341", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824354", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824369", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00216|bfd|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168824383", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Forwarding: false" + }, + { + "at": "1789233168824399", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168824410", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168824423", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168824433", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168824444", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now -4483827ms" + }, + { + "at": "1789233168824455", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now -4483827ms" + }, + { + "at": "1789233168824466", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -4483827ms" + }, + { + "at": "1789233168824478", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168824489", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168824505", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824517", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233168824529", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168824540", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824550", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168824561", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168824572", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168824583", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168824592", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168824602", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168824619", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168824629", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00001|ofproto_dpif_monitor(monitor65)|INFO|monitor thread created" + }, + { + "at": "1789233168830826", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00217|bfd|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: admin_down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168830870", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Forwarding: false" + }, + { + "at": "1789233168830889", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168830901", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168830915", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168830929", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 0ms" + }, + { + "at": "1789233168830941", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now -4483834ms" + }, + { + "at": "1789233168830956", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now -4483834ms" + }, + { + "at": "1789233168830966", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -4483834ms" + }, + { + "at": "1789233168830979", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168830992", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: admin_down" + }, + { + "at": "1789233168831002", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831014", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168831029", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168831040", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831053", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168831069", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: admin_down" + }, + { + "at": "1789233168831081", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168831092", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x0" + }, + { + "at": "1789233168831103", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168831115", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 0ms" + }, + { + "at": "1789233168831130", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 0" + }, + { + "at": "1789233168919953", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233168920177", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00219|bridge|INFO|bridge incusovn16: using datapath ID 000038052532def3" + }, + { + "at": "1789233168922264", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00001|bfd(handler40)|INFO|Interface ovn-5ec8d1-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168922326", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00002|bfd(handler40)|INFO|ovn-5ec8d1-0: New remote min_rx." + }, + { + "at": "1789233168922365", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168922405", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " flags: none" + }, + { + "at": "1789233168922441", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " my_disc:0x8cb25190 your_disc:0xc4521b29" + }, + { + "at": "1789233168922474", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168922508", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168922542", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168922585", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168922614", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168922648", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168922680", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168922710", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now -4483925ms" + }, + { + "at": "1789233168922739", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now +752ms" + }, + { + "at": "1789233168922777", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -98ms" + }, + { + "at": "1789233168922812", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168922846", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: down" + }, + { + "at": "1789233168922882", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168922914", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168922946", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168922978", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923012", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923044", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923075", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923106", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923139", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168923179", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923215", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168923247", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00003|bfd(handler40)|INFO|ovn-5ec8d1-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168923282", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Forwarding: false" + }, + { + "at": "1789233168923323", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168923356", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168923388", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168923420", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168923454", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168923489", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now +751ms" + }, + { + "at": "1789233168923528", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -99ms" + }, + { + "at": "1789233168923563", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168923594", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: down" + }, + { + "at": "1789233168923625", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923653", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0xc4521b29" + }, + { + "at": "1789233168923684", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923715", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923749", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168923780", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: init" + }, + { + "at": "1789233168923811", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168923842", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x8cb25190" + }, + { + "at": "1789233168923873", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168923907", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168923938", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168926377", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00004|bfd(handler40)|INFO|Interface ovn-67314e-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233168926481", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00005|bfd(handler40)|INFO|ovn-67314e-0: New remote min_rx." + }, + { + "at": "1789233168926527", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233168926562", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " flags: none" + }, + { + "at": "1789233168926596", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " my_disc:0x10864ed9 your_disc:0xcfbfe66f" + }, + { + "at": "1789233168926642", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233168926671", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233168926702", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233168926734", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168926764", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168926796", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168926827", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168926859", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now -4483929ms" + }, + { + "at": "1789233168926894", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168926927", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168926959", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168926991", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: down" + }, + { + "at": "1789233168927023", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927057", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927088", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927120", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927148", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927180", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927211", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927239", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168927273", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233168927304", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927339", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168927371", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00006|bfd(handler40)|INFO|ovn-67314e-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233168927407", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Forwarding: false" + }, + { + "at": "1789233168927514", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233168927546", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233168927578", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233168927609", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233168927636", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233168927668", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now +989ms" + }, + { + "at": "1789233168927700", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -1ms" + }, + { + "at": "1789233168927731", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233168927758", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: down" + }, + { + "at": "1789233168927789", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233168927817", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0xcfbfe66f" + }, + { + "at": "1789233168927848", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168927879", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168927910", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233168927941", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: init" + }, + { + "at": "1789233168927972", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233168928000", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0x10864ed9" + }, + { + "at": "1789233168928031", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233168928062", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233168928093", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233168928123", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00220|bridge|INFO|bridge incusovn16: added interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233168928159", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00221|bridge|INFO|bridge br-int: added interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6" + }, + { + "at": "1789233169749719", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00007|bfd(handler40)|INFO|Interface ovn-c29198-0 remote mult value 0 changed to 3" + }, + { + "at": "1789233169749802", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00008|bfd(handler40)|INFO|ovn-c29198-0: New remote min_rx." + }, + { + "at": "1789233169749820", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " vers:1 diag:\"No Diagnostic\" state:init mult:3 length:24" + }, + { + "at": "1789233169749836", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " flags: none" + }, + { + "at": "1789233169749847", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " my_disc:0xae7cb34c your_disc:0x61d86ef2" + }, + { + "at": "1789233169749861", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_tx:1000000us (1000ms)" + }, + { + "at": "1789233169749872", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_rx:1000000us (1000ms)" + }, + { + "at": "1789233169749882", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " min_rx_echo:0us (0ms) Forwarding: false" + }, + { + "at": "1789233169749895", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169749905", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169749927", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169749937", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169749949", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now -4484753ms" + }, + { + "at": "1789233169749969", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169749988", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750005", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233169750019", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: down" + }, + { + "at": "1789233169750030", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750040", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750053", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750064", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750078", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750089", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750100", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750111", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750126", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 0ms" + }, + { + "at": "1789233169750139", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750154", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233169750165", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00009|bfd(handler40)|INFO|ovn-c29198-0: BFD state change: (bfd.SessionState: down, bfd.LocalDiag: \"No Diagnostic\") -> (bfd.SessionState: up, bfd.LocalDiag: \"No Diagnostic\")" + }, + { + "at": "1789233169750177", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Forwarding: false" + }, + { + "at": "1789233169750188", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Multiplier: 3" + }, + { + "at": "1789233169750200", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Concatenated Path Down: false" + }, + { + "at": "1789233169750211", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " TX Interval: Approx 1000ms" + }, + { + "at": "1789233169750221", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " RX Interval: Approx 1000ms" + }, + { + "at": "1789233169750230", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Detect Time: now +3000ms" + }, + { + "at": "1789233169750241", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Next TX Time: now +894ms" + }, + { + "at": "1789233169750252", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Last TX Time: now -56ms" + }, + { + "at": "1789233169750263", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Flags: none" + }, + { + "at": "1789233169750273", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Session State: down" + }, + { + "at": "1789233169750285", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750295", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Discriminator: 0x61d86ef2" + }, + { + "at": "1789233169750305", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750323", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Local Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750337", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Flags: none" + }, + { + "at": "1789233169750350", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Session State: init" + }, + { + "at": "1789233169750363", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Diagnostic: No Diagnostic" + }, + { + "at": "1789233169750373", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Discriminator: 0xae7cb34c" + }, + { + "at": "1789233169750385", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum TX Interval: 1000ms" + }, + { + "at": "1789233169750397", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Minimum RX Interval: 1000ms" + }, + { + "at": "1789233169750408", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": " Remote Detect Multiplier: 3" + }, + { + "at": "1789233170158976", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00222|bridge|INFO|bridge br-int: added interface vethd42ad9e0 on port 7" + }, + { + "at": "1789233178826726", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00223|connmgr|INFO|br-int<->unix#3: 913 flow_mods in the 6 s starting 10 s ago (847 adds, 58 deletes, 8 modifications)" + }, + { + "at": "1789233193165011", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00224|bridge|INFO|bridge br-int: deleted interface vethd42ad9e0 on port 7" + }, + { + "at": "1789233195484004", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00225|bridge|INFO|bridge incusovn16: deleted interface incusovn16 on port 65534" + }, + { + "at": "1789233195484249", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00226|bridge|INFO|bridge incusovn16: deleted interface patch-incus-net39-ls-ext-lsp-provider-to-br-int on port 2" + }, + { + "at": "1789233195484344", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + }, + { + "at": "1789233195501004", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00228|bridge|INFO|bridge br-int: deleted interface patch-br-int-to-incus-net39-ls-ext-lsp-provider on port 6" + }, + { + "at": "1789233195501040", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00002|ofproto_dpif_monitor(monitor65)|INFO|monitor thread terminated" + } +] diff --git a/spikes/ovn/parent-recovery-2026-09-12/result.json b/spikes/ovn/parent-recovery-2026-09-12/result.json new file mode 100644 index 0000000..9f6f154 --- /dev/null +++ b/spikes/ovn/parent-recovery-2026-09-12/result.json @@ -0,0 +1,34 @@ +{ + "verdict": "PROCEED", + "root_cause": "default/soak01 raw macvlan eth1 and OVS compete for fast40 RX handler", + "cycle": { + "cycle": "cycle-1", + "ok": true, + "seconds": 31.018, + "router": "incus-net39-lr", + "gateway_chassis": "lab01.glab.lol", + "external_ip": "10.10.40.64", + "router_mac": "10:66:6a:66:eb:74", + "teardown": "done", + "network_create_seconds": 0.669 + }, + "ovs_busy_errors": 0, + "ovs_fast40_events": [ + { + "at": "1789233168919953", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00218|bridge|INFO|bridge incusovn16: added interface fast40 on port 1" + }, + { + "at": "1789233195484344", + "member": "lab01.glab.lol", + "boot_id": "b5e39bb2a73f421c9b89a935f9f116b2", + "message": "ovs|00227|bridge|INFO|bridge incusovn16: deleted interface fast40 on port 1" + } + ], + "required_rules": [ + "Exclusive fast40-uplink parent ownership; managed-only sandbox NICs and fleet default-project check", + "Central up for OVN control-plane operations; Errored networks reaper-deletable after recovery" + ] +} diff --git a/spikes/ovn/probe.sh b/spikes/ovn/probe.sh index d67f44f..5dc15b5 100755 --- a/spikes/ovn/probe.sh +++ b/spikes/ovn/probe.sh @@ -1,23 +1,31 @@ #!/usr/bin/env bash -# OVN connectivity probe for two already-placed disposable guests. +# OVN connectivity probe for two already-placed disposable guests, or a full +# create/probe/destroy cycle. # # Usage: # spikes/ovn/probe.sh \ # +# spikes/ovn/probe.sh cycle --evidence-dir PATH [--keep-on-failure] # -# Checks: network list/show; network type ovn; both instances Running on -# different members; eth0 attached to the given network with a global IPv4; -# guest eth0 MTU; cross-member ping both ways; curl internet egress from both -# guests; workstation GET of forward-url matches expected-body exactly; -# guest HTTP GET of 100000000-byte /large.bin both ways with sha256 match. +# Positional checks: network list/show; network type ovn; both instances Running +# on different members; eth0 attached to the given network with a global IPv4; +# guest eth0 MTU; cross-member ping both ways; gateway ping and DNS lookup from +# both guests; curl internet egress from both guests; workstation GET of +# forward-url matches expected-body exactly; guest HTTP GET of 100000000-byte +# /large.bin both ways with sha256 match. # -# Dependencies: bash, incus, curl, python3, jq. Guests need ping, curl, sha256sum. -# Bounds: incus 90s; ping -c 3 -W 2; curl --connect-timeout 5 --max-time 15 -# (large guest GET --max-time 60). Prints commands, output, elapsed_seconds. -# Writes /tmp/ovn-large.bin in each guest; does not create Incus resources. +# Cycle: one topology.py create, diagnostics, this probe, teardown. Default +# destroys owned resources even on failure. --keep-on-failure leaves them. +# Does not stop central, run keeper, or clear neighbor/ARP state. +# +# Dependencies: bash, incus, curl, python3, jq. Guests need ping, nslookup, +# curl, sha256sum. Bounds: incus 90s; ping -c 3 -W 2; curl --connect-timeout 5 +# --max-time 15 (large guest GET --max-time 60). Prints commands, output, +# elapsed_seconds. Writes /tmp/ovn-large.bin in each guest; positional mode +# does not create Incus resources. Cycle writes evidence-dir/cycle.json. set -euo pipefail -usage() { sed -n '2,17p' "$0"; } +usage() { sed -n '2,25p' "$0"; } die() { printf 'probe: %s\n' "$*" >&2; exit 1; } RUN_OUT="" @@ -28,7 +36,7 @@ path, args = sys.argv[1], sys.argv[2:] print("+ " + shlex.join(args), flush=True) t = time.monotonic() try: - r = subprocess.run(args, capture_output=True, timeout=90) + r = subprocess.run(args, capture_output=True, timeout=90, stdin=subprocess.DEVNULL) except subprocess.TimeoutExpired: open(path, "w").write("") print("elapsed_seconds=%.3f exit=timeout" % (time.monotonic() - t)) @@ -51,6 +59,12 @@ case "${1-}" in usage exit 0 ;; +cycle) + shift + command -v python3 >/dev/null || die "need python3 on PATH" + here="$(CDPATH= cd -- "$(dirname "$0")" && pwd)" + exec python3 "$here/cycle.py" "$@" + ;; --*) die "unknown option: $1" ;; esac [ "$#" -eq 7 ] || { usage >&2; die "expected remote project network instance1 instance2 forward-url expected-body"; } @@ -78,6 +92,9 @@ run incus network list "$prefix" --project "$project" || die "network list faile run incus network show "${prefix}${network}" --project "$project" || die "network show ${network} failed" [ "$(awk '/^type:/{print $2; exit}' "$RUN_OUT")" = ovn ] || die "network ${network} type is not ovn" +dns="$(awk '/dns.nameservers:/{print $2; exit}' "$RUN_OUT")" +[ -n "$dns" ] || die "network ${network} has no dns.nameservers" +printf 'dns.nameservers=%s\n' "$dns" run incus list "$prefix" --project "$project" --format json || die "instance list failed" list_json="$(cat "$RUN_OUT")" @@ -114,34 +131,57 @@ mtu2="$(tr -d '[:space:]' <"$RUN_OUT")" printf 'guest_mtu %s=%s %s=%s\n' "$instance1" "$mtu1" "$instance2" "$mtu2" [ -n "$mtu1" ] && [ -n "$mtu2" ] || die "empty eth0 MTU" -guest "$instance1" ping -c 3 -W 2 "$ip2" || die "ping ${instance1} -> ${ip2} failed" -guest "$instance2" ping -c 3 -W 2 "$ip1" || die "ping ${instance2} -> ${ip1} failed" +failures=0 +failed() { + printf 'probe: %s\n' "$*" >&2 + failures=$((failures + 1)) +} + +guest "$instance1" ping -c 3 -W 2 "$ip2" || failed "ping ${instance1} -> ${ip2} failed" +guest "$instance2" ping -c 3 -W 2 "$ip1" || failed "ping ${instance2} -> ${ip1} failed" + +guest "$instance1" ping -c 3 -W 2 "$dns" || failed "gateway ping ${instance1} -> ${dns} failed" +guest "$instance2" ping -c 3 -W 2 "$dns" || failed "gateway ping ${instance2} -> ${dns} failed" +guest "$instance1" nslookup example.com "$dns" || failed "dns lookup example.com from ${instance1} via ${dns} failed" +guest "$instance2" nslookup example.com "$dns" || failed "dns lookup example.com from ${instance2} via ${dns} failed" egress=(curl -4 -fsS --connect-timeout 5 --max-time 15 -o /dev/null https://example.com) -guest "$instance1" "${egress[@]}" || die "internet egress curl from ${instance1} failed" -guest "$instance2" "${egress[@]}" || die "internet egress curl from ${instance2} failed" +guest "$instance1" "${egress[@]}" || failed "internet egress curl from ${instance1} failed" +guest "$instance2" "${egress[@]}" || failed "internet egress curl from ${instance2} failed" -run curl -4 -fsS --connect-timeout 5 --max-time 15 "$forward_url" || die "workstation curl of forward-url failed" -python3 -c ' +if run curl -4 -fsS --connect-timeout 5 --max-time 15 "$forward_url"; then + python3 -c ' import sys actual = open(sys.argv[1], "rb").read() expected = sys.argv[2].encode() if actual != expected: sys.stderr.write("probe: forward-url body mismatch: got %d bytes, expected %d\n" % (len(actual), len(expected))) sys.exit(1) -' "$RUN_OUT" "$expected_body" || die "forward-url body did not match expected-body" +' "$RUN_OUT" "$expected_body" || failed "forward-url body did not match expected-body" +else + failed "workstation curl of forward-url failed" +fi expected_hash="a993f8c574e0fea8c1cdcbcd9408d9e2e107ee6e4d120edcfa11decd53fa0cae" -guest "$instance1" curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin "http://${ip2}:8080/large.bin" || - die "large GET ${instance1} <- ${ip2} failed" -guest "$instance1" sha256sum /tmp/ovn-large.bin || die "sha256sum on ${instance1} failed" -hash1="$(awk '{print $1}' "$RUN_OUT")" -[ "$hash1" = "$expected_hash" ] || die "large GET ${instance1} <- ${ip2} sha256 ${hash1} != ${expected_hash}" -guest "$instance2" curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin "http://${ip1}:8080/large.bin" || - die "large GET ${instance2} <- ${ip1} failed" -guest "$instance2" sha256sum /tmp/ovn-large.bin || die "sha256sum on ${instance2} failed" -hash2="$(awk '{print $1}' "$RUN_OUT")" -[ "$hash2" = "$expected_hash" ] || die "large GET ${instance2} <- ${ip1} sha256 ${hash2} != ${expected_hash}" -printf 'large_transfer bytes=100000000 sha256=%s both_directions=ok\n' "$expected_hash" - +hash1="" +hash2="" +if guest "$instance1" curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin "http://${ip2}:8080/large.bin" && + guest "$instance1" sha256sum /tmp/ovn-large.bin; then + hash1="$(awk '{print $1}' "$RUN_OUT")" + [ "$hash1" = "$expected_hash" ] || failed "large GET ${instance1} <- ${ip2} sha256 ${hash1} != ${expected_hash}" +else + failed "large GET/hash ${instance1} <- ${ip2} failed" +fi +if guest "$instance2" curl -4 -fsS --connect-timeout 5 --max-time 60 -w 'bytes=%{size_download} seconds=%{time_total} bytes_per_second=%{speed_download}\n' -o /tmp/ovn-large.bin "http://${ip1}:8080/large.bin" && + guest "$instance2" sha256sum /tmp/ovn-large.bin; then + hash2="$(awk '{print $1}' "$RUN_OUT")" + [ "$hash2" = "$expected_hash" ] || failed "large GET ${instance2} <- ${ip1} sha256 ${hash2} != ${expected_hash}" +else + failed "large GET/hash ${instance2} <- ${ip1} failed" +fi +if [ "$hash1" = "$expected_hash" ] && [ "$hash2" = "$expected_hash" ]; then + printf 'large_transfer bytes=100000000 sha256=%s both_directions=ok\n' "$expected_hash" +fi + +[ "$failures" -eq 0 ] || die "${failures} datapath checks failed" printf 'probe passed placement=%s:%s ipv4=%s:%s\n' "$location1" "$location2" "$ip1" "$ip2" diff --git a/spikes/ovn/topology.py b/spikes/ovn/topology.py index 335f6c4..8a5eaf9 100755 --- a/spikes/ovn/topology.py +++ b/spikes/ovn/topology.py @@ -9,11 +9,19 @@ treat HTTP 404/not-found as a failed GET. create-network is one bounded attempt with no retries or hidden cleanup. """ + import argparse +import hashlib +import io import json +import re import subprocess import sys +import tarfile +import tempfile import time +import urllib.request +from concurrent.futures import ThreadPoolExecutor from pathlib import Path REMOTE = "nas01" @@ -53,6 +61,7 @@ WAIT_IP_POLL = 2 LOG = None +TOOLS_BUNDLE = None class TopologyError(Exception): @@ -81,12 +90,23 @@ def incus(*args, check=True, timeout=COMMAND_TIMEOUT): started = time.monotonic() try: result = subprocess.run( - ["incus", *args], capture_output=True, text=True, timeout=timeout + ["incus", *args], + capture_output=True, + text=True, + timeout=timeout, + stdin=subprocess.DEVNULL, ) - error = None except subprocess.TimeoutExpired as exc: - stdout = exc.stdout if isinstance(exc.stdout, str) else (exc.stdout or b"").decode("utf-8", "replace") - stderr = exc.stderr if isinstance(exc.stderr, str) else (exc.stderr or b"").decode("utf-8", "replace") + stdout = ( + exc.stdout + if isinstance(exc.stdout, str) + else (exc.stdout or b"").decode("utf-8", "replace") + ) + stderr = ( + exc.stderr + if isinstance(exc.stderr, str) + else (exc.stderr or b"").decode("utf-8", "replace") + ) event = { "args": args, "code": None, @@ -105,7 +125,13 @@ def incus(*args, check=True, timeout=COMMAND_TIMEOUT): "seconds": round(time.monotonic() - started, 3), "stdout": result.stdout, "stderr": result.stderr, - "error": None if result.returncode == 0 else (result.stderr.strip() or result.stdout.strip() or f"exit {result.returncode}"), + "error": None + if result.returncode == 0 + else ( + result.stderr.strip() + or result.stdout.strip() + or f"exit {result.returncode}" + ), } log_event(event) if check and result.returncode: @@ -140,21 +166,29 @@ def query(path, method="GET", data=None, check=True, timeout=COMMAND_TIMEOUT): def get_existing(path): - result = incus("query", remote_prefix() + path, "--request", "GET", "--wait", check=False) + result = incus( + "query", remote_prefix() + path, "--request", "GET", "--wait", check=False + ) if result.returncode == 0: return json.loads(result.stdout) if result.stdout.strip() else {} if is_absent(result): return None - raise TopologyError(f"GET {path} failed: {result.stderr.strip() or result.stdout.strip() or f'exit {result.returncode}'}") + raise TopologyError( + f"GET {path} failed: {result.stderr.strip() or result.stdout.strip() or f'exit {result.returncode}'}" + ) def list_or_absent(path): - result = incus("query", remote_prefix() + path, "--request", "GET", "--wait", check=False) + result = incus( + "query", remote_prefix() + path, "--request", "GET", "--wait", check=False + ) if result.returncode == 0: return json.loads(result.stdout) if result.stdout.strip() else [] if is_absent(result): return [] - raise TopologyError(f"GET {path} failed: {result.stderr.strip() or result.stdout.strip() or f'exit {result.returncode}'}") + raise TopologyError( + f"GET {path} failed: {result.stderr.strip() or result.stdout.strip() or f'exit {result.returncode}'}" + ) def emit(payload, code=0): @@ -199,7 +233,9 @@ def require_owned_project(): return None config = found.get("config") or {} if config.get(OWNER_KEY) != OWNER_VALUE: - raise TopologyError(f"project {PROJECT} exists without {OWNER_KEY}={OWNER_VALUE}; refusing") + raise TopologyError( + f"project {PROJECT} exists without {OWNER_KEY}={OWNER_VALUE}; refusing" + ) return found @@ -231,7 +267,9 @@ def wait_router_external(): network = get_existing(f"/1.0/networks/{NETWORK}?project={PROJECT}") external = router_external_ipv4(network) if not external: - state = get_existing(f"/1.0/networks/{NETWORK}/state?project={PROJECT}") or {} + state = ( + get_existing(f"/1.0/networks/{NETWORK}/state?project={PROJECT}") or {} + ) external = router_external_ipv4(state) last = external if external: @@ -247,12 +285,18 @@ def wait_ipv4(name): state = get_existing(f"/1.0/instances/{name}/state?project={PROJECT}") last = state if state: - nic = ((state.get("network") or {}).get("eth0") or {}) + nic = (state.get("network") or {}).get("eth0") or {} for addr in nic.get("addresses") or []: - if addr.get("family") == "inet" and addr.get("scope") == "global" and addr.get("address"): + if ( + addr.get("family") == "inet" + and addr.get("scope") == "global" + and addr.get("address") + ): return addr["address"] time.sleep(WAIT_IP_POLL) - raise TopologyError(f"instance {name} got no global eth0 IPv4 within {WAIT_IP_SECONDS}s: {last}") + raise TopologyError( + f"instance {name} got no global eth0 IPv4 within {WAIT_IP_SECONDS}s: {last}" + ) def wait_ping(name, address): @@ -267,7 +311,9 @@ def wait_ping(name, address): detail = "" if last is not None: detail = (last.stderr or last.stdout or f"exit {last.returncode}").strip() - raise TopologyError(f"ping {name} -> {address} failed within {WAIT_IP_SECONDS}s: {detail}") + raise TopologyError( + f"ping {name} -> {address} failed within {WAIT_IP_SECONDS}s: {detail}" + ) def guest(name, command, check=True): @@ -284,9 +330,92 @@ def guest(name, command, check=True): ) +def prepare_tools_bundle(directory): + """Fetch the probe tools without depending on the datapath under test.""" + repository = f"{ALPINE_MAIN}/x86_64" + with urllib.request.urlopen( + f"{repository}/APKINDEX.tar.gz", timeout=30 + ) as response: + index_bytes = response.read() + with tarfile.open(fileobj=io.BytesIO(index_bytes), mode="r:gz") as archive: + index = archive.extractfile("APKINDEX").read().decode() + packages = [ + dict(line.split(":", 1) for line in block.splitlines() if ":" in line) + for block in index.strip().split("\n\n") + ] + by_name = {package["P"]: package for package in packages} + providers = {} + for package in packages: + for capability in package.get("p", "").split(): + providers.setdefault(re.split(r"[<>=~]", capability, 1)[0], []).append( + package["P"] + ) + selected = {} + pending = ["curl", "busybox-extras"] + while pending: + dependency = pending.pop() + if dependency.startswith("!"): + continue + name = re.split(r"[<>=~]", dependency, 1)[0] + candidates = [name] if name in by_name else providers.get(name, []) + if len(candidates) != 1: + raise TopologyError( + f"cannot resolve one provider for {dependency}: {candidates}" + ) + name = candidates[0] + if name not in selected: + selected[name] = by_name[name] + pending.extend(by_name[name].get("D", "").split()) + + def fetch(package): + filename = f"{package['P']}-{package['V']}.apk" + if not re.fullmatch(r"[A-Za-z0-9+_.-]+", filename): + raise TopologyError(f"invalid APK filename: {filename}") + with urllib.request.urlopen(f"{repository}/{filename}", timeout=30) as response: + return filename, response.read() + + bundle = Path(directory) / "probe-tools.tar" + manifest = [] + with ( + ThreadPoolExecutor(max_workers=8) as pool, + tarfile.open(bundle, "w") as archive, + ): + for filename, data in pool.map( + fetch, [selected[name] for name in sorted(selected)] + ): + info = tarfile.TarInfo(filename) + info.size = len(data) + info.mode = 0o644 + archive.addfile(info, io.BytesIO(data)) + manifest.append( + {"file": filename, "sha256": hashlib.sha256(data).hexdigest()} + ) + log_event( + { + "phase": "prepare-probe-tools", + "repository": repository, + "index_sha256": hashlib.sha256(index_bytes).hexdigest(), + "packages": manifest, + "signature_check": "apk verifies signatures with the guest's trusted Alpine keys", + } + ) + return bundle + + def install_curl(name): - guest(name, f"printf '%s\\n' '{ALPINE_MAIN}' > /etc/apk/repositories") - guest(name, "apk add --no-cache curl busybox-extras") + incus( + "file", + "push", + str(TOOLS_BUNDLE), + f"{remote_prefix()}{name}/tmp/probe-tools.tar", + "--project", + PROJECT, + ) + guest( + name, + "mkdir -p /tmp/probe-tools && tar -xf /tmp/probe-tools.tar -C /tmp/probe-tools", + ) + guest(name, "apk add --no-network /tmp/probe-tools/*.apk") def start_httpd(name): @@ -379,7 +508,9 @@ def cmd_create(): loc_one = (inst_one or {}).get("location") or "" loc_two = (inst_two or {}).get("location") or "" if loc_one != MEMBER_ONE or loc_two != MEMBER_TWO: - raise TopologyError(f"placement {loc_one}/{loc_two} != {MEMBER_ONE}/{MEMBER_TWO}") + raise TopologyError( + f"placement {loc_one}/{loc_two} != {MEMBER_ONE}/{MEMBER_TWO}" + ) wait_ping(INSTANCE_ONE, ip_two) first_cross_member_ping_seconds = round(time.monotonic() - network_created_at, 3) @@ -449,7 +580,11 @@ def cmd_create_network(): uplink = get_existing(f"/1.0/networks/{OVN_UPLINK}?project=default") if uplink is None: raise TopologyError(f"uplink {OVN_UPLINK} is absent in default project") - payload = {"name": AUX_NETWORK, "type": "ovn", "config": ovn_network_config(AUX_SUBNET)} + payload = { + "name": AUX_NETWORK, + "type": "ovn", + "config": ovn_network_config(AUX_SUBNET), + } started = time.monotonic() result = incus( "query", @@ -472,20 +607,29 @@ def cmd_create_network(): "seconds": seconds, "stdout": result.stdout, "stderr": result.stderr, - "error": None if result.returncode == 0 else (result.stderr.strip() or result.stdout.strip() or f"exit {result.returncode}"), + "error": None + if result.returncode == 0 + else ( + result.stderr.strip() + or result.stdout.strip() + or f"exit {result.returncode}" + ), } emit(body, 0 if result.returncode == 0 else 1) def delete_named_network(name): - forwards = list_or_absent(f"/1.0/networks/{name}/forwards?project={PROJECT}&recursion=1") + forwards = list_or_absent( + f"/1.0/networks/{name}/forwards?project={PROJECT}&recursion=1" + ) for forward in forwards: listen = forward.get("listen_address") if not listen: continue result = incus( "query", - remote_prefix() + f"/1.0/networks/{name}/forwards/{listen}?project={PROJECT}", + remote_prefix() + + f"/1.0/networks/{name}/forwards/{listen}?project={PROJECT}", "--request", "DELETE", "--wait", @@ -541,7 +685,14 @@ def delete_project_images(): fingerprint = image.get("fingerprint") if not fingerprint: continue - result = incus("image", "delete", remote_prefix() + fingerprint, "--project", PROJECT, check=False) + result = incus( + "image", + "delete", + remote_prefix() + fingerprint, + "--project", + PROJECT, + check=False, + ) if result.returncode and not is_absent(result): yield f"image {fingerprint}: {result.stderr.strip() or result.stdout.strip()}" @@ -550,10 +701,14 @@ def cmd_destroy(): projects = list_or_absent("/1.0/projects?recursion=1") found = next((p for p in projects if p.get("name") == PROJECT), None) if found is None: - emit({"project": PROJECT, "destroyed": False, "reason": "absent", "failures": []}) + emit( + {"project": PROJECT, "destroyed": False, "reason": "absent", "failures": []} + ) config = found.get("config") or {} if config.get(OWNER_KEY) != OWNER_VALUE: - raise TopologyError(f"project {PROJECT} is not owned ({OWNER_KEY}!={OWNER_VALUE}); refusing destroy") + raise TopologyError( + f"project {PROJECT} is not owned ({OWNER_KEY}!={OWNER_VALUE}); refusing destroy" + ) failures = [] instances = list_or_absent(f"/1.0/instances?project={PROJECT}&recursion=1") @@ -561,9 +716,13 @@ def cmd_destroy(): name = instance.get("name") if not name: continue - result = incus("delete", "-f", remote_prefix() + name, "--project", PROJECT, check=False) + result = incus( + "delete", "-f", remote_prefix() + name, "--project", PROJECT, check=False + ) if result.returncode and not is_absent(result): - failures.append(f"instance {name}: {result.stderr.strip() or result.stdout.strip()}") + failures.append( + f"instance {name}: {result.stderr.strip() or result.stdout.strip()}" + ) networks = list_or_absent(f"/1.0/networks?project={PROJECT}&recursion=1") for network in networks: @@ -586,13 +745,17 @@ def cmd_destroy(): check=False, ) if result.returncode and not is_absent(result): - failures.append(f"profile {name}: {result.stderr.strip() or result.stdout.strip()}") + failures.append( + f"profile {name}: {result.stderr.strip() or result.stdout.strip()}" + ) failures.extend(delete_project_images()) result = incus("project", "delete", remote_prefix() + PROJECT, check=False) if result.returncode and not is_absent(result): - failures.append(f"project {PROJECT}: {result.stderr.strip() or result.stdout.strip()}") + failures.append( + f"project {PROJECT}: {result.stderr.strip() or result.stdout.strip()}" + ) emit( {"project": PROJECT, "destroyed": not failures, "failures": failures}, @@ -601,15 +764,22 @@ def cmd_destroy(): def main(argv=None): - global REMOTE, LOG + global REMOTE, LOG, TOOLS_BUNDLE parser = argparse.ArgumentParser(description=__doc__.split("\n\n", 1)[0]) parser.add_argument("--log", required=True, help="append-only JSONL command log") parser.add_argument("--remote", default=REMOTE, help="Incus remote (default nas01)") sub = parser.add_subparsers(dest="command", required=True) - sub.add_parser("create", help="create owned project, OVN network, guests, forward, HTTP fixture") + sub.add_parser( + "create", + help="create owned project, OVN network, guests, forward, HTTP fixture", + ) sub.add_parser("destroy", help="destroy owned project only, in dependency order") - sub.add_parser("create-network", help="create auxiliary recovery network once; no retries") - sub.add_parser("delete-network", help="delete auxiliary recovery network if present") + sub.add_parser( + "create-network", help="create auxiliary recovery network once; no retries" + ) + sub.add_parser( + "delete-network", help="delete auxiliary recovery network if present" + ) args = parser.parse_args(argv) REMOTE = args.remote path = Path(args.log) @@ -617,7 +787,9 @@ def main(argv=None): LOG = path.open("a", encoding="utf-8") try: if args.command == "create": - cmd_create() + with tempfile.TemporaryDirectory(prefix="ovn-probe-tools-") as directory: + TOOLS_BUNDLE = prepare_tools_bundle(directory) + cmd_create() elif args.command == "destroy": cmd_destroy() elif args.command == "create-network": @@ -626,8 +798,17 @@ def main(argv=None): cmd_delete_network() else: raise TopologyError(f"unknown command {args.command}") - except TopologyError as exc: - log_event({"args": [args.command], "code": 1, "seconds": 0, "stdout": "", "stderr": str(exc), "error": str(exc)}) + except (TopologyError, OSError, ValueError) as exc: + log_event( + { + "args": [args.command], + "code": 1, + "seconds": 0, + "stdout": "", + "stderr": str(exc), + "error": str(exc), + } + ) print(str(exc), file=sys.stderr) emit({"error": str(exc)}, 1) finally: